-- Logs begin at Mon 2021-11-15 23:51:52 UTC, end at Tue 2021-11-16 01:18:57 UTC. -- Nov 16 00:18:50.439429 dv-cinder-811155-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Nov 16 00:18:50.446763 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 16 00:18:50 2021] *** Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: nodename: dv-cinder-811155-2-iscsi Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: machine: x86_64 Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: clock source: unix Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: pcre jit disabled Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: detected number of CPU cores: 4 Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: current working directory: / Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: detected binary path: /usr/bin/uwsgi-core Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: your processes number limit is 47680 Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: your memory page size is 4096 bytes Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: detected max file descriptor number: 2048 Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: lock engine: pthread robust mutexes Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: thunder lock: enabled Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 16 00:18:50.450099 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 16 00:18:50.496104 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: Python main interpreter initialized at 0x55ce008579c0 Nov 16 00:18:50.496104 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: python threads support enabled Nov 16 00:18:50.496104 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: your server socket listen backlog is limited to 100 connections Nov 16 00:18:50.496104 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: your mercy for graceful operations on workers is 90 seconds Nov 16 00:18:50.496460 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: mapped 403077 bytes (393 KB) for 2 cores Nov 16 00:18:50.496518 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: *** Operational MODE: preforking *** Nov 16 00:18:50.496800 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: *** uWSGI is running in multiple interpreter mode *** Nov 16 00:18:50.496800 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: spawned uWSGI master process (pid: 85985) Nov 16 00:18:50.497000 dv-cinder-811155-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Nov 16 00:18:50.498810 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: spawned uWSGI worker 1 (pid: 86000, cores: 1) Nov 16 00:18:50.498810 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: spawned uWSGI worker 2 (pid: 86001, cores: 1) Nov 16 00:18:50.499638 dv-cinder-811155-2-iscsi devstack@keystone.service[85985]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 16 00:18:55.617793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 00:18:55.617793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: from cryptography.utils import int_from_bytes Nov 16 00:18:55.618607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 00:18:55.618607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: from cryptography.utils import int_from_bytes Nov 16 00:18:55.619080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 00:18:55.619080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: from cryptography.utils import int_from_bytes Nov 16 00:18:55.619201 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 00:18:55.619201 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: from cryptography.utils import int_from_bytes Nov 16 00:18:55.667576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 00:18:55.667745 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 00:18:55.667939 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] command line args: [] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 00:18:55.668206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 00:18:55.668382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ================================================================================ {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 00:18:55.668636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] admin_token = **** {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.668718 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 00:18:55.668847 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 00:18:55.668931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] config_dir = [] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.669040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] command line args: [] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 00:18:55.669128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.669209 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] config_source = [] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.669313 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 00:18:55.669399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] debug = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.669478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ================================================================================ {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 00:18:55.669561 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.669825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] admin_token = **** {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.669951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.670036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] config_dir = [] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.670103 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.670174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.670309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] config_source = [] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.670423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.670523 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] debug = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.670625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.670744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.670902 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] list_limit = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.671013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.671110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] log_config_append = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.671222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.671318 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.671318 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] log_dir = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.671513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.671614 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] log_file = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.671715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.671817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.671918 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] list_limit = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.672007 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.672088 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] log_config_append = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.672212 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.672332 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.672415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] log_dir = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.672532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.672625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] log_file = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.672705 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.672786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.672911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.672995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.673069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.673195 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.673276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.673380 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.673469 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.673549 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.673678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.673761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.673841 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.673965 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.674043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.674190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.674284 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.674426 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.674513 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.674662 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.674790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.674919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.675156 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.675285 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.675406 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.675493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] publish_errors = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.675654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.675741 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.675887 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.675969 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.676067 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.676317 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.676403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.676551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.676636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] publish_errors = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.676786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] standard_threads = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.676876 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.677044 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.677131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.677210 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.677463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.677555 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.677686 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.677771 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.677869 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] use_journal = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.677955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] standard_threads = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.678041 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] use_json = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.678143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.678223 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] use_stderr = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.678372 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] use_syslog = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.678456 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.678535 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.678617 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.678716 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] use_journal = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.678867 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.678952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] use_json = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.679091 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] use_stderr = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.679176 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.679261 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] use_syslog = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.679361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.679486 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:18:55.679601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.679744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.679850 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.679986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.680073 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.680250 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.680330 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.680492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.680577 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.680747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.680834 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.680987 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.681071 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.681239 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.681320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.681471 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.681555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.681715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.681794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.681951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.682026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.682197 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.682294 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.682432 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.682521 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.682662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.682740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.682930 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.683011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.683181 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.683262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.683413 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.683498 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.683657 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.683737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.683915 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.684002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.684163 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.684241 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.684398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.684477 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.684625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.684709 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.684853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.684944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.685082 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.685162 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.685316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.685396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.685562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.685650 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.685806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.685896 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.686034 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.686120 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.686264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.686419 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.686502 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.686575 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.686739 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.686824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.686996 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.687091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.687231 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.687311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.687459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.687538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.687693 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.687781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.687921 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.688015 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.688151 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.688237 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.688379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.688466 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.688607 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.688686 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.688834 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.688920 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.689066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.689153 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.689298 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.689377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.689525 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.689634 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.689754 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.689865 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.689963 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.690066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.690197 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.690302 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.690429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.690544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.690671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.690757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.690922 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.691046 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.691158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.691277 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.691406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.691486 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.691603 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.691680 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.691829 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.691952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.692060 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.692185 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.692286 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.692367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.693082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.693188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.693320 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.693397 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.693545 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.693630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.693760 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.693839 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.694016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.694104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.694253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.694345 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.694504 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.694623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.694717 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.694796 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.694968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.695052 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.695218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.695299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.695451 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.695531 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.695687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.695764 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.695918 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.695996 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.696163 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.696243 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.696396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.696477 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.696628 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.696707 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.696863 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.696951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.697096 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.697175 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.697325 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.697404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.697556 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.697642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.697793 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.697871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.698033 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.698112 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.698269 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.698357 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.698480 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.698569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.698708 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.698787 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.698962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.699052 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.699196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.699281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.699424 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.699503 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.699660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.699740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.699890 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.699967 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.700130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.700215 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.700359 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.700438 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.700599 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.700686 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.700837 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.700916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.701073 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.701159 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.701302 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] auth.external = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.701388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.701530 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.701609 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.701805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.702051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.702286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] auth.external = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.702520 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.702819 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.703078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.703165 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.703312 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] auth.password = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.703394 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.703544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] auth.token = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.703649 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] auth.password = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.703787 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.703900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] auth.token = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.704026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.704162 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.704395 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.704474 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.704632 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.704711 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.704885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.704970 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.705133 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.705216 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.705367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.705446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.705605 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.705684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] credential.caching = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.705845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] credential.caching = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.705935 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.706094 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.706172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.706342 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.706430 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.706579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.706659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.706819 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.706928 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.707082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.707160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.707315 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.707396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.707563 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.707642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.707803 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.707881 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.708039 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.708746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.708963 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.709052 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.709320 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.709446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.709604 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.709789 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.709894 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.710108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.710246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.710382 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] federation.caching = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.710530 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.710655 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.710783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.710956 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.711090 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] federation.caching = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.711222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.711373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.711503 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.711647 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.711786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.711928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.712060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.712209 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.712343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.712476 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.712601 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.712725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.712852 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.712996 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.713131 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.713260 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.713396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.713533 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.713679 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity.caching = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.713818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.713951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.714086 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.714224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.714361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity.caching = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.714629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.714725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.714810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.714910 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.714986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.715058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.715144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.715221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.715294 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.715366 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.715366 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.715506 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.715587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.715669 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.715669 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.715816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.715890 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.716081 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.716293 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.716376 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.716568 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.716732 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.716812 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.717065 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.717153 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.717319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.717488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.717637 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.717779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.717922 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.718079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.718079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.718391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.718496 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.718582 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.718659 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.718742 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.718806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.718944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.719130 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.719213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.719383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.719477 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.719626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.719715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.719860 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.719950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.720098 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.720194 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.720329 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.720412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.720565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.720647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.720811 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.720903 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.721062 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.721270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.721352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.721520 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.721990 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.722082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.722229 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.722426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.722508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.722703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.722937 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.723035 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.723204 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.723329 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.723578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.723659 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.723863 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.724124 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.724342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.724551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.724759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.724759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.725145 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.725367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.725578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.725783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.725987 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.726197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.726422 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.726623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.726769 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.726923 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.727052 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.727183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.727325 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.727456 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.727586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.727724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.727854 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.727937 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728010 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728074 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728074 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728423 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728659 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728726 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728788 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728847 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.728965 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.729024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.729158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.729231 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.729419 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.729490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.729651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.729722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.729899 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.729971 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.730154 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.730234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.730702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.730852 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.731002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.731134 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.731265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.731394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.731522 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.731653 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.731790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.731921 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.732051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.732180 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.732309 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.732438 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.732535 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.732607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.732670 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.732730 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.732789 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.732848 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.732916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.732978 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.733132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.733260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.733391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.733520 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.733660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.733789 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.733919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.734064 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.734254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.734441 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.734635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.734814 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.735062 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.735197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.735306 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.735415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] resource.caching = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.735527 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.735628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.735876 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.736056 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.736241 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.736427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.736645 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.736822 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.736997 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.737184 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.737377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.737558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.737765 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.737892 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.738002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.738121 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.738234 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.738343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.738570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.738783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] role.caching = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.739015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.739187 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] role.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.739430 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.739614 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.739815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] resource.caching = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.740003 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.740186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.740319 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.740458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.740585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.740790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.740790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.741039 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.741178 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.741307 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.741442 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.741575 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.741700 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.741827 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.741952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.741952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.742198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.742198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.742437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] role.caching = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.742568 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.742694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] role.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.742819 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.742998 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.743132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.743263 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.743394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.743522 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.743522 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.743775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.743905 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.744035 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.744166 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.744294 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.744426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.744563 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.744704 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.744833 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.744917 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.744980 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.745110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.745247 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.745379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.745509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.745638 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.745768 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.745896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.746034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.746165 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.746305 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.746435 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.746564 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.746694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.746850 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.746982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.747109 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.747236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.747362 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.747503 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.747636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.747762 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.747893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.748030 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.748162 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.748296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.748427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.748427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] token.caching = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.748674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.748805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.748936 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.748936 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.749192 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.749319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.749450 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.749581 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.749706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.749849 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.749982 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.750109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.750240 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.750366 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.750496 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.750630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.750762 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.750948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.751075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.751214 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.751343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.751482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] token.caching = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.751620 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.751755 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.751883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.752011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.752138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.752277 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.752407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.752543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.752673 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.752801 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.752929 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.753064 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.753193 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.753324 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.753463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.connection = **** {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.753594 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.753723 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.753858 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.753986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.754114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.754260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.754389 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.754519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.754658 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.754788 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.755462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.755625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.755809 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.755981 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.756076 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.756197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.756368 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.756492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.756620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.756748 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.756883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.connection = **** {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.757011 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.757147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.757283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.757411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.757537 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.757674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.757810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.757937 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.758063 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.758191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.758317 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.758443 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.758578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.758706 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.758706 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.758990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.758990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86001) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 00:18:55.759237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.759237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.759237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.759237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.759237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.759237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.759237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.759237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.759237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.760362 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:18:55.760362 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 00:18:55.784148 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.784379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.784605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.785328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.785564 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.785793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.793541 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.794584 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.822340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.822573 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.823041 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.823275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.876905 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.877184 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.927422 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.927694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.927820 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:55.927926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.080176 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.080407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.080638 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.080866 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.081090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.081311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.084824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.085054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.085277 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.085496 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.085715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.085936 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.105027 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.105277 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.105373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.105471 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.105563 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.105690 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.105775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.105912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.105996 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.106127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.106212 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.106341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.106424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.106579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.117963 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.118550 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.131269 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.131384 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.131457 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.131624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.131721 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.131852 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.131936 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.132078 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.132161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.132294 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.132378 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.132508 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86000) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.132591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.132722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86001) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 00:18:56.149747 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.149955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 16 00:18:56.150286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.150372 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.150486 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 16 00:18:56.150567 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 16 00:18:56.150757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.150864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.151043 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 16 00:18:56.151126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.151302 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.151396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.151558 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.151639 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.151818 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.152076 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.162179 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.162447 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.162715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.162950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.163036 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.163230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.163500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.163784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.171193 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.171723 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.174365 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.174642 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.174937 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.175023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.175217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.175300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.175496 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.175900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.175993 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.176069 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.176143 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.176217 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.176299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.176375 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.176512 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.176652 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.176780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.177480 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.177651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.178067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.178067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.178263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.203841 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.204562 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.205403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.205681 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.206276 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.206556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.211196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.211871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.211967 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.212043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.212118 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.212293 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.218993 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.219271 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.219408 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.219692 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.224032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.224378 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.224469 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.224785 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.224871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.225079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.225174 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.225361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.225498 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.225636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.225795 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.225910 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.226061 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.226181 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.226332 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.226451 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.245282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.245448 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.245566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.245723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.250129 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.250221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.253687 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.253775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.253984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.254065 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.259511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.259700 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.263065 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.263250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.266875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.267180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.267459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.267736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.268010 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.268185 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.268273 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.268490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.268777 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.269063 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.269345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.269626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.287643 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.287924 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.288185 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.288443 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.288784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.290198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.290198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.290198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.298355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.298486 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.298629 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.298924 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.299113 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.299393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.302954 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.303242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.303549 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.303810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.304088 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.305310 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.305594 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.305875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.306168 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.306591 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.317982 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.318273 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.318557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.318857 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.319149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.319428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.319708 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.321923 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.322205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.322492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.322771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.323174 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.323453 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.323728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.337407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.340614 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.341082 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.343887 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.344292 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.345454 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.347354 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.347644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.347808 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.347925 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.350094 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.351723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.352000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.352276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.355918 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.357508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.359379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.360694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.360942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.361030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.361259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.361538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.364110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.365010 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.365518 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.365798 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.371444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.371734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.372125 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.374896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.375183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.375462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.379835 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86001) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.380173 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.380454 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.380733 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.381009 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.381332 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.381577 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.381856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.382138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.382416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.382703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.382997 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.383161 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86000) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 00:18:56.383275 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.383439 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.383535 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86001) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.383714 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.383991 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.384261 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.384631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.384911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.385185 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.385459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.385741 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.386015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.386275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.386534 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.386790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86000) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 00:18:56.421357 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce008579c0 pid: 86001 (default app) Nov 16 00:18:56.423965 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce008579c0 pid: 86000 (default app) Nov 16 00:18:56.424651 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025bbaa-5edd-48bc-b7c0-a22ed9a4e2f4 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:18:56.424949 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025bbaa-5edd-48bc-b7c0-a22ed9a4e2f4 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:18:56.425231 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025bbaa-5edd-48bc-b7c0-a22ed9a4e2f4 None None] PATH_INFO: `/v3` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:18:56.430872 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Tue Nov 16 00:18:56 2021] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:04.162453 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c61af-cebf-436b-871f-bb944efa533e None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:04.162978 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c61af-cebf-436b-871f-bb944efa533e None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:04.163059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c61af-cebf-436b-871f-bb944efa533e None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:04.168745 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:04 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:04.174650 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff549b7-21f7-4599-9bb1-0057753d30b8 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:04.175077 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff549b7-21f7-4599-9bb1-0057753d30b8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:04.175238 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff549b7-21f7-4599-9bb1-0057753d30b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:04.206931 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG oslo_db.sqlalchemy.engines [None req-bff549b7-21f7-4599-9bb1-0057753d30b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86001) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:19:04.392410 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG passlib.handlers.bcrypt [None req-bff549b7-21f7-4599-9bb1-0057753d30b8 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86001) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 16 00:19:04.392849 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG passlib.handlers.bcrypt [None req-bff549b7-21f7-4599-9bb1-0057753d30b8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86001) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 16 00:19:04.448563 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-bff549b7-21f7-4599-9bb1-0057753d30b8 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:04.450174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-bff549b7-21f7-4599-9bb1-0057753d30b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:04.610713 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:04.745329 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c61af-cebf-436b-871f-bb944efa533e None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:04.780381 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG oslo_db.sqlalchemy.engines [None req-2d4c61af-cebf-436b-871f-bb944efa533e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:19:04.917252 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c61af-cebf-436b-871f-bb944efa533e None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:04.921424 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061347c2-b304-4bdb-9be1-e9d7c2f51b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:04.922080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061347c2-b304-4bdb-9be1-e9d7c2f51b79 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:04.922364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061347c2-b304-4bdb-9be1-e9d7c2f51b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:04.922640 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061347c2-b304-4bdb-9be1-e9d7c2f51b79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:04.931940 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061347c2-b304-4bdb-9be1-e9d7c2f51b79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:04.982773 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.common.rbac_enforcer.enforcer [None req-061347c2-b304-4bdb-9be1-e9d7c2f51b79 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 16 00:19:04.983132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061347c2-b304-4bdb-9be1-e9d7c2f51b79 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:04.993484 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:19:05.000051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff549b7-21f7-4599-9bb1-0057753d30b8 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:05.015051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff549b7-21f7-4599-9bb1-0057753d30b8 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:05.019528 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a4b72-bdcc-48b3-a906-40666a4c5df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:05.020657 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a4b72-bdcc-48b3-a906-40666a4c5df4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:05.020951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a4b72-bdcc-48b3-a906-40666a4c5df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:05.021242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a4b72-bdcc-48b3-a906-40666a4c5df4 admin admin] PATH_INFO: `/v3/projects/7aec0bf3f5ba404495a1eab25f1fe71c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:05.022733 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a4b72-bdcc-48b3-a906-40666a4c5df4 admin admin] RBAC: Authorizing `identity:get_project(project_id=7aec0bf3f5ba404495a1eab25f1fe71c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:05.076328 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.common.rbac_enforcer.enforcer [None req-230a4b72-bdcc-48b3-a906-40666a4c5df4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 16 00:19:05.076684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a4b72-bdcc-48b3-a906-40666a4c5df4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:05.081380 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 3/5] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:04 2021] GET /identity/v3/projects/7aec0bf3f5ba404495a1eab25f1fe71c => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:07.215674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602e061-faf1-43bd-a770-bd64a44fa8f4 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:07.216198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602e061-faf1-43bd-a770-bd64a44fa8f4 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:07.216198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602e061-faf1-43bd-a770-bd64a44fa8f4 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:07.220604 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 3/6] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:07.228943 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4288fe-899e-4fef-96b4-2cb005ea2ff4 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:07.229324 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4288fe-899e-4fef-96b4-2cb005ea2ff4 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:07.229511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4288fe-899e-4fef-96b4-2cb005ea2ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:07.248144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-1e4288fe-899e-4fef-96b4-2cb005ea2ff4 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:07.249676 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1e4288fe-899e-4fef-96b4-2cb005ea2ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:07.258101 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:07.281155 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602e061-faf1-43bd-a770-bd64a44fa8f4 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:07.294056 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602e061-faf1-43bd-a770-bd64a44fa8f4 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:07.298406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad9d15-67e1-4df7-9596-25bb1171103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:07.299080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad9d15-67e1-4df7-9596-25bb1171103f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:07.299374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad9d15-67e1-4df7-9596-25bb1171103f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:07.299660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad9d15-67e1-4df7-9596-25bb1171103f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:07.307485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad9d15-67e1-4df7-9596-25bb1171103f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:07.309285 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad9d15-67e1-4df7-9596-25bb1171103f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:07.318184 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:07.324031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4288fe-899e-4fef-96b4-2cb005ea2ff4 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:07.333430 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4288fe-899e-4fef-96b4-2cb005ea2ff4 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:07.337942 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15494383-30d7-461c-b3f8-950d4a3ac49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:07.338802 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15494383-30d7-461c-b3f8-950d4a3ac49e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:07.339118 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15494383-30d7-461c-b3f8-950d4a3ac49e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:07.339395 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15494383-30d7-461c-b3f8-950d4a3ac49e admin admin] PATH_INFO: `/v3/users/9ebf9643a2de4a8a9500c2ccce871c70` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:07.340775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15494383-30d7-461c-b3f8-950d4a3ac49e admin admin] RBAC: Authorizing `identity:get_user(user_id=9ebf9643a2de4a8a9500c2ccce871c70)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:07.342604 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15494383-30d7-461c-b3f8-950d4a3ac49e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:07.344188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 5/9] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:07 2021] GET /identity/v3/users/9ebf9643a2de4a8a9500c2ccce871c70 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:09.567157 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff57805-1a00-46af-844a-12f72b035353 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:09.567955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff57805-1a00-46af-844a-12f72b035353 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:09.567955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff57805-1a00-46af-844a-12f72b035353 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:09.569956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:09.579164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e65304-d0cb-44fa-8135-2eb5917db7f1 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:09.579620 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e65304-d0cb-44fa-8135-2eb5917db7f1 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:09.579848 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e65304-d0cb-44fa-8135-2eb5917db7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:09.593914 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3d95-482a-4664-991c-65d0c2370381 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:09.594208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3d95-482a-4664-991c-65d0c2370381 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:09.594490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3d95-482a-4664-991c-65d0c2370381 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:09.596250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 6/11] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:09.599528 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-44e65304-d0cb-44fa-8135-2eb5917db7f1 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:09.600717 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-44e65304-d0cb-44fa-8135-2eb5917db7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:09.604272 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7ac09-ba46-476a-bca5-9a993a621b30 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:09.604562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7ac09-ba46-476a-bca5-9a993a621b30 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:09.604838 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7ac09-ba46-476a-bca5-9a993a621b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:09.608768 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:09.632418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e65304-d0cb-44fa-8135-2eb5917db7f1 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:09.641303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e65304-d0cb-44fa-8135-2eb5917db7f1 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:09.646466 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb725cb-701f-4c9f-a6b4-c415d606bb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:09.646666 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG passlib.handlers.bcrypt [None req-07c7ac09-ba46-476a-bca5-9a993a621b30 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86000) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 16 00:19:09.647492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG passlib.handlers.bcrypt [None req-07c7ac09-ba46-476a-bca5-9a993a621b30 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86000) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 16 00:19:09.647593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb725cb-701f-4c9f-a6b4-c415d606bb1e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:09.647593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb725cb-701f-4c9f-a6b4-c415d606bb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:09.647847 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb725cb-701f-4c9f-a6b4-c415d606bb1e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:09.662235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb725cb-701f-4c9f-a6b4-c415d606bb1e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:09.672438 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-fcb725cb-701f-4c9f-a6b4-c415d606bb1e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:19:09.673704 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 7/13] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:19:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:19:09.682696 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb725cb-701f-4c9f-a6b4-c415d606bb1e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:09.694474 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-07c7ac09-ba46-476a-bca5-9a993a621b30 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:09.696143 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-07c7ac09-ba46-476a-bca5-9a993a621b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:09.697480 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb725cb-701f-4c9f-a6b4-c415d606bb1e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:09.704649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dd98f-eaac-4781-82f7-80e31dc4e9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:09.705308 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dd98f-eaac-4781-82f7-80e31dc4e9ee admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:09.705597 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dd98f-eaac-4781-82f7-80e31dc4e9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:09.705877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dd98f-eaac-4781-82f7-80e31dc4e9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:09.707509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dd98f-eaac-4781-82f7-80e31dc4e9ee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:09.709011 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dd98f-eaac-4781-82f7-80e31dc4e9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:09.710878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-a41dd98f-eaac-4781-82f7-80e31dc4e9ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:09.710878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:19:09.710878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:19:09.712430 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dd98f-eaac-4781-82f7-80e31dc4e9ee admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:09.730104 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 8/14] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:09.737012 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dd98f-eaac-4781-82f7-80e31dc4e9ee admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:09.747271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dd98f-eaac-4781-82f7-80e31dc4e9ee admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:09.752808 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf50043-49ca-4dd6-9f59-0cc9bfc90871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:09.753666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf50043-49ca-4dd6-9f59-0cc9bfc90871 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:09.753948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf50043-49ca-4dd6-9f59-0cc9bfc90871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:09.754227 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf50043-49ca-4dd6-9f59-0cc9bfc90871 admin admin] PATH_INFO: `/v3/users/9ebf9643a2de4a8a9500c2ccce871c70` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:09.756336 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf50043-49ca-4dd6-9f59-0cc9bfc90871 admin admin] RBAC: Authorizing `identity:get_user(user_id=9ebf9643a2de4a8a9500c2ccce871c70)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:09.758891 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf50043-49ca-4dd6-9f59-0cc9bfc90871 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:09.760146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 9/15] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:09 2021] GET /identity/v3/users/9ebf9643a2de4a8a9500c2ccce871c70 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:09.761138 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 7/16] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:09.766624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf50043-49ca-4dd6-9f59-0cc9bfc90871 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:09.780473 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf50043-49ca-4dd6-9f59-0cc9bfc90871 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:09.785920 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4df82-6bd9-4e2e-adba-81b3986f940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:09.787554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7ac09-ba46-476a-bca5-9a993a621b30 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:09.787951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4df82-6bd9-4e2e-adba-81b3986f940e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:09.788239 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4df82-6bd9-4e2e-adba-81b3986f940e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:09.788518 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4df82-6bd9-4e2e-adba-81b3986f940e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:09.789731 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4df82-6bd9-4e2e-adba-81b3986f940e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:09.791560 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4df82-6bd9-4e2e-adba-81b3986f940e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:09.793265 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 10/17] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:09.797523 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7ac09-ba46-476a-bca5-9a993a621b30 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:09.799755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4df82-6bd9-4e2e-adba-81b3986f940e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:09.802786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faad3c0-f4da-4a37-892a-5e8d94e53a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:09.803811 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faad3c0-f4da-4a37-892a-5e8d94e53a50 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:09.804102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faad3c0-f4da-4a37-892a-5e8d94e53a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:09.804384 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faad3c0-f4da-4a37-892a-5e8d94e53a50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:09.812522 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4df82-6bd9-4e2e-adba-81b3986f940e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:09.813163 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faad3c0-f4da-4a37-892a-5e8d94e53a50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:09.815045 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faad3c0-f4da-4a37-892a-5e8d94e53a50 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:09.818439 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0d9e4-dfd1-4a25-b40d-d168cda8e8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:09.819206 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0d9e4-dfd1-4a25-b40d-d168cda8e8cb admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:09.819498 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0d9e4-dfd1-4a25-b40d-d168cda8e8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:09.819784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0d9e4-dfd1-4a25-b40d-d168cda8e8cb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:09.820622 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0d9e4-dfd1-4a25-b40d-d168cda8e8cb admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.domain.id=default, user.id=9ebf9643a2de4a8a9500c2ccce871c70) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:09.820939 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0d9e4-dfd1-4a25-b40d-d168cda8e8cb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:09.821953 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-caa0d9e4-dfd1-4a25-b40d-d168cda8e8cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:09.821953 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:19:09.821953 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:19:09.823154 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0d9e4-dfd1-4a25-b40d-d168cda8e8cb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:09.830253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 11/18] 10.222.0.50 () {56 vars in 1343 bytes} [Tue Nov 16 00:19:09 2021] GET /identity/v3/role_assignments?user.id=9ebf9643a2de4a8a9500c2ccce871c70&scope.domain.id=default&role.id=2813231cc8954b998440e4bf5ede2945 => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:09.835031 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 8/19] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:19:09.837647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0d9e4-dfd1-4a25-b40d-d168cda8e8cb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:09.848397 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0d9e4-dfd1-4a25-b40d-d168cda8e8cb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:09.853127 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274355f5-f822-446d-98f5-53823a40c5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:09.853944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274355f5-f822-446d-98f5-53823a40c5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:09.854232 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274355f5-f822-446d-98f5-53823a40c5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:09.854511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274355f5-f822-446d-98f5-53823a40c5d4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:09.855772 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274355f5-f822-446d-98f5-53823a40c5d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:09.857616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274355f5-f822-446d-98f5-53823a40c5d4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:09.859385 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 12/20] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:12.366890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd40db-e361-46de-9f8b-2b31477d3648 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:12.367911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd40db-e361-46de-9f8b-2b31477d3648 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:12.368392 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd40db-e361-46de-9f8b-2b31477d3648 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:12.370740 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 9/21] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:12.387072 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b2b33-0b55-4120-b0f0-9709bfd0b408 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:12.387613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b2b33-0b55-4120-b0f0-9709bfd0b408 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:12.387613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b2b33-0b55-4120-b0f0-9709bfd0b408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:12.416048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-2e6b2b33-0b55-4120-b0f0-9709bfd0b408 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:12.417300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2e6b2b33-0b55-4120-b0f0-9709bfd0b408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:12.425527 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 13/22] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:12.466291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd40db-e361-46de-9f8b-2b31477d3648 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:12.484790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd40db-e361-46de-9f8b-2b31477d3648 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:12.489442 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b64de-da47-4913-b484-8d91ac6de15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:12.490242 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b64de-da47-4913-b484-8d91ac6de15b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:12.490532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b64de-da47-4913-b484-8d91ac6de15b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:12.490815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b64de-da47-4913-b484-8d91ac6de15b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:12.514202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b64de-da47-4913-b484-8d91ac6de15b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:12.522070 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-249b64de-da47-4913-b484-8d91ac6de15b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:19:12.523642 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 10/23] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:19:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:12.530028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b2b33-0b55-4120-b0f0-9709bfd0b408 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:12.540314 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b2b33-0b55-4120-b0f0-9709bfd0b408 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:12.550190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf8333-9b6f-4492-a12b-9834e753a2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:12.550897 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf8333-9b6f-4492-a12b-9834e753a2ed admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:12.551195 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf8333-9b6f-4492-a12b-9834e753a2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:12.551532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf8333-9b6f-4492-a12b-9834e753a2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:12.552339 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf8333-9b6f-4492-a12b-9834e753a2ed admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:12.552623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf8333-9b6f-4492-a12b-9834e753a2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:12.554292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf8333-9b6f-4492-a12b-9834e753a2ed admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:12.563897 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 14/24] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:12.569812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b64de-da47-4913-b484-8d91ac6de15b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:12.579982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b64de-da47-4913-b484-8d91ac6de15b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:12.587406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c87b16-60a4-45df-adb4-94d579ec544a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:12.588279 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c87b16-60a4-45df-adb4-94d579ec544a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:12.588567 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c87b16-60a4-45df-adb4-94d579ec544a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:12.588848 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c87b16-60a4-45df-adb4-94d579ec544a admin admin] PATH_INFO: `/v3/users/9ebf9643a2de4a8a9500c2ccce871c70` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:12.590444 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c87b16-60a4-45df-adb4-94d579ec544a admin admin] RBAC: Authorizing `identity:get_user(user_id=9ebf9643a2de4a8a9500c2ccce871c70)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:12.592338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c87b16-60a4-45df-adb4-94d579ec544a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:12.594161 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 11/25] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:12 2021] GET /identity/v3/users/9ebf9643a2de4a8a9500c2ccce871c70 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:12.601234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf8333-9b6f-4492-a12b-9834e753a2ed admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:12.611386 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf8333-9b6f-4492-a12b-9834e753a2ed admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:12.619247 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf6c3c-57c8-4e4d-8715-ffe32be81c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:12.619989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6c3c-57c8-4e4d-8715-ffe32be81c2a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:12.620277 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6c3c-57c8-4e4d-8715-ffe32be81c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:12.620554 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6c3c-57c8-4e4d-8715-ffe32be81c2a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:12.621792 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf6c3c-57c8-4e4d-8715-ffe32be81c2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:12.623569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf6c3c-57c8-4e4d-8715-ffe32be81c2a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:12.625948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467912c0-b2dd-4f02-8497-8303c70f8dde None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:12.626243 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467912c0-b2dd-4f02-8497-8303c70f8dde None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:12.626531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467912c0-b2dd-4f02-8497-8303c70f8dde None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:12.628519 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 12/26] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:12.629744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 15/27] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:12.635552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467912c0-b2dd-4f02-8497-8303c70f8dde None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:12.644731 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cddfb3-ee7f-4bf3-aef4-ba4b37fe52f6 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:12.645027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cddfb3-ee7f-4bf3-aef4-ba4b37fe52f6 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:12.645846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cddfb3-ee7f-4bf3-aef4-ba4b37fe52f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:12.653403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467912c0-b2dd-4f02-8497-8303c70f8dde None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:12.666572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893e3e0-2cf9-4321-a4c3-9e2d42952109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:12.667490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893e3e0-2cf9-4321-a4c3-9e2d42952109 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:12.667783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893e3e0-2cf9-4321-a4c3-9e2d42952109 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:12.668110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893e3e0-2cf9-4321-a4c3-9e2d42952109 admin admin] PATH_INFO: `/v3/domains/default/users/9ebf9643a2de4a8a9500c2ccce871c70/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:12.670123 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893e3e0-2cf9-4321-a4c3-9e2d42952109 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9ebf9643a2de4a8a9500c2ccce871c70, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:12.671948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-9893e3e0-2cf9-4321-a4c3-9e2d42952109 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:12.671948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:19:12.671948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:19:12.673976 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893e3e0-2cf9-4321-a4c3-9e2d42952109 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:12.685151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-28cddfb3-ee7f-4bf3-aef4-ba4b37fe52f6 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:12.686677 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-28cddfb3-ee7f-4bf3-aef4-ba4b37fe52f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:12.696358 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 16/28] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:12.783735 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cddfb3-ee7f-4bf3-aef4-ba4b37fe52f6 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:12.797285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cddfb3-ee7f-4bf3-aef4-ba4b37fe52f6 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:12.945622 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5aa9a-4b74-4ac3-be28-93ca9c8ff2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:12.946429 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5aa9a-4b74-4ac3-be28-93ca9c8ff2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:12.946717 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5aa9a-4b74-4ac3-be28-93ca9c8ff2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:12.950223 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 13/29] 10.222.0.50 () {58 vars in 1382 bytes} [Tue Nov 16 00:19:12 2021] PUT /identity/v3/domains/default/users/9ebf9643a2de4a8a9500c2ccce871c70/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:19:12.954953 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5aa9a-4b74-4ac3-be28-93ca9c8ff2c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:12.976182 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5aa9a-4b74-4ac3-be28-93ca9c8ff2c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:12.978128 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5aa9a-4b74-4ac3-be28-93ca9c8ff2c1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:13.005703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-a0e5aa9a-4b74-4ac3-be28-93ca9c8ff2c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:13.007155 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 17/30] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:13.014465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893e3e0-2cf9-4321-a4c3-9e2d42952109 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:13.038203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893e3e0-2cf9-4321-a4c3-9e2d42952109 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:13.046860 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a3744-77b8-4d06-9b0a-d41cd7b30f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:13.047829 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a3744-77b8-4d06-9b0a-d41cd7b30f2a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:13.048331 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a3744-77b8-4d06-9b0a-d41cd7b30f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:13.048840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a3744-77b8-4d06-9b0a-d41cd7b30f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:13.049789 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a3744-77b8-4d06-9b0a-d41cd7b30f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:13.050302 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a3744-77b8-4d06-9b0a-d41cd7b30f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:13.052362 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-b65a3744-77b8-4d06-9b0a-d41cd7b30f2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:13.052362 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:19:13.052362 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:19:13.060198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a3744-77b8-4d06-9b0a-d41cd7b30f2a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:13.102492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 14/31] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:13.109329 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5aa9a-4b74-4ac3-be28-93ca9c8ff2c1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:13.133534 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5aa9a-4b74-4ac3-be28-93ca9c8ff2c1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:13.147702 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f866817-6638-4aad-9f42-c1221407355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:13.148668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f866817-6638-4aad-9f42-c1221407355c admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:13.149096 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f866817-6638-4aad-9f42-c1221407355c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:13.149515 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f866817-6638-4aad-9f42-c1221407355c admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:13.150381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f866817-6638-4aad-9f42-c1221407355c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:13.151592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-4f866817-6638-4aad-9f42-c1221407355c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:13.151592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:19:13.151592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:19:13.153176 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f866817-6638-4aad-9f42-c1221407355c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:13.185598 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3717911-728b-4079-8783-8d7316552678 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:13.185830 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3717911-728b-4079-8783-8d7316552678 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:13.186083 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3717911-728b-4079-8783-8d7316552678 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:13.188041 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 15/32] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:13.223109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9604ee-b105-4430-aba8-53418af53f7d None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:13.224043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9604ee-b105-4430-aba8-53418af53f7d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:13.224744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9604ee-b105-4430-aba8-53418af53f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:13.261551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-ba9604ee-b105-4430-aba8-53418af53f7d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:13.263115 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ba9604ee-b105-4430-aba8-53418af53f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:13.289508 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 16/33] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Nov 16 00:19:13.454079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9604ee-b105-4430-aba8-53418af53f7d None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:13.465265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9604ee-b105-4430-aba8-53418af53f7d None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:13.470872 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 18/34] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Nov 16 00:19:13 2021] POST /identity/v3/projects => generated 301 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:19:13.560836 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe2b6-ff8f-4f54-96ac-9396b60daca7 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:13.561461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe2b6-ff8f-4f54-96ac-9396b60daca7 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:13.561944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe2b6-ff8f-4f54-96ac-9396b60daca7 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:13.564180 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 19/35] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:13.585008 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49f6d9-e636-4dce-9414-996a893c1205 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:13.585654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49f6d9-e636-4dce-9414-996a893c1205 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:13.586167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49f6d9-e636-4dce-9414-996a893c1205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:13.600558 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81789f-8d57-4cda-b965-64e688a29c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:13.601318 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81789f-8d57-4cda-b965-64e688a29c2b admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:13.601607 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81789f-8d57-4cda-b965-64e688a29c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:13.601932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81789f-8d57-4cda-b965-64e688a29c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:13.602879 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81789f-8d57-4cda-b965-64e688a29c2b admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:13.606867 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-6d81789f-8d57-4cda-b965-64e688a29c2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:13.606867 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:19:13.606867 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:19:13.606867 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81789f-8d57-4cda-b965-64e688a29c2b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:13.640157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-2c49f6d9-e636-4dce-9414-996a893c1205 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:13.641086 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 17/36] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:19:13 2021] POST /identity/v3/roles => generated 219 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:19:13.642531 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2c49f6d9-e636-4dce-9414-996a893c1205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:13.658638 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 20/37] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:13.703402 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81789f-8d57-4cda-b965-64e688a29c2b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:13.722958 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81789f-8d57-4cda-b965-64e688a29c2b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:13.729411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db5042-4aea-4b8c-a5c7-70c05265aeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:13.730417 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db5042-4aea-4b8c-a5c7-70c05265aeeb admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:13.730866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db5042-4aea-4b8c-a5c7-70c05265aeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:13.731310 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db5042-4aea-4b8c-a5c7-70c05265aeeb admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:13.732296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db5042-4aea-4b8c-a5c7-70c05265aeeb admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:13.734714 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db5042-4aea-4b8c-a5c7-70c05265aeeb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:13.764674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 18/38] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:19:13 2021] POST /identity/v3/roles => generated 225 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:19:13.899294 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc73691-f9aa-4d8d-af03-25329505e173 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:13.899793 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc73691-f9aa-4d8d-af03-25329505e173 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:13.900188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc73691-f9aa-4d8d-af03-25329505e173 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:13.902105 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 21/39] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:13.910023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850b38d-7a77-4c9e-9f7f-d7b9d8cf6b85 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:13.911244 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850b38d-7a77-4c9e-9f7f-d7b9d8cf6b85 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:13.912398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850b38d-7a77-4c9e-9f7f-d7b9d8cf6b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:13.952568 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-f850b38d-7a77-4c9e-9f7f-d7b9d8cf6b85 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:13.954217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-f850b38d-7a77-4c9e-9f7f-d7b9d8cf6b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:13.967756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 19/40] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:13.998177 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc73691-f9aa-4d8d-af03-25329505e173 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:14.014614 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc73691-f9aa-4d8d-af03-25329505e173 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:14.023649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252caee-c4dd-41a3-aef1-f421cd1e111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:14.023649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252caee-c4dd-41a3-aef1-f421cd1e111a admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:14.023911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252caee-c4dd-41a3-aef1-f421cd1e111a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:14.024193 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252caee-c4dd-41a3-aef1-f421cd1e111a admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:14.025028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252caee-c4dd-41a3-aef1-f421cd1e111a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:14.026326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-b252caee-c4dd-41a3-aef1-f421cd1e111a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:14.026326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:19:14.026326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:19:14.027266 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252caee-c4dd-41a3-aef1-f421cd1e111a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:14.048308 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 22/41] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:19:13 2021] POST /identity/v3/roles => generated 223 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:19:14.233065 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1917b-d298-4f63-b750-e78b06b94851 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:14.233467 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1917b-d298-4f63-b750-e78b06b94851 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:14.233663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1917b-d298-4f63-b750-e78b06b94851 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:14.235527 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 20/42] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:14.243100 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed828aa-a22d-41fb-bd80-05983d020f52 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:14.243403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed828aa-a22d-41fb-bd80-05983d020f52 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:14.243694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed828aa-a22d-41fb-bd80-05983d020f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:14.261993 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-1ed828aa-a22d-41fb-bd80-05983d020f52 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:14.263274 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1ed828aa-a22d-41fb-bd80-05983d020f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:14.271790 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 23/43] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:14.296018 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1917b-d298-4f63-b750-e78b06b94851 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:14.308923 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1917b-d298-4f63-b750-e78b06b94851 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:14.313167 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f886c-0b66-4e43-a833-24e062b7cdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:14.313951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f886c-0b66-4e43-a833-24e062b7cdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:14.314237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f886c-0b66-4e43-a833-24e062b7cdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:14.314515 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f886c-0b66-4e43-a833-24e062b7cdb7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:14.315724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f886c-0b66-4e43-a833-24e062b7cdb7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:14.318568 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f886c-0b66-4e43-a833-24e062b7cdb7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:14.320373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 21/44] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:14.326301 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed828aa-a22d-41fb-bd80-05983d020f52 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:14.336612 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed828aa-a22d-41fb-bd80-05983d020f52 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:14.341024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69333c1-5d7d-4e7c-a5c1-1f020c6aa062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:14.341679 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69333c1-5d7d-4e7c-a5c1-1f020c6aa062 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:14.341968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69333c1-5d7d-4e7c-a5c1-1f020c6aa062 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:14.342248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69333c1-5d7d-4e7c-a5c1-1f020c6aa062 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:14.342997 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69333c1-5d7d-4e7c-a5c1-1f020c6aa062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:14.344926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69333c1-5d7d-4e7c-a5c1-1f020c6aa062 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:14.370278 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 24/45] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Nov 16 00:19:14 2021] POST /identity/v3/projects => generated 312 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:19:15.715175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ba09f-779e-4da4-be49-1260633a9ae9 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:15.715699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ba09f-779e-4da4-be49-1260633a9ae9 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:15.715811 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ba09f-779e-4da4-be49-1260633a9ae9 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:15.717503 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 22/46] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:15.725724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb400736-f297-44c6-9979-e3cd11fde329 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:15.726141 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb400736-f297-44c6-9979-e3cd11fde329 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:15.726290 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb400736-f297-44c6-9979-e3cd11fde329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:15.745462 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-eb400736-f297-44c6-9979-e3cd11fde329 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:15.746666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-eb400736-f297-44c6-9979-e3cd11fde329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:15.810463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 25/47] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:15.836200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ba09f-779e-4da4-be49-1260633a9ae9 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:15.849030 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ba09f-779e-4da4-be49-1260633a9ae9 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:15.853521 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a109c-7ed7-4a8f-9ec0-7b4ff35a1258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:15.854326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a109c-7ed7-4a8f-9ec0-7b4ff35a1258 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:15.854610 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a109c-7ed7-4a8f-9ec0-7b4ff35a1258 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:15.854915 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a109c-7ed7-4a8f-9ec0-7b4ff35a1258 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:15.865485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a109c-7ed7-4a8f-9ec0-7b4ff35a1258 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:15.872160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-282a109c-7ed7-4a8f-9ec0-7b4ff35a1258 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:19:15.873468 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 23/48] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:19:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:15.880031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb400736-f297-44c6-9979-e3cd11fde329 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:15.889172 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb400736-f297-44c6-9979-e3cd11fde329 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:15.893499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf75021-d1bc-4875-a731-9d5581cafb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:15.894157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf75021-d1bc-4875-a731-9d5581cafb9d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:15.894444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf75021-d1bc-4875-a731-9d5581cafb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:15.894726 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf75021-d1bc-4875-a731-9d5581cafb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:15.896595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf75021-d1bc-4875-a731-9d5581cafb9d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:15.896908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf75021-d1bc-4875-a731-9d5581cafb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:15.898512 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf75021-d1bc-4875-a731-9d5581cafb9d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:15.906668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 26/49] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:15.912851 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a109c-7ed7-4a8f-9ec0-7b4ff35a1258 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:15.923054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a109c-7ed7-4a8f-9ec0-7b4ff35a1258 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:15.930558 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36afee-d062-47b4-afed-77d9119a2d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:15.931469 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36afee-d062-47b4-afed-77d9119a2d8e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:15.931757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36afee-d062-47b4-afed-77d9119a2d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:15.932037 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36afee-d062-47b4-afed-77d9119a2d8e admin admin] PATH_INFO: `/v3/users/9ebf9643a2de4a8a9500c2ccce871c70` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:15.933243 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36afee-d062-47b4-afed-77d9119a2d8e admin admin] RBAC: Authorizing `identity:get_user(user_id=9ebf9643a2de4a8a9500c2ccce871c70)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:15.935109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36afee-d062-47b4-afed-77d9119a2d8e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:15.936728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 24/50] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:15 2021] GET /identity/v3/users/9ebf9643a2de4a8a9500c2ccce871c70 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:15.943476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf75021-d1bc-4875-a731-9d5581cafb9d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:15.953282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf75021-d1bc-4875-a731-9d5581cafb9d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:15.958559 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51882df4-e725-48c7-afe7-f160888c35f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:15.959389 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882df4-e725-48c7-afe7-f160888c35f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:15.959685 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882df4-e725-48c7-afe7-f160888c35f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:15.959969 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882df4-e725-48c7-afe7-f160888c35f2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:15.961176 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51882df4-e725-48c7-afe7-f160888c35f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:15.963060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51882df4-e725-48c7-afe7-f160888c35f2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:15.964671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 27/51] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:15.970946 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36afee-d062-47b4-afed-77d9119a2d8e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:15.980996 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36afee-d062-47b4-afed-77d9119a2d8e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:15.985437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eabf6a-9a30-4a43-b58a-c5cc8bf39865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:15.986087 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eabf6a-9a30-4a43-b58a-c5cc8bf39865 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:15.986379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eabf6a-9a30-4a43-b58a-c5cc8bf39865 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:15.986665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eabf6a-9a30-4a43-b58a-c5cc8bf39865 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:15.987541 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eabf6a-9a30-4a43-b58a-c5cc8bf39865 admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.domain.id=default, user.id=9ebf9643a2de4a8a9500c2ccce871c70) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:15.987860 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eabf6a-9a30-4a43-b58a-c5cc8bf39865 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:15.988879 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-f1eabf6a-9a30-4a43-b58a-c5cc8bf39865 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:15.988879 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:19:15.988879 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:19:15.990058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eabf6a-9a30-4a43-b58a-c5cc8bf39865 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:15.997242 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 25/52] 10.222.0.50 () {56 vars in 1343 bytes} [Tue Nov 16 00:19:15 2021] GET /identity/v3/role_assignments?user.id=9ebf9643a2de4a8a9500c2ccce871c70&scope.domain.id=default&role.id=2813231cc8954b998440e4bf5ede2945 => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:16.545762 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937bae7-79e5-468e-b9e2-0fbc503057bc None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:16.546054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937bae7-79e5-468e-b9e2-0fbc503057bc None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:16.546338 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937bae7-79e5-468e-b9e2-0fbc503057bc None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:16.548172 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 28/53] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:16.555812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13220bc1-a7b3-4de6-a47f-00396a5cfc5a None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:16.556105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13220bc1-a7b3-4de6-a47f-00396a5cfc5a None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:16.556386 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13220bc1-a7b3-4de6-a47f-00396a5cfc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:16.573991 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-13220bc1-a7b3-4de6-a47f-00396a5cfc5a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:16.575220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-13220bc1-a7b3-4de6-a47f-00396a5cfc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:16.582684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 26/54] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:16.606892 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937bae7-79e5-468e-b9e2-0fbc503057bc None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:16.619511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937bae7-79e5-468e-b9e2-0fbc503057bc None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:16.623782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8bd62-9e28-4189-a44e-758e4f3b23f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:16.624554 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8bd62-9e28-4189-a44e-758e4f3b23f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:16.624845 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8bd62-9e28-4189-a44e-758e4f3b23f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:16.625128 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8bd62-9e28-4189-a44e-758e4f3b23f2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:16.626314 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8bd62-9e28-4189-a44e-758e4f3b23f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:16.628049 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8bd62-9e28-4189-a44e-758e4f3b23f2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:16.629800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 29/55] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:16.635368 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13220bc1-a7b3-4de6-a47f-00396a5cfc5a None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:16.644002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13220bc1-a7b3-4de6-a47f-00396a5cfc5a None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:16.648406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2c7fc-c2a2-4b42-b37b-5bb3bc31a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:16.649046 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c7fc-c2a2-4b42-b37b-5bb3bc31a163 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:16.649343 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c7fc-c2a2-4b42-b37b-5bb3bc31a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:16.649628 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c7fc-c2a2-4b42-b37b-5bb3bc31a163 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:16.650328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2c7fc-c2a2-4b42-b37b-5bb3bc31a163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:16.651375 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-b8f2c7fc-c2a2-4b42-b37b-5bb3bc31a163 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:16.651375 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:19:16.651375 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:19:16.652590 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2c7fc-c2a2-4b42-b37b-5bb3bc31a163 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:16.679289 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 27/56] 10.222.0.50 () {60 vars in 1161 bytes} [Tue Nov 16 00:19:16 2021] POST /identity/v3/projects => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:19:18.819986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644a215-a8de-487c-8e3c-472534234771 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:18.820506 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644a215-a8de-487c-8e3c-472534234771 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:18.820591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644a215-a8de-487c-8e3c-472534234771 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:18.822331 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 30/57] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:18.829424 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83867d4c-1028-489e-98de-f48d1f089e88 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:18.829836 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83867d4c-1028-489e-98de-f48d1f089e88 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:18.829985 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83867d4c-1028-489e-98de-f48d1f089e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:18.849211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-83867d4c-1028-489e-98de-f48d1f089e88 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:18.850401 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-83867d4c-1028-489e-98de-f48d1f089e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:18.905480 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 28/58] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:18.933826 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644a215-a8de-487c-8e3c-472534234771 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:18.946541 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644a215-a8de-487c-8e3c-472534234771 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:18.950884 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59abd8-8186-4344-91a2-90a3f35a2477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:18.951673 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59abd8-8186-4344-91a2-90a3f35a2477 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:18.951961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59abd8-8186-4344-91a2-90a3f35a2477 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:18.952242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59abd8-8186-4344-91a2-90a3f35a2477 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:18.953418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59abd8-8186-4344-91a2-90a3f35a2477 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:18.955164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59abd8-8186-4344-91a2-90a3f35a2477 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:18.956744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 31/59] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:18.962689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83867d4c-1028-489e-98de-f48d1f089e88 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:18.971491 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83867d4c-1028-489e-98de-f48d1f089e88 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:18.976804 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164cba5-d78d-4e45-ade0-6eb9d2e2ed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:18.977461 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164cba5-d78d-4e45-ade0-6eb9d2e2ed6f admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:18.977747 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164cba5-d78d-4e45-ade0-6eb9d2e2ed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:18.978023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164cba5-d78d-4e45-ade0-6eb9d2e2ed6f admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:18.978736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164cba5-d78d-4e45-ade0-6eb9d2e2ed6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:18.979786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-f164cba5-d78d-4e45-ade0-6eb9d2e2ed6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:18.979786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:19:18.979786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:19:18.981018 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164cba5-d78d-4e45-ade0-6eb9d2e2ed6f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:19.006161 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 29/60] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Nov 16 00:19:18 2021] POST /identity/v3/users => generated 275 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:19:22.260388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647a4c-ba19-4ecd-adf3-761fecde6cdf None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.261381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647a4c-ba19-4ecd-adf3-761fecde6cdf None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.261965 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647a4c-ba19-4ecd-adf3-761fecde6cdf None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.264254 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 32/61] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:22.273899 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c219-b59d-44a5-8e9b-b520c70de558 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.274362 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c219-b59d-44a5-8e9b-b520c70de558 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.274550 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c219-b59d-44a5-8e9b-b520c70de558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.303995 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c615c219-b59d-44a5-8e9b-b520c70de558 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:22.305197 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c615c219-b59d-44a5-8e9b-b520c70de558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:22.319112 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 30/62] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:22.357437 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01647a4c-ba19-4ecd-adf3-761fecde6cdf None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.377264 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01647a4c-ba19-4ecd-adf3-761fecde6cdf None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.387399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad8f11-030d-48ce-83c4-14caff56a608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.388222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad8f11-030d-48ce-83c4-14caff56a608 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.388514 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad8f11-030d-48ce-83c4-14caff56a608 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.388800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad8f11-030d-48ce-83c4-14caff56a608 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.411764 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad8f11-030d-48ce-83c4-14caff56a608 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:22.418815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-f9ad8f11-030d-48ce-83c4-14caff56a608 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:22.420461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 33/63] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:22.428046 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c219-b59d-44a5-8e9b-b520c70de558 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.445463 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c219-b59d-44a5-8e9b-b520c70de558 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.455026 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc90cd8-a311-429f-8692-fb55efc41c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.455993 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc90cd8-a311-429f-8692-fb55efc41c20 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.456547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc90cd8-a311-429f-8692-fb55efc41c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.457019 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc90cd8-a311-429f-8692-fb55efc41c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.458658 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc90cd8-a311-429f-8692-fb55efc41c20 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:22.459207 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc90cd8-a311-429f-8692-fb55efc41c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:22.460439 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-8cc90cd8-a311-429f-8692-fb55efc41c20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:22.460439 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:19:22.460439 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:19:22.461783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc90cd8-a311-429f-8692-fb55efc41c20 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:22.486631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 31/64] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:22.488183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f0a1-c080-4a7c-ab00-d03bdf6a015e None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.488486 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f0a1-c080-4a7c-ab00-d03bdf6a015e None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.490024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f0a1-c080-4a7c-ab00-d03bdf6a015e None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.491732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 34/65] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:22.496127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc90cd8-a311-429f-8692-fb55efc41c20 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.512116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e71a0-787c-4c1c-af09-eb425696e638 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.513105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc90cd8-a311-429f-8692-fb55efc41c20 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.513555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e71a0-787c-4c1c-af09-eb425696e638 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.514035 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e71a0-787c-4c1c-af09-eb425696e638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.519149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d3f03-7750-470d-98f3-644d4bdf0c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.520612 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d3f03-7750-470d-98f3-644d4bdf0c7d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.521574 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d3f03-7750-470d-98f3-644d4bdf0c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.521862 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d3f03-7750-470d-98f3-644d4bdf0c7d admin admin] PATH_INFO: `/v3/users/b2a5428b2da04a328371dd74e3789090` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.545009 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-277e71a0-787c-4c1c-af09-eb425696e638 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:22.546578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-277e71a0-787c-4c1c-af09-eb425696e638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:22.555085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d3f03-7750-470d-98f3-644d4bdf0c7d admin admin] RBAC: Authorizing `identity:get_user(user_id=b2a5428b2da04a328371dd74e3789090)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:22.557417 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d3f03-7750-470d-98f3-644d4bdf0c7d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:22.559573 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 32/66] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/users/b2a5428b2da04a328371dd74e3789090 => generated 275 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:22.560255 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 35/67] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:22.561052 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae8d36-97ad-4392-9e4c-b8272b7c8ca9 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.561344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae8d36-97ad-4392-9e4c-b8272b7c8ca9 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.561720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae8d36-97ad-4392-9e4c-b8272b7c8ca9 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.567254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 33/68] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:22.572271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a0401-4d2c-424d-9548-a956acc7a48d None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.572790 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a0401-4d2c-424d-9548-a956acc7a48d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.573291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a0401-4d2c-424d-9548-a956acc7a48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.577875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae8d36-97ad-4392-9e4c-b8272b7c8ca9 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.594785 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-e29a0401-4d2c-424d-9548-a956acc7a48d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:22.597399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e29a0401-4d2c-424d-9548-a956acc7a48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:22.605255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae8d36-97ad-4392-9e4c-b8272b7c8ca9 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.606515 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 36/69] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:22.607711 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a0401-4d2c-424d-9548-a956acc7a48d None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.617461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a0401-4d2c-424d-9548-a956acc7a48d None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.619564 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20121c-6065-4633-a114-55d526c5aa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.620227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20121c-6065-4633-a114-55d526c5aa86 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.620516 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20121c-6065-4633-a114-55d526c5aa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.620797 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20121c-6065-4633-a114-55d526c5aa86 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.623174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd337352-b5f7-44fb-8f33-d4411ebfa1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.624169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337352-b5f7-44fb-8f33-d4411ebfa1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.624654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337352-b5f7-44fb-8f33-d4411ebfa1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.625129 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337352-b5f7-44fb-8f33-d4411ebfa1a3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.636929 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20121c-6065-4633-a114-55d526c5aa86 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:22.637820 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd337352-b5f7-44fb-8f33-d4411ebfa1a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:22.638719 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20121c-6065-4633-a114-55d526c5aa86 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:22.645789 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-dd337352-b5f7-44fb-8f33-d4411ebfa1a3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:19:22.647271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 37/70] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:22.655418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd337352-b5f7-44fb-8f33-d4411ebfa1a3 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.657727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 34/71] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:22.658760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20121c-6065-4633-a114-55d526c5aa86 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.666127 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd337352-b5f7-44fb-8f33-d4411ebfa1a3 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.671957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b9d48-79e5-43f1-a1b7-95ab90837fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.672954 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b9d48-79e5-43f1-a1b7-95ab90837fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.673387 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b9d48-79e5-43f1-a1b7-95ab90837fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.673811 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b9d48-79e5-43f1-a1b7-95ab90837fe7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.674118 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20121c-6065-4633-a114-55d526c5aa86 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.680084 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72598f-59bb-46d3-be55-67b21e240786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.681023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72598f-59bb-46d3-be55-67b21e240786 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.681399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72598f-59bb-46d3-be55-67b21e240786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.681891 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72598f-59bb-46d3-be55-67b21e240786 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.682856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72598f-59bb-46d3-be55-67b21e240786 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:22.683361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72598f-59bb-46d3-be55-67b21e240786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:22.685162 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72598f-59bb-46d3-be55-67b21e240786 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:22.686935 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b9d48-79e5-43f1-a1b7-95ab90837fe7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:22.694981 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 35/72] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:22.696313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72598f-59bb-46d3-be55-67b21e240786 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.699272 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-1e5b9d48-79e5-43f1-a1b7-95ab90837fe7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 00:19:22.700669 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 38/73] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:22.701979 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b9d48-79e5-43f1-a1b7-95ab90837fe7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.713232 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72598f-59bb-46d3-be55-67b21e240786 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.718107 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fa327-dbb3-47be-a109-4d0085ce7bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.718266 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b9d48-79e5-43f1-a1b7-95ab90837fe7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.719383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fa327-dbb3-47be-a109-4d0085ce7bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.719817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fa327-dbb3-47be-a109-4d0085ce7bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.720242 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fa327-dbb3-47be-a109-4d0085ce7bf4 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.722020 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fa327-dbb3-47be-a109-4d0085ce7bf4 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:22.725322 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fa327-dbb3-47be-a109-4d0085ce7bf4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:22.726069 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed694d2f-ec30-4f93-af45-60274b68b762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.727106 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed694d2f-ec30-4f93-af45-60274b68b762 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.727491 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed694d2f-ec30-4f93-af45-60274b68b762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.727830 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 36/74] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:22.727954 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed694d2f-ec30-4f93-af45-60274b68b762 admin admin] PATH_INFO: `/v3/users/9ebf9643a2de4a8a9500c2ccce871c70` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.728935 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fa327-dbb3-47be-a109-4d0085ce7bf4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.734516 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed694d2f-ec30-4f93-af45-60274b68b762 admin admin] RBAC: Authorizing `identity:get_user(user_id=9ebf9643a2de4a8a9500c2ccce871c70)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:22.736500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed694d2f-ec30-4f93-af45-60274b68b762 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:22.738258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 39/75] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/users/9ebf9643a2de4a8a9500c2ccce871c70 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:22.740514 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed694d2f-ec30-4f93-af45-60274b68b762 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.743740 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fa327-dbb3-47be-a109-4d0085ce7bf4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.751716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a687c6-d923-473f-be67-55086fa397b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.752630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a687c6-d923-473f-be67-55086fa397b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.753095 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a687c6-d923-473f-be67-55086fa397b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.753533 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a687c6-d923-473f-be67-55086fa397b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.753906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed694d2f-ec30-4f93-af45-60274b68b762 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.754729 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a687c6-d923-473f-be67-55086fa397b9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:22.755369 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a687c6-d923-473f-be67-55086fa397b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:22.757462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a687c6-d923-473f-be67-55086fa397b9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:22.760944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618dc43-799f-4c6d-b086-13913766491e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.761757 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618dc43-799f-4c6d-b086-13913766491e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.762200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618dc43-799f-4c6d-b086-13913766491e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.762539 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618dc43-799f-4c6d-b086-13913766491e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.763540 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618dc43-799f-4c6d-b086-13913766491e admin admin] RBAC: Adding query filter params (role.id=e338c12e36c04cffba27cfe873d606aa, scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea, user.id=b2a5428b2da04a328371dd74e3789090) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:22.763961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618dc43-799f-4c6d-b086-13913766491e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:22.766134 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618dc43-799f-4c6d-b086-13913766491e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:22.771600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 37/76] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:22.776511 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a687c6-d923-473f-be67-55086fa397b9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.786542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 40/77] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/role_assignments?user.id=b2a5428b2da04a328371dd74e3789090&scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea&role.id=e338c12e36c04cffba27cfe873d606aa => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:22.793574 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618dc43-799f-4c6d-b086-13913766491e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.793774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a687c6-d923-473f-be67-55086fa397b9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.807663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92075623-d560-4a27-83cf-9b529f2f532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.809079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92075623-d560-4a27-83cf-9b529f2f532e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.809370 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92075623-d560-4a27-83cf-9b529f2f532e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.809652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92075623-d560-4a27-83cf-9b529f2f532e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.822748 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618dc43-799f-4c6d-b086-13913766491e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.824562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92075623-d560-4a27-83cf-9b529f2f532e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:22.826404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92075623-d560-4a27-83cf-9b529f2f532e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:22.835213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce4304-505c-45b9-b764-9fece2296664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.836098 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4304-505c-45b9-b764-9fece2296664 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.836391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4304-505c-45b9-b764-9fece2296664 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.836677 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4304-505c-45b9-b764-9fece2296664 admin admin] PATH_INFO: `/v3/users/b2a5428b2da04a328371dd74e3789090` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.837941 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce4304-505c-45b9-b764-9fece2296664 admin admin] RBAC: Authorizing `identity:get_user(user_id=b2a5428b2da04a328371dd74e3789090)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:22.840157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce4304-505c-45b9-b764-9fece2296664 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:22.849001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 41/78] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/users/b2a5428b2da04a328371dd74e3789090 => generated 275 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:22.850010 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce4304-505c-45b9-b764-9fece2296664 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.855259 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 38/79] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:22.859679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a51f3-68a8-4b21-ba9c-45179d10d6f0 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.859981 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a51f3-68a8-4b21-ba9c-45179d10d6f0 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.860304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a51f3-68a8-4b21-ba9c-45179d10d6f0 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.862352 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 39/80] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:22.866375 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce4304-505c-45b9-b764-9fece2296664 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.869594 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a51f3-68a8-4b21-ba9c-45179d10d6f0 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.871469 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a31a2-c798-43af-9377-146a051158b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.872292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a31a2-c798-43af-9377-146a051158b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.872658 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a31a2-c798-43af-9377-146a051158b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.873014 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a31a2-c798-43af-9377-146a051158b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.882997 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a51f3-68a8-4b21-ba9c-45179d10d6f0 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.883557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a31a2-c798-43af-9377-146a051158b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:22.885667 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a31a2-c798-43af-9377-146a051158b3 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:22.888196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff74bb-fb82-4a26-9164-656f80750497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.889200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff74bb-fb82-4a26-9164-656f80750497 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.889559 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff74bb-fb82-4a26-9164-656f80750497 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.889907 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff74bb-fb82-4a26-9164-656f80750497 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.891313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff74bb-fb82-4a26-9164-656f80750497 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:22.893688 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff74bb-fb82-4a26-9164-656f80750497 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:22.895919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 40/81] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:22.896844 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 42/82] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:22.900472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed797e-0e42-46cf-b7fa-b922f47a7bc1 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.900767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed797e-0e42-46cf-b7fa-b922f47a7bc1 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.901049 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed797e-0e42-46cf-b7fa-b922f47a7bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.903396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a31a2-c798-43af-9377-146a051158b3 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.917146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a31a2-c798-43af-9377-146a051158b3 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.928106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-fbed797e-0e42-46cf-b7fa-b922f47a7bc1 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:22.929343 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-fbed797e-0e42-46cf-b7fa-b922f47a7bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:22.929526 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3aa6d-9c4d-480f-8dff-3648fe5029d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.930193 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3aa6d-9c4d-480f-8dff-3648fe5029d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.930590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3aa6d-9c4d-480f-8dff-3648fe5029d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.930939 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3aa6d-9c4d-480f-8dff-3648fe5029d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.931900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3aa6d-9c4d-480f-8dff-3648fe5029d7 admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea, user.id=9ebf9643a2de4a8a9500c2ccce871c70) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:22.932221 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3aa6d-9c4d-480f-8dff-3648fe5029d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:22.934568 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3aa6d-9c4d-480f-8dff-3648fe5029d7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:22.938263 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 41/83] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:22.943390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 43/84] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/role_assignments?user.id=9ebf9643a2de4a8a9500c2ccce871c70&scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea&role.id=2813231cc8954b998440e4bf5ede2945 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:22.943390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3aa6d-9c4d-480f-8dff-3648fe5029d7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.958447 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3aa6d-9c4d-480f-8dff-3648fe5029d7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:22.963431 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71597d6d-c207-4b5a-99bc-75da8423b4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:22.964324 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71597d6d-c207-4b5a-99bc-75da8423b4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:22.964615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71597d6d-c207-4b5a-99bc-75da8423b4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:22.964899 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71597d6d-c207-4b5a-99bc-75da8423b4c2 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:22.966194 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71597d6d-c207-4b5a-99bc-75da8423b4c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:22.968392 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71597d6d-c207-4b5a-99bc-75da8423b4c2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:22.970245 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 44/85] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:22.978780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed797e-0e42-46cf-b7fa-b922f47a7bc1 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:22.996918 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed797e-0e42-46cf-b7fa-b922f47a7bc1 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:23.002798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71597d6d-c207-4b5a-99bc-75da8423b4c2 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:23.009308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42eb2d3-3173-469b-b0fb-c89ebedb0bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:23.010000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42eb2d3-3173-469b-b0fb-c89ebedb0bfe admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:23.010289 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42eb2d3-3173-469b-b0fb-c89ebedb0bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:23.010569 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42eb2d3-3173-469b-b0fb-c89ebedb0bfe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:23.011492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42eb2d3-3173-469b-b0fb-c89ebedb0bfe admin admin] RBAC: Adding query filter params (role.id=5f5b315594d34a0da8fd0e1cc476318e, scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea, user.id=b2a5428b2da04a328371dd74e3789090) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:23.011795 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42eb2d3-3173-469b-b0fb-c89ebedb0bfe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:23.013816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42eb2d3-3173-469b-b0fb-c89ebedb0bfe admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:23.021549 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71597d6d-c207-4b5a-99bc-75da8423b4c2 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:23.027374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 42/86] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:22 2021] GET /identity/v3/role_assignments?user.id=b2a5428b2da04a328371dd74e3789090&scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea&role.id=5f5b315594d34a0da8fd0e1cc476318e => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:23.029870 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979665bb-1483-4f93-bfbf-38e28d528837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:23.030746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979665bb-1483-4f93-bfbf-38e28d528837 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:23.031078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979665bb-1483-4f93-bfbf-38e28d528837 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:23.031361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979665bb-1483-4f93-bfbf-38e28d528837 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:23.046046 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979665bb-1483-4f93-bfbf-38e28d528837 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:23.055427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-979665bb-1483-4f93-bfbf-38e28d528837 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:23.056829 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 45/87] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:19:23.067718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42eb2d3-3173-469b-b0fb-c89ebedb0bfe admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:23.079659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42eb2d3-3173-469b-b0fb-c89ebedb0bfe admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:23.086177 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84035ef7-ac06-4ad3-a2e8-6dd7ba2ba117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:23.086969 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84035ef7-ac06-4ad3-a2e8-6dd7ba2ba117 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:23.087262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84035ef7-ac06-4ad3-a2e8-6dd7ba2ba117 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:23.087594 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84035ef7-ac06-4ad3-a2e8-6dd7ba2ba117 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:23.088427 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84035ef7-ac06-4ad3-a2e8-6dd7ba2ba117 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:23.088744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84035ef7-ac06-4ad3-a2e8-6dd7ba2ba117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:23.090464 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84035ef7-ac06-4ad3-a2e8-6dd7ba2ba117 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:23.099405 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2cb6d-3f49-4918-9790-9fd9b8f8d3e2 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:23.099723 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2cb6d-3f49-4918-9790-9fd9b8f8d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:23.099971 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2cb6d-3f49-4918-9790-9fd9b8f8d3e2 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:23.101858 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 46/88] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:23.102685 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 43/89] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:23.109044 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2cb6d-3f49-4918-9790-9fd9b8f8d3e2 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:23.110868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eac3c-31bf-4181-b9f8-e414773e9b02 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:23.111184 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eac3c-31bf-4181-b9f8-e414773e9b02 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:23.111572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eac3c-31bf-4181-b9f8-e414773e9b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:23.122620 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2cb6d-3f49-4918-9790-9fd9b8f8d3e2 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:23.127220 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe090a1f-ec8f-4bef-9899-878b0c37cfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:23.128157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe090a1f-ec8f-4bef-9899-878b0c37cfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:23.128443 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe090a1f-ec8f-4bef-9899-878b0c37cfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:23.128759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe090a1f-ec8f-4bef-9899-878b0c37cfb5 admin admin] PATH_INFO: `/v3/users/b2a5428b2da04a328371dd74e3789090` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:23.130386 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe090a1f-ec8f-4bef-9899-878b0c37cfb5 admin admin] RBAC: Authorizing `identity:get_user(user_id=b2a5428b2da04a328371dd74e3789090)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:23.132659 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe090a1f-ec8f-4bef-9899-878b0c37cfb5 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:23.132878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-739eac3c-31bf-4181-b9f8-e414773e9b02 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:23.134033 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-739eac3c-31bf-4181-b9f8-e414773e9b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:23.134547 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 47/90] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:23 2021] GET /identity/v3/users/b2a5428b2da04a328371dd74e3789090 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:23.140677 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe090a1f-ec8f-4bef-9899-878b0c37cfb5 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:23.157585 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 44/91] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:23.159932 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe090a1f-ec8f-4bef-9899-878b0c37cfb5 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:23.165428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85132fcf-e48f-4eb3-86c6-e20bcee601c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:23.166091 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85132fcf-e48f-4eb3-86c6-e20bcee601c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:23.166381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85132fcf-e48f-4eb3-86c6-e20bcee601c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:23.166663 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85132fcf-e48f-4eb3-86c6-e20bcee601c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:23.175706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85132fcf-e48f-4eb3-86c6-e20bcee601c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:23.178177 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85132fcf-e48f-4eb3-86c6-e20bcee601c2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:23.188330 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 48/92] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:19:23.195344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eac3c-31bf-4181-b9f8-e414773e9b02 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:23.205417 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eac3c-31bf-4181-b9f8-e414773e9b02 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:23.207076 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85132fcf-e48f-4eb3-86c6-e20bcee601c2 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:23.220894 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c79dc0-3dcd-4dfa-b3d8-6217dc9a5124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:23.222133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c79dc0-3dcd-4dfa-b3d8-6217dc9a5124 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:23.222420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c79dc0-3dcd-4dfa-b3d8-6217dc9a5124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:23.222754 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c79dc0-3dcd-4dfa-b3d8-6217dc9a5124 admin admin] PATH_INFO: `/v3/projects/ea483834386d454d980698fc75c492f7` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:23.224806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c79dc0-3dcd-4dfa-b3d8-6217dc9a5124 admin admin] RBAC: Authorizing `identity:get_project(project_id=ea483834386d454d980698fc75c492f7)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:23.227006 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c79dc0-3dcd-4dfa-b3d8-6217dc9a5124 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:23.227904 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85132fcf-e48f-4eb3-86c6-e20bcee601c2 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:23.229124 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 45/93] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:23 2021] GET /identity/v3/projects/ea483834386d454d980698fc75c492f7 => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:23.233243 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df4c18-f971-444d-97eb-11438f4e106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:23.234272 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df4c18-f971-444d-97eb-11438f4e106b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:23.234568 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df4c18-f971-444d-97eb-11438f4e106b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:23.234870 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df4c18-f971-444d-97eb-11438f4e106b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:23.235845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c79dc0-3dcd-4dfa-b3d8-6217dc9a5124 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:23.236184 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df4c18-f971-444d-97eb-11438f4e106b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:23.238305 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df4c18-f971-444d-97eb-11438f4e106b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:23.245098 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 49/94] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:23.247929 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df4c18-f971-444d-97eb-11438f4e106b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:23.249097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c79dc0-3dcd-4dfa-b3d8-6217dc9a5124 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:23.254056 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8164ad-dee5-4beb-bf3b-51b347273c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:23.255631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8164ad-dee5-4beb-bf3b-51b347273c52 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:23.256583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8164ad-dee5-4beb-bf3b-51b347273c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:23.257074 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8164ad-dee5-4beb-bf3b-51b347273c52 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:23.258149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8164ad-dee5-4beb-bf3b-51b347273c52 admin admin] RBAC: Adding query filter params (role.id=e338c12e36c04cffba27cfe873d606aa, scope.project.id=ea483834386d454d980698fc75c492f7, user.id=b2a5428b2da04a328371dd74e3789090) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:23.258685 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8164ad-dee5-4beb-bf3b-51b347273c52 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:23.260434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df4c18-f971-444d-97eb-11438f4e106b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:23.261386 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8164ad-dee5-4beb-bf3b-51b347273c52 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:23.265817 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d752ebf-d97b-48c9-8fe1-07417e619fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:23.266433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d752ebf-d97b-48c9-8fe1-07417e619fbf admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:23.266755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d752ebf-d97b-48c9-8fe1-07417e619fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:23.267065 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d752ebf-d97b-48c9-8fe1-07417e619fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:23.267800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d752ebf-d97b-48c9-8fe1-07417e619fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:23.269740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d752ebf-d97b-48c9-8fe1-07417e619fbf admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:23.271593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 46/95] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:23 2021] GET /identity/v3/role_assignments?user.id=b2a5428b2da04a328371dd74e3789090&scope.project.id=ea483834386d454d980698fc75c492f7&role.id=e338c12e36c04cffba27cfe873d606aa => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:23.303507 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 50/96] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Nov 16 00:19:23 2021] POST /identity/v3/projects => generated 302 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:19:25.478820 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b099c9-514b-49a3-9a32-cde70b07560a None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:25.479889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b099c9-514b-49a3-9a32-cde70b07560a None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:25.480399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b099c9-514b-49a3-9a32-cde70b07560a None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:25.482434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 47/97] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:25.495117 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9255c-b271-46a3-b8a7-cb290b099fe1 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:25.496040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9255c-b271-46a3-b8a7-cb290b099fe1 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:25.496531 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9255c-b271-46a3-b8a7-cb290b099fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:25.523883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-00b9255c-b271-46a3-b8a7-cb290b099fe1 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:25.525432 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-00b9255c-b271-46a3-b8a7-cb290b099fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:25.590134 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 51/98] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:25.627188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b099c9-514b-49a3-9a32-cde70b07560a None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:25.643689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b099c9-514b-49a3-9a32-cde70b07560a None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:25.652824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290360a-382d-48cd-ba7f-268a603585ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:25.653892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290360a-382d-48cd-ba7f-268a603585ee admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:25.654382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290360a-382d-48cd-ba7f-268a603585ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:25.654880 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290360a-382d-48cd-ba7f-268a603585ee admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:25.668923 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290360a-382d-48cd-ba7f-268a603585ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:25.676653 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-8290360a-382d-48cd-ba7f-268a603585ee admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:25.678393 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 48/99] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:25.684465 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9255c-b271-46a3-b8a7-cb290b099fe1 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:25.694652 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9255c-b271-46a3-b8a7-cb290b099fe1 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:25.699876 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379a34-e496-4892-9f66-b8b9f8476277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:25.701086 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379a34-e496-4892-9f66-b8b9f8476277 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:25.701603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379a34-e496-4892-9f66-b8b9f8476277 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:25.702096 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379a34-e496-4892-9f66-b8b9f8476277 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:25.703211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd379a34-e496-4892-9f66-b8b9f8476277 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:25.703773 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd379a34-e496-4892-9f66-b8b9f8476277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:25.705685 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd379a34-e496-4892-9f66-b8b9f8476277 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:25.716584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 52/100] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:25.723117 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290360a-382d-48cd-ba7f-268a603585ee admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:25.743196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290360a-382d-48cd-ba7f-268a603585ee admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:25.751276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783545b8-ae3b-4b84-a871-e24c19b71a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:25.752172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783545b8-ae3b-4b84-a871-e24c19b71a95 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:25.752466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783545b8-ae3b-4b84-a871-e24c19b71a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:25.752751 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783545b8-ae3b-4b84-a871-e24c19b71a95 admin admin] PATH_INFO: `/v3/users/b2a5428b2da04a328371dd74e3789090` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:25.759620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783545b8-ae3b-4b84-a871-e24c19b71a95 admin admin] RBAC: Authorizing `identity:get_user(user_id=b2a5428b2da04a328371dd74e3789090)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:25.761836 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783545b8-ae3b-4b84-a871-e24c19b71a95 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:25.763552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 49/101] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:25 2021] GET /identity/v3/users/b2a5428b2da04a328371dd74e3789090 => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:25.770643 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379a34-e496-4892-9f66-b8b9f8476277 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:25.783911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379a34-e496-4892-9f66-b8b9f8476277 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:25.795310 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be773ad6-46e3-49a1-8b8d-94c9ed364049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:25.796566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be773ad6-46e3-49a1-8b8d-94c9ed364049 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:25.797084 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be773ad6-46e3-49a1-8b8d-94c9ed364049 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:25.797569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be773ad6-46e3-49a1-8b8d-94c9ed364049 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:25.803909 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be773ad6-46e3-49a1-8b8d-94c9ed364049 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:25.806445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be773ad6-46e3-49a1-8b8d-94c9ed364049 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:25.808616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 53/102] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:25 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:25.815339 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783545b8-ae3b-4b84-a871-e24c19b71a95 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:25.820322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91938cd-b04b-4829-b00e-c00da65deaf4 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:25.820931 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91938cd-b04b-4829-b00e-c00da65deaf4 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:25.821423 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91938cd-b04b-4829-b00e-c00da65deaf4 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:25.823605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 54/103] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:25.833008 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783545b8-ae3b-4b84-a871-e24c19b71a95 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:25.833222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1dc1e-5d73-4fda-8d3e-69082f57d4da None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:25.833557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1dc1e-5d73-4fda-8d3e-69082f57d4da None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:25.833849 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1dc1e-5d73-4fda-8d3e-69082f57d4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:25.844275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12aa1ec-220f-46f2-a69a-8b3f9f69dfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:25.845180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aa1ec-220f-46f2-a69a-8b3f9f69dfed admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:25.845468 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aa1ec-220f-46f2-a69a-8b3f9f69dfed admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:25.845751 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aa1ec-220f-46f2-a69a-8b3f9f69dfed admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea/users/b2a5428b2da04a328371dd74e3789090/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:25.851946 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12aa1ec-220f-46f2-a69a-8b3f9f69dfed admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3488c6af544a1aa2bc5fdd48f927ea, user_id=b2a5428b2da04a328371dd74e3789090, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:25.854986 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12aa1ec-220f-46f2-a69a-8b3f9f69dfed admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:25.857513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-faa1dc1e-5d73-4fda-8d3e-69082f57d4da None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:25.858712 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-faa1dc1e-5d73-4fda-8d3e-69082f57d4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:25.868466 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 55/104] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:25.869881 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82761174-fa29-4da1-88b5-652c96d5c524 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:25.870179 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82761174-fa29-4da1-88b5-652c96d5c524 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:25.870459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82761174-fa29-4da1-88b5-652c96d5c524 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:25.871659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 50/105] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:19:25 2021] PUT /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea/users/b2a5428b2da04a328371dd74e3789090/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:25.872383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 56/106] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:25.880668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f6fd-ed7d-4d30-a6a9-d17251e0b3fd None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:25.880974 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f6fd-ed7d-4d30-a6a9-d17251e0b3fd None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:25.881239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f6fd-ed7d-4d30-a6a9-d17251e0b3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:25.901342 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-3c69f6fd-ed7d-4d30-a6a9-d17251e0b3fd None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:25.902676 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3c69f6fd-ed7d-4d30-a6a9-d17251e0b3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:25.905366 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e53be7-ba20-45b3-8915-0a03b5b0b653 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:25.905657 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e53be7-ba20-45b3-8915-0a03b5b0b653 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:25.905941 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e53be7-ba20-45b3-8915-0a03b5b0b653 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:25.908202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 57/107] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:25.922017 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e53be7-ba20-45b3-8915-0a03b5b0b653 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:25.995764 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 51/108] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:25.997805 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f17da4-d47c-4d52-a89f-8b439911b6a1 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:25.998255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f17da4-d47c-4d52-a89f-8b439911b6a1 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:25.998697 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f17da4-d47c-4d52-a89f-8b439911b6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.021280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e53be7-ba20-45b3-8915-0a03b5b0b653 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.022254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-27f17da4-d47c-4d52-a89f-8b439911b6a1 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:26.023809 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-27f17da4-d47c-4d52-a89f-8b439911b6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:26.030617 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2d731-4a65-4a81-9d9c-07acff324660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.031796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2d731-4a65-4a81-9d9c-07acff324660 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.032090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2d731-4a65-4a81-9d9c-07acff324660 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.032411 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2d731-4a65-4a81-9d9c-07acff324660 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.037021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 52/109] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:26.038317 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f17da4-d47c-4d52-a89f-8b439911b6a1 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.062767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f17da4-d47c-4d52-a89f-8b439911b6a1 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.063544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2d731-4a65-4a81-9d9c-07acff324660 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:26.072917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-c6c2d731-4a65-4a81-9d9c-07acff324660 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 00:19:26.073106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e765-d8e6-4897-aec6-fe96dc3256cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.073845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e765-d8e6-4897-aec6-fe96dc3256cd admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.074133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e765-d8e6-4897-aec6-fe96dc3256cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.074411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e765-d8e6-4897-aec6-fe96dc3256cd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.075031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 58/110] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:19:25 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:26.075750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2d731-4a65-4a81-9d9c-07acff324660 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.088935 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2d731-4a65-4a81-9d9c-07acff324660 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.089429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073e765-d8e6-4897-aec6-fe96dc3256cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:26.093938 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2c3de-9508-45af-a4e6-525a2e6734d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.094919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2c3de-9508-45af-a4e6-525a2e6734d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.095377 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2c3de-9508-45af-a4e6-525a2e6734d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.095805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2c3de-9508-45af-a4e6-525a2e6734d7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.096182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-7073e765-d8e6-4897-aec6-fe96dc3256cd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:19:26.097643 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 53/111] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:19:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:26.099192 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e765-d8e6-4897-aec6-fe96dc3256cd admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.109609 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e765-d8e6-4897-aec6-fe96dc3256cd admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.111253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2c3de-9508-45af-a4e6-525a2e6734d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:26.115429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba83e4-77a7-4a6f-946d-6e19ae018866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.116091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba83e4-77a7-4a6f-946d-6e19ae018866 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.116380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba83e4-77a7-4a6f-946d-6e19ae018866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.116660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba83e4-77a7-4a6f-946d-6e19ae018866 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.117411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba83e4-77a7-4a6f-946d-6e19ae018866 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:26.117720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba83e4-77a7-4a6f-946d-6e19ae018866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:26.119371 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba83e4-77a7-4a6f-946d-6e19ae018866 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:26.120647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-d1e2c3de-9508-45af-a4e6-525a2e6734d7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:26.122018 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 59/112] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:26.123049 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2c3de-9508-45af-a4e6-525a2e6734d7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.128407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 54/113] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:26 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:26.134499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2c3de-9508-45af-a4e6-525a2e6734d7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.136893 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba83e4-77a7-4a6f-946d-6e19ae018866 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.139350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747f5be-10dc-4017-8042-555fac5c2447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.140148 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f5be-10dc-4017-8042-555fac5c2447 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.140543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f5be-10dc-4017-8042-555fac5c2447 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.140929 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f5be-10dc-4017-8042-555fac5c2447 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.141793 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747f5be-10dc-4017-8042-555fac5c2447 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:26.142116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747f5be-10dc-4017-8042-555fac5c2447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:26.144617 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747f5be-10dc-4017-8042-555fac5c2447 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:26.147615 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba83e4-77a7-4a6f-946d-6e19ae018866 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.152259 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be2f5b-a5ac-481c-94fb-72a538d456b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.152989 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be2f5b-a5ac-481c-94fb-72a538d456b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.153324 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be2f5b-a5ac-481c-94fb-72a538d456b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.153729 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 60/114] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:26.153834 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be2f5b-a5ac-481c-94fb-72a538d456b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.154389 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be2f5b-a5ac-481c-94fb-72a538d456b6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:26.154491 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747f5be-10dc-4017-8042-555fac5c2447 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.154702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be2f5b-a5ac-481c-94fb-72a538d456b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:26.156752 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be2f5b-a5ac-481c-94fb-72a538d456b6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:26.164438 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747f5be-10dc-4017-8042-555fac5c2447 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.166455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 55/115] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:26.167398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be2f5b-a5ac-481c-94fb-72a538d456b6 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.169158 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b0aec-549a-4b07-a946-d55799bbb446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.170031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b0aec-549a-4b07-a946-d55799bbb446 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.170326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b0aec-549a-4b07-a946-d55799bbb446 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.170615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b0aec-549a-4b07-a946-d55799bbb446 admin admin] PATH_INFO: `/v3/users/b2a5428b2da04a328371dd74e3789090` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.171898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b0aec-549a-4b07-a946-d55799bbb446 admin admin] RBAC: Authorizing `identity:get_user(user_id=b2a5428b2da04a328371dd74e3789090)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:26.174162 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b0aec-549a-4b07-a946-d55799bbb446 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:26.175904 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 61/116] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:26 2021] GET /identity/v3/users/b2a5428b2da04a328371dd74e3789090 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:26.177270 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b0aec-549a-4b07-a946-d55799bbb446 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.178520 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be2f5b-a5ac-481c-94fb-72a538d456b6 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.183449 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76877371-9c62-4577-a622-7bab8b207131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.184315 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76877371-9c62-4577-a622-7bab8b207131 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.184652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76877371-9c62-4577-a622-7bab8b207131 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.184931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76877371-9c62-4577-a622-7bab8b207131 admin admin] PATH_INFO: `/v3/users/9ebf9643a2de4a8a9500c2ccce871c70` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.186197 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76877371-9c62-4577-a622-7bab8b207131 admin admin] RBAC: Authorizing `identity:get_user(user_id=9ebf9643a2de4a8a9500c2ccce871c70)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:26.187505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b0aec-549a-4b07-a946-d55799bbb446 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.188175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76877371-9c62-4577-a622-7bab8b207131 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:26.190056 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 56/117] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:26 2021] GET /identity/v3/users/9ebf9643a2de4a8a9500c2ccce871c70 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:26.190821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76877371-9c62-4577-a622-7bab8b207131 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.193094 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c2316-cbd4-4433-b352-2b2f1eb45f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.194131 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c2316-cbd4-4433-b352-2b2f1eb45f53 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.194424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c2316-cbd4-4433-b352-2b2f1eb45f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.194714 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c2316-cbd4-4433-b352-2b2f1eb45f53 admin admin] PATH_INFO: `/v3/users/b2a5428b2da04a328371dd74e3789090` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.196119 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c2316-cbd4-4433-b352-2b2f1eb45f53 admin admin] RBAC: Authorizing `identity:get_user(user_id=b2a5428b2da04a328371dd74e3789090)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:26.198542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c2316-cbd4-4433-b352-2b2f1eb45f53 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:26.200325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 62/118] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:26 2021] GET /identity/v3/users/b2a5428b2da04a328371dd74e3789090 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:26.201017 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76877371-9c62-4577-a622-7bab8b207131 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.201197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c2316-cbd4-4433-b352-2b2f1eb45f53 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.205639 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce28846-ed42-45fd-9a97-900f1415b627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.206490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce28846-ed42-45fd-9a97-900f1415b627 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.206957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce28846-ed42-45fd-9a97-900f1415b627 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.207461 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce28846-ed42-45fd-9a97-900f1415b627 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.208449 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce28846-ed42-45fd-9a97-900f1415b627 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:26.210515 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce28846-ed42-45fd-9a97-900f1415b627 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:26.212070 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c2316-cbd4-4433-b352-2b2f1eb45f53 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.212735 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 57/119] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:26 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:26.213458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce28846-ed42-45fd-9a97-900f1415b627 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.217067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9204aaf-4fba-4c7c-bd26-46aaac260302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.217983 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9204aaf-4fba-4c7c-bd26-46aaac260302 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.218274 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9204aaf-4fba-4c7c-bd26-46aaac260302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.218621 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9204aaf-4fba-4c7c-bd26-46aaac260302 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.219878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9204aaf-4fba-4c7c-bd26-46aaac260302 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:26.222375 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9204aaf-4fba-4c7c-bd26-46aaac260302 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:26.224327 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 63/120] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:26 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:26.224590 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce28846-ed42-45fd-9a97-900f1415b627 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.225190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9204aaf-4fba-4c7c-bd26-46aaac260302 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.229773 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2db76-c8fd-4a5c-96fa-180d5a01979b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.230760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2db76-c8fd-4a5c-96fa-180d5a01979b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.231171 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2db76-c8fd-4a5c-96fa-180d5a01979b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.231459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2db76-c8fd-4a5c-96fa-180d5a01979b admin admin] PATH_INFO: `/v3/projects/ea483834386d454d980698fc75c492f7` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.232842 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2db76-c8fd-4a5c-96fa-180d5a01979b admin admin] RBAC: Authorizing `identity:get_project(project_id=ea483834386d454d980698fc75c492f7)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:26.235622 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2db76-c8fd-4a5c-96fa-180d5a01979b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:26.237932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 58/121] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:26 2021] GET /identity/v3/projects/ea483834386d454d980698fc75c492f7 => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:26.237932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2db76-c8fd-4a5c-96fa-180d5a01979b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.241619 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9204aaf-4fba-4c7c-bd26-46aaac260302 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.251902 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2db76-c8fd-4a5c-96fa-180d5a01979b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.255069 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8332d2-f98d-4643-b51d-fa9f20966c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.256233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8332d2-f98d-4643-b51d-fa9f20966c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.256767 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8332d2-f98d-4643-b51d-fa9f20966c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.257305 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8332d2-f98d-4643-b51d-fa9f20966c48 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea/users/b2a5428b2da04a328371dd74e3789090/roles/5f5b315594d34a0da8fd0e1cc476318e` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.259041 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7671913-e0dd-4211-b889-ac6d84afefb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.260116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7671913-e0dd-4211-b889-ac6d84afefb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.260418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8332d2-f98d-4643-b51d-fa9f20966c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3488c6af544a1aa2bc5fdd48f927ea, user_id=b2a5428b2da04a328371dd74e3789090, role_id=5f5b315594d34a0da8fd0e1cc476318e)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:26.260520 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7671913-e0dd-4211-b889-ac6d84afefb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.260860 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7671913-e0dd-4211-b889-ac6d84afefb2 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea/users/9ebf9643a2de4a8a9500c2ccce871c70/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.261932 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-1f8332d2-f98d-4643-b51d-fa9f20966c48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:26.261932 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:19:26.261932 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:19:26.263243 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7671913-e0dd-4211-b889-ac6d84afefb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3488c6af544a1aa2bc5fdd48f927ea, user_id=9ebf9643a2de4a8a9500c2ccce871c70, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:26.264485 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8332d2-f98d-4643-b51d-fa9f20966c48 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:26.266351 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7671913-e0dd-4211-b889-ac6d84afefb2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:26.286865 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 59/122] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:19:26 2021] PUT /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea/users/9ebf9643a2de4a8a9500c2ccce871c70/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:26.289836 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7671913-e0dd-4211-b889-ac6d84afefb2 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.293755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 64/123] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:19:26 2021] PUT /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea/users/b2a5428b2da04a328371dd74e3789090/roles/5f5b315594d34a0da8fd0e1cc476318e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:26.329127 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb56ab1-e41a-4507-a74c-df80dfb3301f None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.329439 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb56ab1-e41a-4507-a74c-df80dfb3301f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.329699 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb56ab1-e41a-4507-a74c-df80dfb3301f None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.332115 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 65/124] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:26.341004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d578-f96c-49f5-8a16-418f830e6e78 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.341004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d578-f96c-49f5-8a16-418f830e6e78 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.341004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d578-f96c-49f5-8a16-418f830e6e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.361039 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-6f23d578-f96c-49f5-8a16-418f830e6e78 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:26.362263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6f23d578-f96c-49f5-8a16-418f830e6e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:26.372906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7671913-e0dd-4211-b889-ac6d84afefb2 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.429668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 66/125] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:26.435132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f65982-256e-4ea0-9753-241a315bbc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.436432 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65982-256e-4ea0-9753-241a315bbc4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.436941 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65982-256e-4ea0-9753-241a315bbc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.437427 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65982-256e-4ea0-9753-241a315bbc4a admin admin] PATH_INFO: `/v3/projects/ea483834386d454d980698fc75c492f7/users/b2a5428b2da04a328371dd74e3789090/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.439826 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f65982-256e-4ea0-9753-241a315bbc4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea483834386d454d980698fc75c492f7, user_id=b2a5428b2da04a328371dd74e3789090, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:26.443611 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f65982-256e-4ea0-9753-241a315bbc4a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:26.459374 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d578-f96c-49f5-8a16-418f830e6e78 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.467549 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 60/126] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:19:26 2021] PUT /identity/v3/projects/ea483834386d454d980698fc75c492f7/users/b2a5428b2da04a328371dd74e3789090/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:26.470247 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d578-f96c-49f5-8a16-418f830e6e78 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.544032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a188e-d709-4f86-b61a-cb3cabfade51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.544853 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a188e-d709-4f86-b61a-cb3cabfade51 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.545146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a188e-d709-4f86-b61a-cb3cabfade51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.545428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a188e-d709-4f86-b61a-cb3cabfade51 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.546666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a188e-d709-4f86-b61a-cb3cabfade51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:26.548691 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a188e-d709-4f86-b61a-cb3cabfade51 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:26.550750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 67/127] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:26.563054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f65982-256e-4ea0-9753-241a315bbc4a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:26.581806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f65982-256e-4ea0-9753-241a315bbc4a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:26.587951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c89c7-6c5b-4e95-829f-d68034d1b1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:26.589044 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c89c7-6c5b-4e95-829f-d68034d1b1de admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:26.589550 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c89c7-6c5b-4e95-829f-d68034d1b1de admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:26.590042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c89c7-6c5b-4e95-829f-d68034d1b1de admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:26.591046 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c89c7-6c5b-4e95-829f-d68034d1b1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:26.593345 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c89c7-6c5b-4e95-829f-d68034d1b1de admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:26.617005 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 61/128] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Nov 16 00:19:26 2021] POST /identity/v3/users => generated 283 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:19:28.454207 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7323c30-ae68-40b4-ae33-9a01195613d1 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:28.454708 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7323c30-ae68-40b4-ae33-9a01195613d1 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:28.454804 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7323c30-ae68-40b4-ae33-9a01195613d1 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:28.456890 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 68/129] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:28.465754 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47675c9-fd1d-40b5-aee8-1840a108ba7c None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:28.466586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47675c9-fd1d-40b5-aee8-1840a108ba7c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:28.467047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47675c9-fd1d-40b5-aee8-1840a108ba7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:28.512007 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-a47675c9-fd1d-40b5-aee8-1840a108ba7c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:28.513502 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a47675c9-fd1d-40b5-aee8-1840a108ba7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:28.522774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 62/130] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:28.562060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7323c30-ae68-40b4-ae33-9a01195613d1 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:28.584324 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7323c30-ae68-40b4-ae33-9a01195613d1 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:28.589124 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5225951-7ea9-4cbc-a77f-8ad4474a89ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:28.590116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5225951-7ea9-4cbc-a77f-8ad4474a89ed admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:28.590554 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5225951-7ea9-4cbc-a77f-8ad4474a89ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:28.591009 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5225951-7ea9-4cbc-a77f-8ad4474a89ed admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:28.608532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5225951-7ea9-4cbc-a77f-8ad4474a89ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:28.616035 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-b5225951-7ea9-4cbc-a77f-8ad4474a89ed admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:28.617407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 69/131] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:28.623981 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47675c9-fd1d-40b5-aee8-1840a108ba7c None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:28.634584 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47675c9-fd1d-40b5-aee8-1840a108ba7c None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:28.642710 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5deda9d-a723-4dd2-9c4f-f5d4dcf3ea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:28.643645 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5deda9d-a723-4dd2-9c4f-f5d4dcf3ea67 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:28.644088 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5deda9d-a723-4dd2-9c4f-f5d4dcf3ea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:28.644515 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5deda9d-a723-4dd2-9c4f-f5d4dcf3ea67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:28.646195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5deda9d-a723-4dd2-9c4f-f5d4dcf3ea67 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:28.646665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5deda9d-a723-4dd2-9c4f-f5d4dcf3ea67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:28.648509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5deda9d-a723-4dd2-9c4f-f5d4dcf3ea67 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:28.657960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 63/132] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:28.664911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5225951-7ea9-4cbc-a77f-8ad4474a89ed admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:28.675313 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5225951-7ea9-4cbc-a77f-8ad4474a89ed admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:28.681765 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8812f2-1333-47a2-8351-c789170825eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:28.682944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8812f2-1333-47a2-8351-c789170825eb admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:28.683383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8812f2-1333-47a2-8351-c789170825eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:28.683812 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8812f2-1333-47a2-8351-c789170825eb admin admin] PATH_INFO: `/v3/users/b2a5428b2da04a328371dd74e3789090` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:28.685209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8812f2-1333-47a2-8351-c789170825eb admin admin] RBAC: Authorizing `identity:get_user(user_id=b2a5428b2da04a328371dd74e3789090)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:28.687614 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8812f2-1333-47a2-8351-c789170825eb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:28.689421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 70/133] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:28 2021] GET /identity/v3/users/b2a5428b2da04a328371dd74e3789090 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:28.695856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5deda9d-a723-4dd2-9c4f-f5d4dcf3ea67 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:28.706280 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5deda9d-a723-4dd2-9c4f-f5d4dcf3ea67 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:28.711873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6b7ed-088a-4aab-9d9b-57723333c794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:28.712728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6b7ed-088a-4aab-9d9b-57723333c794 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:28.713190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6b7ed-088a-4aab-9d9b-57723333c794 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:28.713618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6b7ed-088a-4aab-9d9b-57723333c794 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:28.727825 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6b7ed-088a-4aab-9d9b-57723333c794 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:28.729882 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6b7ed-088a-4aab-9d9b-57723333c794 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:28.741140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 64/134] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:28.748900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8812f2-1333-47a2-8351-c789170825eb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:28.760032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8812f2-1333-47a2-8351-c789170825eb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:28.770763 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00213fc7-5247-4600-86fe-4424cd86f4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:28.771861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00213fc7-5247-4600-86fe-4424cd86f4ec admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:28.772301 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00213fc7-5247-4600-86fe-4424cd86f4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:28.772754 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00213fc7-5247-4600-86fe-4424cd86f4ec admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:28.774147 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00213fc7-5247-4600-86fe-4424cd86f4ec admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:28.776460 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00213fc7-5247-4600-86fe-4424cd86f4ec admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:28.778347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 71/135] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:28 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:28.785129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6b7ed-088a-4aab-9d9b-57723333c794 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:28.797484 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6b7ed-088a-4aab-9d9b-57723333c794 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:28.804966 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48f809-c196-4597-a51a-ba76fca56153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:28.805907 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48f809-c196-4597-a51a-ba76fca56153 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:28.806417 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48f809-c196-4597-a51a-ba76fca56153 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:28.806870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48f809-c196-4597-a51a-ba76fca56153 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:28.808544 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48f809-c196-4597-a51a-ba76fca56153 admin admin] RBAC: Adding query filter params (role.id=e338c12e36c04cffba27cfe873d606aa, scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea, user.id=b2a5428b2da04a328371dd74e3789090) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:28.809333 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48f809-c196-4597-a51a-ba76fca56153 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:28.811511 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48f809-c196-4597-a51a-ba76fca56153 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:28.819901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 65/136] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:28 2021] GET /identity/v3/role_assignments?user.id=b2a5428b2da04a328371dd74e3789090&scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea&role.id=e338c12e36c04cffba27cfe873d606aa => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:29.248921 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbd141-53b1-4e92-8002-2ec66a3af6dd None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.249513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbd141-53b1-4e92-8002-2ec66a3af6dd None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.249979 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbd141-53b1-4e92-8002-2ec66a3af6dd None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.252070 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 72/137] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:29.261577 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15849a-ad7c-43f1-ab48-0a65f5cbe02b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.262136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15849a-ad7c-43f1-ab48-0a65f5cbe02b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.262600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15849a-ad7c-43f1-ab48-0a65f5cbe02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.286260 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-6d15849a-ad7c-43f1-ab48-0a65f5cbe02b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:29.287821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6d15849a-ad7c-43f1-ab48-0a65f5cbe02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:29.302328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 66/138] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:29.356352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbd141-53b1-4e92-8002-2ec66a3af6dd None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:29.372898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbd141-53b1-4e92-8002-2ec66a3af6dd None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:29.377740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df68ac-b34e-416e-9770-cad3b961ea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:29.378854 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df68ac-b34e-416e-9770-cad3b961ea43 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.380039 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df68ac-b34e-416e-9770-cad3b961ea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.380505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df68ac-b34e-416e-9770-cad3b961ea43 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.397777 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df68ac-b34e-416e-9770-cad3b961ea43 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:29.405300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-39df68ac-b34e-416e-9770-cad3b961ea43 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:29.406724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 73/139] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:29.413340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15849a-ad7c-43f1-ab48-0a65f5cbe02b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:29.423105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15849a-ad7c-43f1-ab48-0a65f5cbe02b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:29.430559 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d374623-c119-47f2-b3f0-2b38987abf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:29.431494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d374623-c119-47f2-b3f0-2b38987abf1f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.431998 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d374623-c119-47f2-b3f0-2b38987abf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.432466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d374623-c119-47f2-b3f0-2b38987abf1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.433407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d374623-c119-47f2-b3f0-2b38987abf1f admin admin] RBAC: Adding query filter params (name=member) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:29.433906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d374623-c119-47f2-b3f0-2b38987abf1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:29.435896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d374623-c119-47f2-b3f0-2b38987abf1f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:29.444780 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fd1fd-adc7-488b-bc20-cbcfc7b93bac None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.445334 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fd1fd-adc7-488b-bc20-cbcfc7b93bac None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.445798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fd1fd-adc7-488b-bc20-cbcfc7b93bac None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.447858 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 74/140] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:29.451182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 67/141] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:29.457864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fd1fd-adc7-488b-bc20-cbcfc7b93bac None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:29.466624 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d944e4-424d-42ab-8133-563b52b70d14 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.468596 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d944e4-424d-42ab-8133-563b52b70d14 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.469068 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d944e4-424d-42ab-8133-563b52b70d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.477487 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fd1fd-adc7-488b-bc20-cbcfc7b93bac None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:29.491214 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb9ef2-d6e2-4fce-b80f-af92dd8efc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:29.494470 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9ef2-d6e2-4fce-b80f-af92dd8efc2c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.495027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9ef2-d6e2-4fce-b80f-af92dd8efc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.496464 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9ef2-d6e2-4fce-b80f-af92dd8efc2c admin admin] PATH_INFO: `/v3/users/b2a5428b2da04a328371dd74e3789090` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.505925 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb9ef2-d6e2-4fce-b80f-af92dd8efc2c admin admin] RBAC: Authorizing `identity:get_user(user_id=b2a5428b2da04a328371dd74e3789090)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:29.512893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb9ef2-d6e2-4fce-b80f-af92dd8efc2c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:29.515220 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 75/142] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:29 2021] GET /identity/v3/users/b2a5428b2da04a328371dd74e3789090 => generated 275 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:29.522360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb9ef2-d6e2-4fce-b80f-af92dd8efc2c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:29.528918 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-e6d944e4-424d-42ab-8133-563b52b70d14 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:29.530384 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e6d944e4-424d-42ab-8133-563b52b70d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:29.548488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb9ef2-d6e2-4fce-b80f-af92dd8efc2c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:29.551305 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 68/143] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:29.559802 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d26d1-a855-4316-a98b-89b51eeecb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:29.560805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d26d1-a855-4316-a98b-89b51eeecb12 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.561277 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d26d1-a855-4316-a98b-89b51eeecb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.561756 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d26d1-a855-4316-a98b-89b51eeecb12 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.571968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d26d1-a855-4316-a98b-89b51eeecb12 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:29.574011 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d26d1-a855-4316-a98b-89b51eeecb12 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:29.585299 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 76/144] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:29.591749 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d944e4-424d-42ab-8133-563b52b70d14 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:29.603208 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d26d1-a855-4316-a98b-89b51eeecb12 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:29.604201 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d944e4-424d-42ab-8133-563b52b70d14 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:29.617289 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9df36-703e-43b6-b4c8-31ee84812428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:29.618794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9df36-703e-43b6-b4c8-31ee84812428 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.620347 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9df36-703e-43b6-b4c8-31ee84812428 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.620952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9df36-703e-43b6-b4c8-31ee84812428 admin admin] PATH_INFO: `/v3/projects/ea483834386d454d980698fc75c492f7` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.623520 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9df36-703e-43b6-b4c8-31ee84812428 admin admin] RBAC: Authorizing `identity:get_project(project_id=ea483834386d454d980698fc75c492f7)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:29.628147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9df36-703e-43b6-b4c8-31ee84812428 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:29.628619 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d26d1-a855-4316-a98b-89b51eeecb12 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:29.633933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 69/145] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:29 2021] GET /identity/v3/projects/ea483834386d454d980698fc75c492f7 => generated 312 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:29.636687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abc946-a292-472e-b53d-be8e22a675c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:29.638603 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9df36-703e-43b6-b4c8-31ee84812428 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:29.639668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abc946-a292-472e-b53d-be8e22a675c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.642500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abc946-a292-472e-b53d-be8e22a675c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.647241 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abc946-a292-472e-b53d-be8e22a675c7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.659770 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9df36-703e-43b6-b4c8-31ee84812428 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:29.673045 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abc946-a292-472e-b53d-be8e22a675c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:29.680090 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedcee1-8ca8-474c-8388-952fb9dec555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:29.680762 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedcee1-8ca8-474c-8388-952fb9dec555 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.681058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedcee1-8ca8-474c-8388-952fb9dec555 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.681339 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedcee1-8ca8-474c-8388-952fb9dec555 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.682183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedcee1-8ca8-474c-8388-952fb9dec555 admin admin] RBAC: Adding query filter params (role.id=e338c12e36c04cffba27cfe873d606aa, scope.project.id=ea483834386d454d980698fc75c492f7, user.id=b2a5428b2da04a328371dd74e3789090) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:29.682494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedcee1-8ca8-474c-8388-952fb9dec555 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:29.686175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedcee1-8ca8-474c-8388-952fb9dec555 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:29.686987 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-12abc946-a292-472e-b53d-be8e22a675c7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 00:19:29.688478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 77/146] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:19:29 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:29.695286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abc946-a292-472e-b53d-be8e22a675c7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:29.696546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 70/147] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:29 2021] GET /identity/v3/role_assignments?user.id=b2a5428b2da04a328371dd74e3789090&scope.project.id=ea483834386d454d980698fc75c492f7&role.id=e338c12e36c04cffba27cfe873d606aa => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:29.709026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abc946-a292-472e-b53d-be8e22a675c7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:29.714970 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50a5bf-2eea-4a4e-b9a5-ed429749f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:29.715914 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a5bf-2eea-4a4e-b9a5-ed429749f16c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.716408 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a5bf-2eea-4a4e-b9a5-ed429749f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.716954 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a5bf-2eea-4a4e-b9a5-ed429749f16c admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.717970 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50a5bf-2eea-4a4e-b9a5-ed429749f16c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:29.718501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50a5bf-2eea-4a4e-b9a5-ed429749f16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:29.720496 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50a5bf-2eea-4a4e-b9a5-ed429749f16c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:29.735213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 78/148] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:29.741788 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedcee1-8ca8-474c-8388-952fb9dec555 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:29.757198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedcee1-8ca8-474c-8388-952fb9dec555 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:29.771641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0caec-d7b5-4089-8c35-2e8d95d109a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:29.772555 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0caec-d7b5-4089-8c35-2e8d95d109a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.772849 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0caec-d7b5-4089-8c35-2e8d95d109a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.773130 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0caec-d7b5-4089-8c35-2e8d95d109a0 admin admin] PATH_INFO: `/v3/users/b2a5428b2da04a328371dd74e3789090` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.774518 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0caec-d7b5-4089-8c35-2e8d95d109a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=b2a5428b2da04a328371dd74e3789090)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:29.776801 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0caec-d7b5-4089-8c35-2e8d95d109a0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:29.778867 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 71/149] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:29 2021] GET /identity/v3/users/b2a5428b2da04a328371dd74e3789090 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:29.784809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50a5bf-2eea-4a4e-b9a5-ed429749f16c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:29.801394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50a5bf-2eea-4a4e-b9a5-ed429749f16c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:29.809684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993ea40-4b22-4947-bf84-cfd989f51e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:29.810715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ea40-4b22-4947-bf84-cfd989f51e04 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.811260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ea40-4b22-4947-bf84-cfd989f51e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.811797 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ea40-4b22-4947-bf84-cfd989f51e04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.822575 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993ea40-4b22-4947-bf84-cfd989f51e04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:29.824835 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993ea40-4b22-4947-bf84-cfd989f51e04 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:29.840963 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 79/150] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:29.848548 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0caec-d7b5-4089-8c35-2e8d95d109a0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:29.861396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0caec-d7b5-4089-8c35-2e8d95d109a0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:29.868205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca22f7-acdb-4e96-a499-7ca55015b421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:29.869525 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca22f7-acdb-4e96-a499-7ca55015b421 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.870003 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca22f7-acdb-4e96-a499-7ca55015b421 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.870472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca22f7-acdb-4e96-a499-7ca55015b421 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.872097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca22f7-acdb-4e96-a499-7ca55015b421 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:29.874585 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca22f7-acdb-4e96-a499-7ca55015b421 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:29.876693 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 72/151] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:29 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:29.883987 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993ea40-4b22-4947-bf84-cfd989f51e04 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:29.893917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993ea40-4b22-4947-bf84-cfd989f51e04 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:29.899463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0630d-325d-4f7d-8a39-4a5c151aa1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:29.900492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0630d-325d-4f7d-8a39-4a5c151aa1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:29.900995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0630d-325d-4f7d-8a39-4a5c151aa1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:29.901554 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0630d-325d-4f7d-8a39-4a5c151aa1a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:29.902727 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0630d-325d-4f7d-8a39-4a5c151aa1a4 admin admin] RBAC: Adding query filter params (role.id=5f5b315594d34a0da8fd0e1cc476318e, scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea, user.id=b2a5428b2da04a328371dd74e3789090) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:29.903322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0630d-325d-4f7d-8a39-4a5c151aa1a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:29.905611 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0630d-325d-4f7d-8a39-4a5c151aa1a4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:29.915755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 80/152] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:29 2021] GET /identity/v3/role_assignments?user.id=b2a5428b2da04a328371dd74e3789090&scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea&role.id=5f5b315594d34a0da8fd0e1cc476318e => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:30.035168 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c067b6e-dfd1-4677-bccc-f4bef7c1a771 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:30.036296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c067b6e-dfd1-4677-bccc-f4bef7c1a771 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:30.036762 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c067b6e-dfd1-4677-bccc-f4bef7c1a771 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:30.038901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 73/153] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:30.048555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae19cbc-2412-4033-9957-0a4c1acd3425 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:30.049219 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae19cbc-2412-4033-9957-0a4c1acd3425 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:30.049686 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae19cbc-2412-4033-9957-0a4c1acd3425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:30.080280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-3ae19cbc-2412-4033-9957-0a4c1acd3425 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:30.081803 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-3ae19cbc-2412-4033-9957-0a4c1acd3425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:30.096489 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 81/154] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:30.140400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c067b6e-dfd1-4677-bccc-f4bef7c1a771 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:30.155805 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c067b6e-dfd1-4677-bccc-f4bef7c1a771 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:30.166818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfd10e-68dc-4f2d-af2c-5fe86c55019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:30.168006 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfd10e-68dc-4f2d-af2c-5fe86c55019b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:30.168482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfd10e-68dc-4f2d-af2c-5fe86c55019b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:30.169026 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfd10e-68dc-4f2d-af2c-5fe86c55019b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:30.186342 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfd10e-68dc-4f2d-af2c-5fe86c55019b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:30.194677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-23cfd10e-68dc-4f2d-af2c-5fe86c55019b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:19:30.196734 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 74/155] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:19:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:30.203529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae19cbc-2412-4033-9957-0a4c1acd3425 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:30.214949 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae19cbc-2412-4033-9957-0a4c1acd3425 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:30.223109 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c430d1-7285-4bb1-8136-881472794fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:30.224195 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c430d1-7285-4bb1-8136-881472794fca admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:30.224729 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c430d1-7285-4bb1-8136-881472794fca admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:30.225238 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c430d1-7285-4bb1-8136-881472794fca admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:30.226211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c430d1-7285-4bb1-8136-881472794fca admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:30.226703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c430d1-7285-4bb1-8136-881472794fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:30.228620 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c430d1-7285-4bb1-8136-881472794fca admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:30.241197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 82/156] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:30.247687 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfd10e-68dc-4f2d-af2c-5fe86c55019b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:30.259502 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfd10e-68dc-4f2d-af2c-5fe86c55019b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:30.267853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d525f-95f0-4666-b2ef-b3265ceeed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:30.269079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d525f-95f0-4666-b2ef-b3265ceeed66 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:30.269664 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d525f-95f0-4666-b2ef-b3265ceeed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:30.270648 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d525f-95f0-4666-b2ef-b3265ceeed66 admin admin] PATH_INFO: `/v3/users/9ebf9643a2de4a8a9500c2ccce871c70` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:30.272109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d525f-95f0-4666-b2ef-b3265ceeed66 admin admin] RBAC: Authorizing `identity:get_user(user_id=9ebf9643a2de4a8a9500c2ccce871c70)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:30.274222 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d525f-95f0-4666-b2ef-b3265ceeed66 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:30.276227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 75/157] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:30 2021] GET /identity/v3/users/9ebf9643a2de4a8a9500c2ccce871c70 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:30.282656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c430d1-7285-4bb1-8136-881472794fca admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:30.293720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c430d1-7285-4bb1-8136-881472794fca admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:30.301860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a0599-a97e-496f-9a72-d3b3006c8d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:30.302825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a0599-a97e-496f-9a72-d3b3006c8d61 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:30.303433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a0599-a97e-496f-9a72-d3b3006c8d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:30.303895 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a0599-a97e-496f-9a72-d3b3006c8d61 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:30.313304 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a0599-a97e-496f-9a72-d3b3006c8d61 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:30.315202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a0599-a97e-496f-9a72-d3b3006c8d61 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:30.326634 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 83/158] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:30.333501 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d525f-95f0-4666-b2ef-b3265ceeed66 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:30.343650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d525f-95f0-4666-b2ef-b3265ceeed66 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:30.351039 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005d9b8-2b85-4779-a328-77b1272da1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:30.351924 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005d9b8-2b85-4779-a328-77b1272da1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:30.352215 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005d9b8-2b85-4779-a328-77b1272da1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:30.352502 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005d9b8-2b85-4779-a328-77b1272da1c8 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:30.353746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005d9b8-2b85-4779-a328-77b1272da1c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:30.355890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005d9b8-2b85-4779-a328-77b1272da1c8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:30.357644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 76/159] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:30 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:30.364510 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a0599-a97e-496f-9a72-d3b3006c8d61 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:30.380692 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a0599-a97e-496f-9a72-d3b3006c8d61 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:30.385309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c32b6-37ea-4df0-aac2-aaa9a3f2eb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:30.385968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c32b6-37ea-4df0-aac2-aaa9a3f2eb3c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:30.386262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c32b6-37ea-4df0-aac2-aaa9a3f2eb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:30.386543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c32b6-37ea-4df0-aac2-aaa9a3f2eb3c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:30.387414 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c32b6-37ea-4df0-aac2-aaa9a3f2eb3c admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea, user.id=9ebf9643a2de4a8a9500c2ccce871c70) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:30.387731 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c32b6-37ea-4df0-aac2-aaa9a3f2eb3c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:30.389633 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c32b6-37ea-4df0-aac2-aaa9a3f2eb3c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:30.400153 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 84/160] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:30 2021] GET /identity/v3/role_assignments?user.id=9ebf9643a2de4a8a9500c2ccce871c70&scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea&role.id=2813231cc8954b998440e4bf5ede2945 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:30.835652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283812-0cc8-4c86-8865-a9983f7d27f2 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:30.836698 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283812-0cc8-4c86-8865-a9983f7d27f2 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:30.837206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283812-0cc8-4c86-8865-a9983f7d27f2 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:30.839485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 77/161] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:30.848951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3749b9-4629-49b1-964b-5a046127e975 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:30.849834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3749b9-4629-49b1-964b-5a046127e975 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:30.850338 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3749b9-4629-49b1-964b-5a046127e975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:30.870586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-bd3749b9-4629-49b1-964b-5a046127e975 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:30.872136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-bd3749b9-4629-49b1-964b-5a046127e975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:30.881862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 85/162] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:30.907492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9283812-0cc8-4c86-8865-a9983f7d27f2 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:30.920964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9283812-0cc8-4c86-8865-a9983f7d27f2 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:30.925694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf4885-fde5-4225-bd26-478faa8de758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:30.927395 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf4885-fde5-4225-bd26-478faa8de758 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:30.927889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf4885-fde5-4225-bd26-478faa8de758 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:30.928963 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf4885-fde5-4225-bd26-478faa8de758 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:30.940170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf4885-fde5-4225-bd26-478faa8de758 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:30.947420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-8abf4885-fde5-4225-bd26-478faa8de758 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:30.949146 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 78/163] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:30.955712 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3749b9-4629-49b1-964b-5a046127e975 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:30.965161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3749b9-4629-49b1-964b-5a046127e975 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:30.969964 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81ab90-6334-4708-9c35-43137b85d1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:30.970873 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81ab90-6334-4708-9c35-43137b85d1de admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:30.971365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81ab90-6334-4708-9c35-43137b85d1de admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:30.972104 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81ab90-6334-4708-9c35-43137b85d1de admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:30.973900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81ab90-6334-4708-9c35-43137b85d1de admin admin] RBAC: Adding query filter params (name=member) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:30.974483 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81ab90-6334-4708-9c35-43137b85d1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:30.976822 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81ab90-6334-4708-9c35-43137b85d1de admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:30.991252 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 86/164] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:30.997664 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf4885-fde5-4225-bd26-478faa8de758 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:31.007918 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf4885-fde5-4225-bd26-478faa8de758 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:31.012667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb39fc-3494-4343-b87b-b0bd3f381b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:31.013753 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb39fc-3494-4343-b87b-b0bd3f381b25 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.014239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb39fc-3494-4343-b87b-b0bd3f381b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.014739 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb39fc-3494-4343-b87b-b0bd3f381b25 admin admin] PATH_INFO: `/v3/users/42d5ad4a80f84d0fb97ac588a47759bf` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.033669 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb39fc-3494-4343-b87b-b0bd3f381b25 admin admin] RBAC: Authorizing `identity:get_user(user_id=42d5ad4a80f84d0fb97ac588a47759bf)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:31.036821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb39fc-3494-4343-b87b-b0bd3f381b25 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:31.038899 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 79/165] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:30 2021] GET /identity/v3/users/42d5ad4a80f84d0fb97ac588a47759bf => generated 283 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:31.045296 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81ab90-6334-4708-9c35-43137b85d1de admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:31.057139 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81ab90-6334-4708-9c35-43137b85d1de admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:31.063375 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995b9a1-530e-4f7e-8f53-19dc4e887614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:31.064227 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995b9a1-530e-4f7e-8f53-19dc4e887614 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.064698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995b9a1-530e-4f7e-8f53-19dc4e887614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.065172 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995b9a1-530e-4f7e-8f53-19dc4e887614 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.076350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995b9a1-530e-4f7e-8f53-19dc4e887614 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:31.078390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995b9a1-530e-4f7e-8f53-19dc4e887614 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:31.091183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 87/166] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:31.099681 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb39fc-3494-4343-b87b-b0bd3f381b25 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:31.110793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb39fc-3494-4343-b87b-b0bd3f381b25 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:31.116471 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e5073-7a98-45a6-a3f1-f2caa5226def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:31.117628 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e5073-7a98-45a6-a3f1-f2caa5226def admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.118096 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e5073-7a98-45a6-a3f1-f2caa5226def admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.118598 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e5073-7a98-45a6-a3f1-f2caa5226def admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.120136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e5073-7a98-45a6-a3f1-f2caa5226def admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:31.122435 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e5073-7a98-45a6-a3f1-f2caa5226def admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:31.124378 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 80/167] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:31 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:31.130975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995b9a1-530e-4f7e-8f53-19dc4e887614 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:31.140556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995b9a1-530e-4f7e-8f53-19dc4e887614 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:31.145468 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de938d1e-dc0f-4200-82ff-41fbb22da109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:31.146347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de938d1e-dc0f-4200-82ff-41fbb22da109 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.146824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de938d1e-dc0f-4200-82ff-41fbb22da109 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.147437 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de938d1e-dc0f-4200-82ff-41fbb22da109 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.148444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de938d1e-dc0f-4200-82ff-41fbb22da109 admin admin] RBAC: Adding query filter params (role.id=e338c12e36c04cffba27cfe873d606aa, scope.project.id=dc0ea87d14e741a29f7ed0df7614186c, user.id=42d5ad4a80f84d0fb97ac588a47759bf) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:31.148985 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de938d1e-dc0f-4200-82ff-41fbb22da109 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:31.151076 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de938d1e-dc0f-4200-82ff-41fbb22da109 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:31.159304 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 88/168] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:31 2021] GET /identity/v3/role_assignments?user.id=42d5ad4a80f84d0fb97ac588a47759bf&scope.project.id=dc0ea87d14e741a29f7ed0df7614186c&role.id=e338c12e36c04cffba27cfe873d606aa => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:31.583410 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bad12-f76b-4d24-b4d8-17f85d396b24 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.583783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bad12-f76b-4d24-b4d8-17f85d396b24 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.584008 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bad12-f76b-4d24-b4d8-17f85d396b24 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.585920 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 81/169] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:31.593565 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b4622-6e13-4e2c-b27b-eca0d02c8f4f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.594110 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b4622-6e13-4e2c-b27b-eca0d02c8f4f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.594590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b4622-6e13-4e2c-b27b-eca0d02c8f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.617373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-9c5b4622-6e13-4e2c-b27b-eca0d02c8f4f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:31.618557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9c5b4622-6e13-4e2c-b27b-eca0d02c8f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:31.626483 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 89/170] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:31.652329 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bad12-f76b-4d24-b4d8-17f85d396b24 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:31.669368 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bad12-f76b-4d24-b4d8-17f85d396b24 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:31.673745 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bf585-4cb3-49b0-b69a-18772a796cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:31.674530 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bf585-4cb3-49b0-b69a-18772a796cae admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.674817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bf585-4cb3-49b0-b69a-18772a796cae admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.675124 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bf585-4cb3-49b0-b69a-18772a796cae admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.686429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bf585-4cb3-49b0-b69a-18772a796cae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:31.693303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-f54bf585-4cb3-49b0-b69a-18772a796cae admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:19:31.694504 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 82/171] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:19:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:31.701102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b4622-6e13-4e2c-b27b-eca0d02c8f4f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:31.710936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b4622-6e13-4e2c-b27b-eca0d02c8f4f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:31.715561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c12e6-68cb-4efc-9e93-6afc575deeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:31.716411 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c12e6-68cb-4efc-9e93-6afc575deeed admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.716892 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c12e6-68cb-4efc-9e93-6afc575deeed admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.717341 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c12e6-68cb-4efc-9e93-6afc575deeed admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.718263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c12e6-68cb-4efc-9e93-6afc575deeed admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:31.718739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c12e6-68cb-4efc-9e93-6afc575deeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:31.720658 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c12e6-68cb-4efc-9e93-6afc575deeed admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:31.730677 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 90/172] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:31.736875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bf585-4cb3-49b0-b69a-18772a796cae admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:31.747468 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bf585-4cb3-49b0-b69a-18772a796cae admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:31.751961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484d83e-d947-4af5-8dac-eb703ee77ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:31.752846 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484d83e-d947-4af5-8dac-eb703ee77ffa admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.753136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484d83e-d947-4af5-8dac-eb703ee77ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.753415 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484d83e-d947-4af5-8dac-eb703ee77ffa admin admin] PATH_INFO: `/v3/users/9ebf9643a2de4a8a9500c2ccce871c70` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.754989 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484d83e-d947-4af5-8dac-eb703ee77ffa admin admin] RBAC: Authorizing `identity:get_user(user_id=9ebf9643a2de4a8a9500c2ccce871c70)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:31.756845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484d83e-d947-4af5-8dac-eb703ee77ffa admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:31.763001 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 83/173] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:31 2021] GET /identity/v3/users/9ebf9643a2de4a8a9500c2ccce871c70 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:31.765576 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c12e6-68cb-4efc-9e93-6afc575deeed admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:31.776342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c12e6-68cb-4efc-9e93-6afc575deeed admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:31.781190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82179c3-43b5-49d8-80c7-e63d59dfe080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:31.781877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82179c3-43b5-49d8-80c7-e63d59dfe080 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.782177 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82179c3-43b5-49d8-80c7-e63d59dfe080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.782464 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82179c3-43b5-49d8-80c7-e63d59dfe080 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.792235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82179c3-43b5-49d8-80c7-e63d59dfe080 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:31.794084 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82179c3-43b5-49d8-80c7-e63d59dfe080 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:31.805500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 91/174] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:31.811668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484d83e-d947-4af5-8dac-eb703ee77ffa admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:31.824653 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484d83e-d947-4af5-8dac-eb703ee77ffa admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:31.829335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4106a-400b-44f9-ab15-54b7c63337e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:31.830183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4106a-400b-44f9-ab15-54b7c63337e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.830485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4106a-400b-44f9-ab15-54b7c63337e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.830740 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4106a-400b-44f9-ab15-54b7c63337e9 admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.832004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4106a-400b-44f9-ab15-54b7c63337e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:31.834666 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4106a-400b-44f9-ab15-54b7c63337e9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:31.836334 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 84/175] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:31 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:31.842794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82179c3-43b5-49d8-80c7-e63d59dfe080 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:31.853077 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82179c3-43b5-49d8-80c7-e63d59dfe080 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:31.857680 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc04de3-9e2b-427b-9182-a8de7bb336b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:31.858328 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04de3-9e2b-427b-9182-a8de7bb336b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.858747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04de3-9e2b-427b-9182-a8de7bb336b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.859225 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04de3-9e2b-427b-9182-a8de7bb336b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.860667 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc04de3-9e2b-427b-9182-a8de7bb336b4 admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=dc0ea87d14e741a29f7ed0df7614186c, user.id=9ebf9643a2de4a8a9500c2ccce871c70) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:31.861147 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc04de3-9e2b-427b-9182-a8de7bb336b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:31.864978 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc04de3-9e2b-427b-9182-a8de7bb336b4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:31.867748 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd149-e63a-4bc4-8cd2-f2436cf7430f None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.868042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd149-e63a-4bc4-8cd2-f2436cf7430f None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.868326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd149-e63a-4bc4-8cd2-f2436cf7430f None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.870117 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 85/176] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:31.872346 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 92/177] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:31 2021] GET /identity/v3/role_assignments?user.id=9ebf9643a2de4a8a9500c2ccce871c70&scope.project.id=dc0ea87d14e741a29f7ed0df7614186c&role.id=2813231cc8954b998440e4bf5ede2945 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:31.876498 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99240f51-dd0e-49b0-9816-6f008103f0f1 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.876787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99240f51-dd0e-49b0-9816-6f008103f0f1 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.877071 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99240f51-dd0e-49b0-9816-6f008103f0f1 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.879074 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 86/178] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:31.886397 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbb981-e7e1-4b32-b0d9-77568b366a89 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.886697 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbb981-e7e1-4b32-b0d9-77568b366a89 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.887027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbb981-e7e1-4b32-b0d9-77568b366a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.889909 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89e53d-d4c4-40c7-a7c5-cf8b788efdd3 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.890197 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89e53d-d4c4-40c7-a7c5-cf8b788efdd3 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.890472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89e53d-d4c4-40c7-a7c5-cf8b788efdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.909152 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-5a89e53d-d4c4-40c7-a7c5-cf8b788efdd3 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:31.911060 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-5a89e53d-d4c4-40c7-a7c5-cf8b788efdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:31.911466 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-74cbb981-e7e1-4b32-b0d9-77568b366a89 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:31.913062 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-74cbb981-e7e1-4b32-b0d9-77568b366a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:31.919376 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 87/179] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:31.933694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 93/180] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:31.945902 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89e53d-d4c4-40c7-a7c5-cf8b788efdd3 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:31.955601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89e53d-d4c4-40c7-a7c5-cf8b788efdd3 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:31.958478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbb981-e7e1-4b32-b0d9-77568b366a89 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:31.964593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78912c79-8de3-445c-8d69-5b0ce890e41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:31.965760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78912c79-8de3-445c-8d69-5b0ce890e41a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.966213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78912c79-8de3-445c-8d69-5b0ce890e41a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.966724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78912c79-8de3-445c-8d69-5b0ce890e41a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.968265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78912c79-8de3-445c-8d69-5b0ce890e41a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:31.968675 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbb981-e7e1-4b32-b0d9-77568b366a89 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:31.970560 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78912c79-8de3-445c-8d69-5b0ce890e41a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:31.973707 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 88/181] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:31.979869 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78912c79-8de3-445c-8d69-5b0ce890e41a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:31.980873 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4240e7c-757b-4881-b81d-aedc3990fae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:31.981948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4240e7c-757b-4881-b81d-aedc3990fae1 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.982592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4240e7c-757b-4881-b81d-aedc3990fae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.983143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4240e7c-757b-4881-b81d-aedc3990fae1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.991110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78912c79-8de3-445c-8d69-5b0ce890e41a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:31.995814 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cbf8a-1ac0-4994-8062-30a8fa5a8fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:31.996504 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cbf8a-1ac0-4994-8062-30a8fa5a8fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:31.996788 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cbf8a-1ac0-4994-8062-30a8fa5a8fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:31.997065 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cbf8a-1ac0-4994-8062-30a8fa5a8fa1 admin admin] PATH_INFO: `/v3/groups` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:31.997835 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cbf8a-1ac0-4994-8062-30a8fa5a8fa1 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:31.998900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-822cbf8a-1ac0-4994-8062-30a8fa5a8fa1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:31.998900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:19:31.998900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:19:31.999445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4240e7c-757b-4881-b81d-aedc3990fae1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:32.000101 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cbf8a-1ac0-4994-8062-30a8fa5a8fa1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:32.009139 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-e4240e7c-757b-4881-b81d-aedc3990fae1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 00:19:32.011091 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 94/182] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:19:31 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:19:32.017232 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4240e7c-757b-4881-b81d-aedc3990fae1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:32.019212 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 89/183] 10.222.0.50 () {60 vars in 1155 bytes} [Tue Nov 16 00:19:31 2021] POST /identity/v3/groups => generated 229 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:19:32.029261 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4240e7c-757b-4881-b81d-aedc3990fae1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:32.034716 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dc6b6-0c30-4069-91a8-ac55b92448cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:32.035968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dc6b6-0c30-4069-91a8-ac55b92448cd admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:32.036508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dc6b6-0c30-4069-91a8-ac55b92448cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:32.037016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dc6b6-0c30-4069-91a8-ac55b92448cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:32.038024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dc6b6-0c30-4069-91a8-ac55b92448cd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:32.038617 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dc6b6-0c30-4069-91a8-ac55b92448cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:32.041020 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dc6b6-0c30-4069-91a8-ac55b92448cd admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:32.053400 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 95/184] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:32.060152 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cbf8a-1ac0-4994-8062-30a8fa5a8fa1 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:32.077534 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cbf8a-1ac0-4994-8062-30a8fa5a8fa1 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:32.083328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b87fb-5bde-4654-95c0-2809059e1d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:32.084433 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b87fb-5bde-4654-95c0-2809059e1d85 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:32.084903 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b87fb-5bde-4654-95c0-2809059e1d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:32.085194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b87fb-5bde-4654-95c0-2809059e1d85 admin admin] PATH_INFO: `/v3/users/42d5ad4a80f84d0fb97ac588a47759bf` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:32.086737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b87fb-5bde-4654-95c0-2809059e1d85 admin admin] RBAC: Authorizing `identity:get_user(user_id=42d5ad4a80f84d0fb97ac588a47759bf)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:32.089164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b87fb-5bde-4654-95c0-2809059e1d85 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:32.091255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 90/185] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:32 2021] GET /identity/v3/users/42d5ad4a80f84d0fb97ac588a47759bf => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:32.098693 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dc6b6-0c30-4069-91a8-ac55b92448cd admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:32.109370 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dc6b6-0c30-4069-91a8-ac55b92448cd admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:32.115820 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fde20a-1fe1-411c-912e-77288859b3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:32.116672 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fde20a-1fe1-411c-912e-77288859b3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:32.117017 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fde20a-1fe1-411c-912e-77288859b3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:32.117353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fde20a-1fe1-411c-912e-77288859b3d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:32.127353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fde20a-1fe1-411c-912e-77288859b3d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:32.130439 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fde20a-1fe1-411c-912e-77288859b3d0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:32.143051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 96/186] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:19:32.150106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b87fb-5bde-4654-95c0-2809059e1d85 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:32.161347 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b87fb-5bde-4654-95c0-2809059e1d85 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:32.166001 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56f6f6-6da6-4be8-9729-3d8b6e6d13c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:32.166957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f6f6-6da6-4be8-9729-3d8b6e6d13c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:32.167299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f6f6-6da6-4be8-9729-3d8b6e6d13c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:32.167638 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f6f6-6da6-4be8-9729-3d8b6e6d13c8 admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:32.168992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56f6f6-6da6-4be8-9729-3d8b6e6d13c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:32.171246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56f6f6-6da6-4be8-9729-3d8b6e6d13c8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:32.173211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 91/187] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:32 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:32.180677 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fde20a-1fe1-411c-912e-77288859b3d0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:32.190296 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fde20a-1fe1-411c-912e-77288859b3d0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:32.197176 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3690c-7de8-475e-81e0-623d88b08460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:32.197834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3690c-7de8-475e-81e0-623d88b08460 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:32.198121 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3690c-7de8-475e-81e0-623d88b08460 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:32.198402 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3690c-7de8-475e-81e0-623d88b08460 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:32.199277 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3690c-7de8-475e-81e0-623d88b08460 admin admin] RBAC: Adding query filter params (role.id=5f5b315594d34a0da8fd0e1cc476318e, scope.project.id=dc0ea87d14e741a29f7ed0df7614186c, user.id=42d5ad4a80f84d0fb97ac588a47759bf) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:32.199593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3690c-7de8-475e-81e0-623d88b08460 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:32.201460 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3690c-7de8-475e-81e0-623d88b08460 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:32.208345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 97/188] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:32 2021] GET /identity/v3/role_assignments?user.id=42d5ad4a80f84d0fb97ac588a47759bf&scope.project.id=dc0ea87d14e741a29f7ed0df7614186c&role.id=5f5b315594d34a0da8fd0e1cc476318e => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:33.429304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37400e26-169d-4ef2-b1e8-9cd4d9b0b2fa None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:33.429808 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37400e26-169d-4ef2-b1e8-9cd4d9b0b2fa None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:33.429883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37400e26-169d-4ef2-b1e8-9cd4d9b0b2fa None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:33.431682 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 92/189] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:33.439366 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff3180-5535-4cb9-8534-66482c022619 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:33.439791 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff3180-5535-4cb9-8534-66482c022619 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:33.440111 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff3180-5535-4cb9-8534-66482c022619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:33.459161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-fcff3180-5535-4cb9-8534-66482c022619 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:33.460421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-fcff3180-5535-4cb9-8534-66482c022619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:33.468193 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 98/190] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:33.492246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37400e26-169d-4ef2-b1e8-9cd4d9b0b2fa None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:33.505375 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37400e26-169d-4ef2-b1e8-9cd4d9b0b2fa None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:33.510276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b280350-0e00-46a7-a258-9a1e381afe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:33.511108 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b280350-0e00-46a7-a258-9a1e381afe5f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:33.511398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b280350-0e00-46a7-a258-9a1e381afe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:33.511677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b280350-0e00-46a7-a258-9a1e381afe5f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:33.524150 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b280350-0e00-46a7-a258-9a1e381afe5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:33.531145 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-5b280350-0e00-46a7-a258-9a1e381afe5f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:33.532347 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 93/191] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:33.539658 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff3180-5535-4cb9-8534-66482c022619 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:33.548874 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff3180-5535-4cb9-8534-66482c022619 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:33.553510 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78444ac0-433c-4ba1-a029-39841a71da6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:33.554178 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78444ac0-433c-4ba1-a029-39841a71da6f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:33.554466 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78444ac0-433c-4ba1-a029-39841a71da6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:33.554748 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78444ac0-433c-4ba1-a029-39841a71da6f admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:33.555547 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78444ac0-433c-4ba1-a029-39841a71da6f admin admin] RBAC: Adding query filter params (name=member) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:33.555859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78444ac0-433c-4ba1-a029-39841a71da6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:33.557476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78444ac0-433c-4ba1-a029-39841a71da6f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:33.566196 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 99/192] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:33.573420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b280350-0e00-46a7-a258-9a1e381afe5f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:33.583915 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b280350-0e00-46a7-a258-9a1e381afe5f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:33.588362 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acef4c1-fa97-4772-bef3-9b79beb4eb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:33.589221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acef4c1-fa97-4772-bef3-9b79beb4eb76 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:33.589510 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acef4c1-fa97-4772-bef3-9b79beb4eb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:33.589793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acef4c1-fa97-4772-bef3-9b79beb4eb76 admin admin] PATH_INFO: `/v3/users/42d5ad4a80f84d0fb97ac588a47759bf` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:33.591058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acef4c1-fa97-4772-bef3-9b79beb4eb76 admin admin] RBAC: Authorizing `identity:get_user(user_id=42d5ad4a80f84d0fb97ac588a47759bf)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:33.593194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acef4c1-fa97-4772-bef3-9b79beb4eb76 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:33.594801 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 94/193] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:33 2021] GET /identity/v3/users/42d5ad4a80f84d0fb97ac588a47759bf => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:33.601970 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78444ac0-433c-4ba1-a029-39841a71da6f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:33.611747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78444ac0-433c-4ba1-a029-39841a71da6f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:33.616451 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8107a-fcea-4c7d-a395-b792fd3dec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:33.617301 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8107a-fcea-4c7d-a395-b792fd3dec93 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:33.617590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8107a-fcea-4c7d-a395-b792fd3dec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:33.617872 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8107a-fcea-4c7d-a395-b792fd3dec93 admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:33.619167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8107a-fcea-4c7d-a395-b792fd3dec93 admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:33.621265 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8107a-fcea-4c7d-a395-b792fd3dec93 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:33.626606 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 100/194] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:33 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:33.629766 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acef4c1-fa97-4772-bef3-9b79beb4eb76 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:33.639752 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acef4c1-fa97-4772-bef3-9b79beb4eb76 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:33.644265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfe71c-84dc-4690-853a-8911c0ed24c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:33.645698 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe71c-84dc-4690-853a-8911c0ed24c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:33.645984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe71c-84dc-4690-853a-8911c0ed24c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:33.646267 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe71c-84dc-4690-853a-8911c0ed24c9 admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c/users/42d5ad4a80f84d0fb97ac588a47759bf/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:33.648327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfe71c-84dc-4690-853a-8911c0ed24c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0ea87d14e741a29f7ed0df7614186c, user_id=42d5ad4a80f84d0fb97ac588a47759bf, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:33.651052 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfe71c-84dc-4690-853a-8911c0ed24c9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:33.665349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 95/195] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:19:33 2021] PUT /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c/users/42d5ad4a80f84d0fb97ac588a47759bf/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:34.140568 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280a0d1-ba34-45e5-97ff-32a90f761a7b None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.141029 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280a0d1-ba34-45e5-97ff-32a90f761a7b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.141203 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280a0d1-ba34-45e5-97ff-32a90f761a7b None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.142909 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 101/196] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:34.150446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d3b43-ed96-4e36-a21b-d4d8e146aeaa None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.150736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d3b43-ed96-4e36-a21b-d4d8e146aeaa None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.151047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d3b43-ed96-4e36-a21b-d4d8e146aeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.170341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-944d3b43-ed96-4e36-a21b-d4d8e146aeaa None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:34.171611 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-944d3b43-ed96-4e36-a21b-d4d8e146aeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:34.234902 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 96/197] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:34.257998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280a0d1-ba34-45e5-97ff-32a90f761a7b None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:34.271222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280a0d1-ba34-45e5-97ff-32a90f761a7b None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:34.271486 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99054cf-468e-4d09-bdab-46952ffbb74f None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.271776 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99054cf-468e-4d09-bdab-46952ffbb74f None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.272161 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99054cf-468e-4d09-bdab-46952ffbb74f None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.274479 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 97/198] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:34.280071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194470cb-f52b-4dcb-b2d4-d7bd2c3a902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:34.280934 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194470cb-f52b-4dcb-b2d4-d7bd2c3a902b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.281284 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194470cb-f52b-4dcb-b2d4-d7bd2c3a902b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.281473 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadaf2-3acc-4211-b670-ff70c23e41bc None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.281680 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194470cb-f52b-4dcb-b2d4-d7bd2c3a902b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.281834 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadaf2-3acc-4211-b670-ff70c23e41bc None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.282031 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadaf2-3acc-4211-b670-ff70c23e41bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.295541 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194470cb-f52b-4dcb-b2d4-d7bd2c3a902b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:34.300375 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-6dbadaf2-3acc-4211-b670-ff70c23e41bc None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:34.301701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6dbadaf2-3acc-4211-b670-ff70c23e41bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:34.303194 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-194470cb-f52b-4dcb-b2d4-d7bd2c3a902b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:19:34.305220 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 102/199] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:19:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:34.310980 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194470cb-f52b-4dcb-b2d4-d7bd2c3a902b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:34.314651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 98/200] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:34.321544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194470cb-f52b-4dcb-b2d4-d7bd2c3a902b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:34.325965 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009f5d1-69a0-4a6a-a5cb-9b678ebfc2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:34.326602 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009f5d1-69a0-4a6a-a5cb-9b678ebfc2df admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.326906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009f5d1-69a0-4a6a-a5cb-9b678ebfc2df admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.327184 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009f5d1-69a0-4a6a-a5cb-9b678ebfc2df admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.327918 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009f5d1-69a0-4a6a-a5cb-9b678ebfc2df admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:34.328222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009f5d1-69a0-4a6a-a5cb-9b678ebfc2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:34.329806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009f5d1-69a0-4a6a-a5cb-9b678ebfc2df admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:34.339581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 103/201] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:34.340843 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbadaf2-3acc-4211-b670-ff70c23e41bc None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:34.346278 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009f5d1-69a0-4a6a-a5cb-9b678ebfc2df admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:34.352263 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbadaf2-3acc-4211-b670-ff70c23e41bc None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:34.357550 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65a9fc-f819-4286-9d49-fe3cd61b2a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:34.358518 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65a9fc-f819-4286-9d49-fe3cd61b2a3f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.358668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009f5d1-69a0-4a6a-a5cb-9b678ebfc2df admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:34.359010 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65a9fc-f819-4286-9d49-fe3cd61b2a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.359548 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65a9fc-f819-4286-9d49-fe3cd61b2a3f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.361215 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65a9fc-f819-4286-9d49-fe3cd61b2a3f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:34.363256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b10d8b-12ad-4d40-96b0-30bb688675f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:34.364224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b10d8b-12ad-4d40-96b0-30bb688675f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.364583 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b10d8b-12ad-4d40-96b0-30bb688675f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.364683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65a9fc-f819-4286-9d49-fe3cd61b2a3f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:34.364983 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b10d8b-12ad-4d40-96b0-30bb688675f7 admin admin] PATH_INFO: `/v3/users/9ebf9643a2de4a8a9500c2ccce871c70` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.366349 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b10d8b-12ad-4d40-96b0-30bb688675f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=9ebf9643a2de4a8a9500c2ccce871c70)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:34.368403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b10d8b-12ad-4d40-96b0-30bb688675f7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:34.370252 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 104/202] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:34 2021] GET /identity/v3/users/9ebf9643a2de4a8a9500c2ccce871c70 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:34.375153 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 99/203] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:34.376147 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b10d8b-12ad-4d40-96b0-30bb688675f7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:34.379494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65a9fc-f819-4286-9d49-fe3cd61b2a3f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:34.388100 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b10d8b-12ad-4d40-96b0-30bb688675f7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:34.390427 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65a9fc-f819-4286-9d49-fe3cd61b2a3f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:34.393441 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bb428-f5a4-473e-94ee-127615f82851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:34.395015 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bb428-f5a4-473e-94ee-127615f82851 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.395508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bb428-f5a4-473e-94ee-127615f82851 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.395871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722448c3-2af2-4a27-a4ee-d2005c76d70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:34.396273 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bb428-f5a4-473e-94ee-127615f82851 admin admin] PATH_INFO: `/v3/groups` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.396996 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722448c3-2af2-4a27-a4ee-d2005c76d70c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.397264 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1bb428-f5a4-473e-94ee-127615f82851 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:34.397481 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722448c3-2af2-4a27-a4ee-d2005c76d70c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.397878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722448c3-2af2-4a27-a4ee-d2005c76d70c admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.398861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-1c1bb428-f5a4-473e-94ee-127615f82851 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:34.398861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:19:34.398861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:19:34.399381 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722448c3-2af2-4a27-a4ee-d2005c76d70c admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:34.400624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1bb428-f5a4-473e-94ee-127615f82851 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:34.401743 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722448c3-2af2-4a27-a4ee-d2005c76d70c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:34.403622 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 100/204] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:34 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:34.410091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722448c3-2af2-4a27-a4ee-d2005c76d70c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:34.422611 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722448c3-2af2-4a27-a4ee-d2005c76d70c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:34.427132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820fbdd-b433-4d70-b581-0851f07c4d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:34.428002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820fbdd-b433-4d70-b581-0851f07c4d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.428286 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820fbdd-b433-4d70-b581-0851f07c4d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.428561 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820fbdd-b433-4d70-b581-0851f07c4d28 admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c/users/9ebf9643a2de4a8a9500c2ccce871c70/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.430559 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820fbdd-b433-4d70-b581-0851f07c4d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0ea87d14e741a29f7ed0df7614186c, user_id=9ebf9643a2de4a8a9500c2ccce871c70, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:34.431841 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 105/205] 10.222.0.50 () {60 vars in 1155 bytes} [Tue Nov 16 00:19:34 2021] POST /identity/v3/groups => generated 226 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:19:34.438932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820fbdd-b433-4d70-b581-0851f07c4d28 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:34.441895 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2e02-6fa3-4410-9d85-c1b09e253b0b None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.442391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2e02-6fa3-4410-9d85-c1b09e253b0b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.442576 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2e02-6fa3-4410-9d85-c1b09e253b0b None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.451029 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 106/206] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:34.452785 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf17ac-3993-4574-bd4e-c28338d1602b None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.453238 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf17ac-3993-4574-bd4e-c28338d1602b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.453668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf17ac-3993-4574-bd4e-c28338d1602b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.455672 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 101/207] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:19:34 2021] PUT /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c/users/9ebf9643a2de4a8a9500c2ccce871c70/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:34.492221 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-afaf17ac-3993-4574-bd4e-c28338d1602b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:34.493854 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-afaf17ac-3993-4574-bd4e-c28338d1602b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:34.564642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 107/208] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:34.589899 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820fbdd-b433-4d70-b581-0851f07c4d28 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:34.601995 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820fbdd-b433-4d70-b581-0851f07c4d28 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:34.607016 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3add3e-69f2-4487-8d89-7c002bbce561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:34.607925 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3add3e-69f2-4487-8d89-7c002bbce561 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.608211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3add3e-69f2-4487-8d89-7c002bbce561 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.608550 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3add3e-69f2-4487-8d89-7c002bbce561 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.622343 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3add3e-69f2-4487-8d89-7c002bbce561 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:34.630275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-6f3add3e-69f2-4487-8d89-7c002bbce561 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 00:19:34.631587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 102/209] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:19:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:34.638213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf17ac-3993-4574-bd4e-c28338d1602b None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:34.647895 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf17ac-3993-4574-bd4e-c28338d1602b None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:34.652922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035e232-69ea-424e-94cc-59fa929d2585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:34.653597 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035e232-69ea-424e-94cc-59fa929d2585 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.653881 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035e232-69ea-424e-94cc-59fa929d2585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.654162 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035e232-69ea-424e-94cc-59fa929d2585 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.654946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035e232-69ea-424e-94cc-59fa929d2585 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:34.655256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035e232-69ea-424e-94cc-59fa929d2585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:34.656995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035e232-69ea-424e-94cc-59fa929d2585 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:34.666400 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 108/210] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:34.673215 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3add3e-69f2-4487-8d89-7c002bbce561 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:34.684655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3add3e-69f2-4487-8d89-7c002bbce561 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:34.689737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad3042-bc1b-4e9c-bc3c-284cf5495d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:34.690600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad3042-bc1b-4e9c-bc3c-284cf5495d77 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.690931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad3042-bc1b-4e9c-bc3c-284cf5495d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.691214 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad3042-bc1b-4e9c-bc3c-284cf5495d77 admin admin] PATH_INFO: `/v3/users/42d5ad4a80f84d0fb97ac588a47759bf` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.692591 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad3042-bc1b-4e9c-bc3c-284cf5495d77 admin admin] RBAC: Authorizing `identity:get_user(user_id=42d5ad4a80f84d0fb97ac588a47759bf)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:34.694856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad3042-bc1b-4e9c-bc3c-284cf5495d77 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:34.696481 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 103/211] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:34 2021] GET /identity/v3/users/42d5ad4a80f84d0fb97ac588a47759bf => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:34.703098 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035e232-69ea-424e-94cc-59fa929d2585 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:34.713110 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035e232-69ea-424e-94cc-59fa929d2585 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:34.717596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04646a-e621-4f1b-999e-76f62516c04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:34.718450 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04646a-e621-4f1b-999e-76f62516c04a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.718734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04646a-e621-4f1b-999e-76f62516c04a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.719087 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04646a-e621-4f1b-999e-76f62516c04a admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.720278 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04646a-e621-4f1b-999e-76f62516c04a admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:34.723223 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04646a-e621-4f1b-999e-76f62516c04a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:34.725156 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 109/212] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:34 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:34.731308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad3042-bc1b-4e9c-bc3c-284cf5495d77 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:34.742116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad3042-bc1b-4e9c-bc3c-284cf5495d77 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:34.746547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe64c51-455d-4b77-a1f9-18e8e02dd45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:34.747548 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe64c51-455d-4b77-a1f9-18e8e02dd45a admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:34.747840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe64c51-455d-4b77-a1f9-18e8e02dd45a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:34.748120 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe64c51-455d-4b77-a1f9-18e8e02dd45a admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c/users/42d5ad4a80f84d0fb97ac588a47759bf/roles/5f5b315594d34a0da8fd0e1cc476318e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:34.752221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe64c51-455d-4b77-a1f9-18e8e02dd45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0ea87d14e741a29f7ed0df7614186c, user_id=42d5ad4a80f84d0fb97ac588a47759bf, role_id=5f5b315594d34a0da8fd0e1cc476318e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:34.755265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe64c51-455d-4b77-a1f9-18e8e02dd45a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:34.772724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 104/213] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:19:34 2021] PUT /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c/users/42d5ad4a80f84d0fb97ac588a47759bf/roles/5f5b315594d34a0da8fd0e1cc476318e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:36.435149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed958-d96d-4cae-b13d-fef21d4cca39 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:36.436174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed958-d96d-4cae-b13d-fef21d4cca39 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:36.436663 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed958-d96d-4cae-b13d-fef21d4cca39 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:36.438937 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 110/214] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:36.447678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e8021-f8ef-4be8-b64f-3e65bd1d8533 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:36.448564 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e8021-f8ef-4be8-b64f-3e65bd1d8533 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:36.449043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e8021-f8ef-4be8-b64f-3e65bd1d8533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:36.467558 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-be4e8021-f8ef-4be8-b64f-3e65bd1d8533 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:36.469042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-be4e8021-f8ef-4be8-b64f-3e65bd1d8533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:36.542565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 105/215] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:36.580774 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ed958-d96d-4cae-b13d-fef21d4cca39 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:36.594927 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ed958-d96d-4cae-b13d-fef21d4cca39 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:36.600455 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b2b65-ebb7-438d-b037-f7ff4da6d5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:36.601493 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b2b65-ebb7-438d-b037-f7ff4da6d5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:36.601977 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b2b65-ebb7-438d-b037-f7ff4da6d5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:36.602528 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b2b65-ebb7-438d-b037-f7ff4da6d5d2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:36.616601 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b2b65-ebb7-438d-b037-f7ff4da6d5d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:36.624034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-b67b2b65-ebb7-438d-b037-f7ff4da6d5d2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:36.625446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 111/216] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:36.633279 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e8021-f8ef-4be8-b64f-3e65bd1d8533 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:36.643125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e8021-f8ef-4be8-b64f-3e65bd1d8533 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:36.655038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b410c-ce00-477a-ab47-aab0297a2926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:36.656759 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b410c-ce00-477a-ab47-aab0297a2926 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:36.657244 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b410c-ce00-477a-ab47-aab0297a2926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:36.657717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b410c-ce00-477a-ab47-aab0297a2926 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:36.658702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b410c-ce00-477a-ab47-aab0297a2926 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:36.659228 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b410c-ce00-477a-ab47-aab0297a2926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:36.661715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b410c-ce00-477a-ab47-aab0297a2926 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:36.675848 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 106/217] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:36 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:36.682133 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b2b65-ebb7-438d-b037-f7ff4da6d5d2 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:36.693066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b2b65-ebb7-438d-b037-f7ff4da6d5d2 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:36.697868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd656da-24ff-4807-b4da-ae8c6a8308d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:36.699004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd656da-24ff-4807-b4da-ae8c6a8308d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:36.699488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd656da-24ff-4807-b4da-ae8c6a8308d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:36.699977 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd656da-24ff-4807-b4da-ae8c6a8308d9 admin admin] PATH_INFO: `/v3/users/42d5ad4a80f84d0fb97ac588a47759bf` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:36.701382 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd656da-24ff-4807-b4da-ae8c6a8308d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=42d5ad4a80f84d0fb97ac588a47759bf)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:36.703894 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd656da-24ff-4807-b4da-ae8c6a8308d9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:36.705733 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 112/218] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:36 2021] GET /identity/v3/users/42d5ad4a80f84d0fb97ac588a47759bf => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:36.712492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b410c-ce00-477a-ab47-aab0297a2926 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:36.723731 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b410c-ce00-477a-ab47-aab0297a2926 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:36.728631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c226e0-2f3c-414c-be1b-47627277b661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:36.729642 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c226e0-2f3c-414c-be1b-47627277b661 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:36.730129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c226e0-2f3c-414c-be1b-47627277b661 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:36.730603 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c226e0-2f3c-414c-be1b-47627277b661 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:36.742953 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c226e0-2f3c-414c-be1b-47627277b661 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:36.745073 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c226e0-2f3c-414c-be1b-47627277b661 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:36.758682 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 107/219] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:36.764516 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd656da-24ff-4807-b4da-ae8c6a8308d9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:36.776087 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd656da-24ff-4807-b4da-ae8c6a8308d9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:36.781005 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3424c-6270-4b4d-aa12-40027e9492d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:36.782174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3424c-6270-4b4d-aa12-40027e9492d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:36.782654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3424c-6270-4b4d-aa12-40027e9492d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:36.783148 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3424c-6270-4b4d-aa12-40027e9492d5 admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:36.784557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3424c-6270-4b4d-aa12-40027e9492d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:36.787783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3424c-6270-4b4d-aa12-40027e9492d5 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:36.789701 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 113/220] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:36 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:36.796455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c226e0-2f3c-414c-be1b-47627277b661 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:36.806304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c226e0-2f3c-414c-be1b-47627277b661 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:36.813115 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6dff-728e-42ed-a66a-b978fbb0a48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:36.814106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6dff-728e-42ed-a66a-b978fbb0a48e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:36.814593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6dff-728e-42ed-a66a-b978fbb0a48e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:36.815097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6dff-728e-42ed-a66a-b978fbb0a48e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:36.816165 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a6dff-728e-42ed-a66a-b978fbb0a48e admin admin] RBAC: Adding query filter params (role.id=e338c12e36c04cffba27cfe873d606aa, scope.project.id=dc0ea87d14e741a29f7ed0df7614186c, user.id=42d5ad4a80f84d0fb97ac588a47759bf) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:36.817487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a6dff-728e-42ed-a66a-b978fbb0a48e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:36.819616 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a6dff-728e-42ed-a66a-b978fbb0a48e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:36.826490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 108/221] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:36 2021] GET /identity/v3/role_assignments?user.id=42d5ad4a80f84d0fb97ac588a47759bf&scope.project.id=dc0ea87d14e741a29f7ed0df7614186c&role.id=e338c12e36c04cffba27cfe873d606aa => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:37.377262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c13ed-4967-487f-927e-1c735b7354f8 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:37.378049 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c13ed-4967-487f-927e-1c735b7354f8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:37.378558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c13ed-4967-487f-927e-1c735b7354f8 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:37.381445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 114/222] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:37.390357 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906fdfd-4f7c-4c67-8179-f47d71a6982a None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:37.390978 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906fdfd-4f7c-4c67-8179-f47d71a6982a None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:37.391461 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906fdfd-4f7c-4c67-8179-f47d71a6982a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:37.414984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-9906fdfd-4f7c-4c67-8179-f47d71a6982a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:37.416605 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9906fdfd-4f7c-4c67-8179-f47d71a6982a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:37.427291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 109/223] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:37.468384 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c13ed-4967-487f-927e-1c735b7354f8 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:37.483794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c13ed-4967-487f-927e-1c735b7354f8 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:37.489166 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd476f-0497-47d9-b183-0f6f4668c3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:37.490220 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd476f-0497-47d9-b183-0f6f4668c3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:37.490717 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd476f-0497-47d9-b183-0f6f4668c3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:37.491218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd476f-0497-47d9-b183-0f6f4668c3e7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:37.512835 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd476f-0497-47d9-b183-0f6f4668c3e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:37.520875 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-dfbd476f-0497-47d9-b183-0f6f4668c3e7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:37.522389 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 115/224] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:37.529210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906fdfd-4f7c-4c67-8179-f47d71a6982a None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:37.539745 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906fdfd-4f7c-4c67-8179-f47d71a6982a None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:37.544531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6880c-80ee-4e44-9d53-6f3d054e288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:37.545465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6880c-80ee-4e44-9d53-6f3d054e288d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:37.545945 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6880c-80ee-4e44-9d53-6f3d054e288d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:37.546468 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6880c-80ee-4e44-9d53-6f3d054e288d admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:37.551784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6880c-80ee-4e44-9d53-6f3d054e288d admin admin] RBAC: Adding query filter params (name=member) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:37.552382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6880c-80ee-4e44-9d53-6f3d054e288d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:37.554321 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6880c-80ee-4e44-9d53-6f3d054e288d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:37.564023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 110/225] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:37.571440 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd476f-0497-47d9-b183-0f6f4668c3e7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:37.581767 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd476f-0497-47d9-b183-0f6f4668c3e7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:37.590622 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e5f54-8861-4ef1-9d58-af8e61d71508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:37.591675 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e5f54-8861-4ef1-9d58-af8e61d71508 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:37.592163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e5f54-8861-4ef1-9d58-af8e61d71508 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:37.592641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e5f54-8861-4ef1-9d58-af8e61d71508 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:37.603275 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e5f54-8861-4ef1-9d58-af8e61d71508 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:37.605375 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e5f54-8861-4ef1-9d58-af8e61d71508 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:37.615813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 116/226] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:37.622576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6880c-80ee-4e44-9d53-6f3d054e288d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:37.633803 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6880c-80ee-4e44-9d53-6f3d054e288d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:37.638624 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4ca25-af4d-46f2-bb13-af23c7b3731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:37.639811 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4ca25-af4d-46f2-bb13-af23c7b3731e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:37.640316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4ca25-af4d-46f2-bb13-af23c7b3731e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:37.640784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4ca25-af4d-46f2-bb13-af23c7b3731e admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:37.642186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4ca25-af4d-46f2-bb13-af23c7b3731e admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:37.648737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4ca25-af4d-46f2-bb13-af23c7b3731e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:37.650913 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 111/227] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:37 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:37.657543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e5f54-8861-4ef1-9d58-af8e61d71508 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:37.667285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e5f54-8861-4ef1-9d58-af8e61d71508 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:37.672196 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00714c63-40aa-4ce6-9d2b-7ff9bf09fd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:37.673319 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00714c63-40aa-4ce6-9d2b-7ff9bf09fd1c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:37.673840 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00714c63-40aa-4ce6-9d2b-7ff9bf09fd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:37.674332 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00714c63-40aa-4ce6-9d2b-7ff9bf09fd1c admin admin] PATH_INFO: `/v3/groups/8e14738e36d54ec99b0c527589518646` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:37.682950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00714c63-40aa-4ce6-9d2b-7ff9bf09fd1c admin admin] RBAC: Authorizing `identity:get_group(group_id=8e14738e36d54ec99b0c527589518646)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:37.684262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-00714c63-40aa-4ce6-9d2b-7ff9bf09fd1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:37.684262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:19:37.684262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:19:37.685824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00714c63-40aa-4ce6-9d2b-7ff9bf09fd1c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:37.688141 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 117/228] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:37 2021] GET /identity/v3/groups/8e14738e36d54ec99b0c527589518646 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:37.695769 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4ca25-af4d-46f2-bb13-af23c7b3731e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:37.706881 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4ca25-af4d-46f2-bb13-af23c7b3731e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:37.712657 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94384bf-7a86-404c-8035-250b0cc75fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:37.713700 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94384bf-7a86-404c-8035-250b0cc75fef admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:37.714189 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94384bf-7a86-404c-8035-250b0cc75fef admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:37.714668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94384bf-7a86-404c-8035-250b0cc75fef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:37.719241 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94384bf-7a86-404c-8035-250b0cc75fef admin admin] RBAC: Adding query filter params (group.id=8e14738e36d54ec99b0c527589518646, role.id=e338c12e36c04cffba27cfe873d606aa, scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:37.719885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94384bf-7a86-404c-8035-250b0cc75fef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:37.722429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94384bf-7a86-404c-8035-250b0cc75fef admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:37.729644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 112/229] 10.222.0.50 () {56 vars in 1397 bytes} [Tue Nov 16 00:19:37 2021] GET /identity/v3/role_assignments?group.id=8e14738e36d54ec99b0c527589518646&scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea&role.id=e338c12e36c04cffba27cfe873d606aa => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:37.913264 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf06216-8b01-465b-ae83-a5b27a0395e9 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:37.913919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf06216-8b01-465b-ae83-a5b27a0395e9 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:37.914407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf06216-8b01-465b-ae83-a5b27a0395e9 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:37.916588 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 118/230] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:37.930335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352c5ca-f95c-41d5-bd42-84b313d64552 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:37.930630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352c5ca-f95c-41d5-bd42-84b313d64552 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:37.930955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352c5ca-f95c-41d5-bd42-84b313d64552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:37.964217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-e352c5ca-f95c-41d5-bd42-84b313d64552 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:37.965457 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e352c5ca-f95c-41d5-bd42-84b313d64552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:37.975505 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 113/231] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:38.009392 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf06216-8b01-465b-ae83-a5b27a0395e9 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:38.024878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf06216-8b01-465b-ae83-a5b27a0395e9 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:38.029351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae2ec1-dc13-40a2-b7c3-b1c85084b96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:38.030130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae2ec1-dc13-40a2-b7c3-b1c85084b96c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.030421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae2ec1-dc13-40a2-b7c3-b1c85084b96c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.030700 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae2ec1-dc13-40a2-b7c3-b1c85084b96c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.044521 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae2ec1-dc13-40a2-b7c3-b1c85084b96c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:38.052404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-6dae2ec1-dc13-40a2-b7c3-b1c85084b96c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:19:38.053806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 119/232] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:19:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:38.060600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352c5ca-f95c-41d5-bd42-84b313d64552 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:38.070780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352c5ca-f95c-41d5-bd42-84b313d64552 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:38.079523 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ffac2-cef0-4432-aaec-336201d6f859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:38.080219 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ffac2-cef0-4432-aaec-336201d6f859 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.080506 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ffac2-cef0-4432-aaec-336201d6f859 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.080781 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ffac2-cef0-4432-aaec-336201d6f859 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.081556 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ffac2-cef0-4432-aaec-336201d6f859 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:38.081916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ffac2-cef0-4432-aaec-336201d6f859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:38.083737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ffac2-cef0-4432-aaec-336201d6f859 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:38.099340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 114/233] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:38.105483 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae2ec1-dc13-40a2-b7c3-b1c85084b96c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:38.151189 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adcc78-0542-4553-9b44-b94f64820d1d None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.151506 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adcc78-0542-4553-9b44-b94f64820d1d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.151758 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adcc78-0542-4553-9b44-b94f64820d1d None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.153961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 115/234] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:38.161893 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604665-d1e8-45f8-a9a4-013888f98d3f None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.162211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604665-d1e8-45f8-a9a4-013888f98d3f None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.162458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604665-d1e8-45f8-a9a4-013888f98d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.208170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c3604665-d1e8-45f8-a9a4-013888f98d3f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:38.209336 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c3604665-d1e8-45f8-a9a4-013888f98d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:38.239771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 116/235] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:38.255152 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae2ec1-dc13-40a2-b7c3-b1c85084b96c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:38.262693 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702c238-fce6-423d-a0d3-1724f7ef8da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:38.263609 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702c238-fce6-423d-a0d3-1724f7ef8da9 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.263889 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702c238-fce6-423d-a0d3-1724f7ef8da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.264159 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702c238-fce6-423d-a0d3-1724f7ef8da9 admin admin] PATH_INFO: `/v3/users/9ebf9643a2de4a8a9500c2ccce871c70` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.265350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702c238-fce6-423d-a0d3-1724f7ef8da9 admin admin] RBAC: Authorizing `identity:get_user(user_id=9ebf9643a2de4a8a9500c2ccce871c70)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:38.267210 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702c238-fce6-423d-a0d3-1724f7ef8da9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:38.268813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 120/236] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:38 2021] GET /identity/v3/users/9ebf9643a2de4a8a9500c2ccce871c70 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:38.275274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3604665-d1e8-45f8-a9a4-013888f98d3f None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:38.287674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3604665-d1e8-45f8-a9a4-013888f98d3f None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:38.293962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9427a07-6525-4877-89a0-754a0a9c918c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:38.294420 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702c238-fce6-423d-a0d3-1724f7ef8da9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:38.294649 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9427a07-6525-4877-89a0-754a0a9c918c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.294909 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9427a07-6525-4877-89a0-754a0a9c918c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.295191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9427a07-6525-4877-89a0-754a0a9c918c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.308446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702c238-fce6-423d-a0d3-1724f7ef8da9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:38.310378 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9427a07-6525-4877-89a0-754a0a9c918c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:38.312176 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9427a07-6525-4877-89a0-754a0a9c918c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:38.318665 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82a85-2334-4d27-833d-631e740fbff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:38.319499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82a85-2334-4d27-833d-631e740fbff7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.319779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82a85-2334-4d27-833d-631e740fbff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.320608 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82a85-2334-4d27-833d-631e740fbff7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.324297 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 117/237] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:38.330713 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9427a07-6525-4877-89a0-754a0a9c918c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:38.339443 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b82a85-2334-4d27-833d-631e740fbff7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:38.343711 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9427a07-6525-4877-89a0-754a0a9c918c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:38.348674 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-92b82a85-2334-4d27-833d-631e740fbff7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 00:19:38.350816 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 121/238] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:19:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:38.351915 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c2b1c-8991-4798-ace9-8364b2158890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:38.352769 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c2b1c-8991-4798-ace9-8364b2158890 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.353057 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c2b1c-8991-4798-ace9-8364b2158890 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.353336 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c2b1c-8991-4798-ace9-8364b2158890 admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.356523 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82a85-2334-4d27-833d-631e740fbff7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:38.357311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c2b1c-8991-4798-ace9-8364b2158890 admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:38.359480 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c2b1c-8991-4798-ace9-8364b2158890 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:38.361183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 118/239] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:38 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:38.368512 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c2b1c-8991-4798-ace9-8364b2158890 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:38.372210 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82a85-2334-4d27-833d-631e740fbff7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:38.382813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a0c2c-aaa2-4788-a26a-b8e57de33ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:38.384075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a0c2c-aaa2-4788-a26a-b8e57de33ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.384501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a0c2c-aaa2-4788-a26a-b8e57de33ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.384915 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a0c2c-aaa2-4788-a26a-b8e57de33ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.385669 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a0c2c-aaa2-4788-a26a-b8e57de33ca9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:38.385975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a0c2c-aaa2-4788-a26a-b8e57de33ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:38.386695 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c2b1c-8991-4798-ace9-8364b2158890 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:38.387722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a0c2c-aaa2-4788-a26a-b8e57de33ca9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:38.396902 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e90711-051d-4d96-a176-ac433b56632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:38.397565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e90711-051d-4d96-a176-ac433b56632b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.397852 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e90711-051d-4d96-a176-ac433b56632b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.398131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e90711-051d-4d96-a176-ac433b56632b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.398957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 122/240] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:38.399132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e90711-051d-4d96-a176-ac433b56632b admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=dc0ea87d14e741a29f7ed0df7614186c, user.id=9ebf9643a2de4a8a9500c2ccce871c70) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:38.399293 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e90711-051d-4d96-a176-ac433b56632b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:38.401129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e90711-051d-4d96-a176-ac433b56632b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:38.408019 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a0c2c-aaa2-4788-a26a-b8e57de33ca9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:38.412521 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 119/241] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:38 2021] GET /identity/v3/role_assignments?user.id=9ebf9643a2de4a8a9500c2ccce871c70&scope.project.id=dc0ea87d14e741a29f7ed0df7614186c&role.id=2813231cc8954b998440e4bf5ede2945 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:38.423982 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a0c2c-aaa2-4788-a26a-b8e57de33ca9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:38.432926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff339c9-2ee9-4378-865a-bca81900df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:38.433810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff339c9-2ee9-4378-865a-bca81900df47 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.434103 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff339c9-2ee9-4378-865a-bca81900df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.434378 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff339c9-2ee9-4378-865a-bca81900df47 admin admin] PATH_INFO: `/v3/users/42d5ad4a80f84d0fb97ac588a47759bf` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.435635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff339c9-2ee9-4378-865a-bca81900df47 admin admin] RBAC: Authorizing `identity:get_user(user_id=42d5ad4a80f84d0fb97ac588a47759bf)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:38.437794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff339c9-2ee9-4378-865a-bca81900df47 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:38.439480 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 123/242] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:19:38 2021] GET /identity/v3/users/42d5ad4a80f84d0fb97ac588a47759bf => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:38.446383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e90711-051d-4d96-a176-ac433b56632b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:38.461585 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e90711-051d-4d96-a176-ac433b56632b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:38.475582 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e814a-4a56-4d6e-b1ae-86c86fee7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:38.476258 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e814a-4a56-4d6e-b1ae-86c86fee7403 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.476551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e814a-4a56-4d6e-b1ae-86c86fee7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.476837 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e814a-4a56-4d6e-b1ae-86c86fee7403 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.491477 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e814a-4a56-4d6e-b1ae-86c86fee7403 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:38.493259 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e814a-4a56-4d6e-b1ae-86c86fee7403 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:38.509978 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 120/243] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:38.516916 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff339c9-2ee9-4378-865a-bca81900df47 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:38.532095 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff339c9-2ee9-4378-865a-bca81900df47 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:38.542896 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e3456-5148-403c-9b02-c2af75b543bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:38.543779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3456-5148-403c-9b02-c2af75b543bd admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.544062 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3456-5148-403c-9b02-c2af75b543bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.544342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3456-5148-403c-9b02-c2af75b543bd admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.545553 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e3456-5148-403c-9b02-c2af75b543bd admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:38.547644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e3456-5148-403c-9b02-c2af75b543bd admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:38.549341 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 124/244] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:38 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:38.556853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e814a-4a56-4d6e-b1ae-86c86fee7403 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:38.572193 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e814a-4a56-4d6e-b1ae-86c86fee7403 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:38.582477 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194882b3-7cac-4c1c-ae21-ab853ab39403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:38.583180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194882b3-7cac-4c1c-ae21-ab853ab39403 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.583626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194882b3-7cac-4c1c-ae21-ab853ab39403 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.583912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194882b3-7cac-4c1c-ae21-ab853ab39403 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.584774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194882b3-7cac-4c1c-ae21-ab853ab39403 admin admin] RBAC: Adding query filter params (role.id=5f5b315594d34a0da8fd0e1cc476318e, scope.project.id=dc0ea87d14e741a29f7ed0df7614186c, user.id=42d5ad4a80f84d0fb97ac588a47759bf) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:38.585088 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194882b3-7cac-4c1c-ae21-ab853ab39403 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:38.586986 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194882b3-7cac-4c1c-ae21-ab853ab39403 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:38.595639 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 121/245] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:38 2021] GET /identity/v3/role_assignments?user.id=42d5ad4a80f84d0fb97ac588a47759bf&scope.project.id=dc0ea87d14e741a29f7ed0df7614186c&role.id=5f5b315594d34a0da8fd0e1cc476318e => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:38.953963 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8169c8-20b9-4938-bb79-729501ce97b8 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.954272 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8169c8-20b9-4938-bb79-729501ce97b8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.954514 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8169c8-20b9-4938-bb79-729501ce97b8 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.956349 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 125/246] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:38.965011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b35ef-fa3c-4a43-936f-c9fa3b21def3 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:38.965293 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b35ef-fa3c-4a43-936f-c9fa3b21def3 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:38.965568 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b35ef-fa3c-4a43-936f-c9fa3b21def3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:38.993296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-5b4b35ef-fa3c-4a43-936f-c9fa3b21def3 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:38.994499 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-5b4b35ef-fa3c-4a43-936f-c9fa3b21def3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:39.007267 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 122/247] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:39.044755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8169c8-20b9-4938-bb79-729501ce97b8 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:39.061283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8169c8-20b9-4938-bb79-729501ce97b8 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:39.067201 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb2489-d0db-4776-9244-7ea3c327b513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:39.068018 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb2489-d0db-4776-9244-7ea3c327b513 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:39.068298 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb2489-d0db-4776-9244-7ea3c327b513 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:39.068573 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb2489-d0db-4776-9244-7ea3c327b513 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:39.080859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb2489-d0db-4776-9244-7ea3c327b513 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:39.088590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-d1bb2489-d0db-4776-9244-7ea3c327b513 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 00:19:39.089863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 126/248] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:19:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:39.096441 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b35ef-fa3c-4a43-936f-c9fa3b21def3 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:39.112155 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b35ef-fa3c-4a43-936f-c9fa3b21def3 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:39.118991 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6aad8a-6bfd-499f-b6a8-6c0a828c84ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:39.119675 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aad8a-6bfd-499f-b6a8-6c0a828c84ec admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:39.119940 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aad8a-6bfd-499f-b6a8-6c0a828c84ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:39.120226 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aad8a-6bfd-499f-b6a8-6c0a828c84ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:39.120989 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6aad8a-6bfd-499f-b6a8-6c0a828c84ec admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:39.121297 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6aad8a-6bfd-499f-b6a8-6c0a828c84ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:39.122922 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6aad8a-6bfd-499f-b6a8-6c0a828c84ec admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:39.138746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 123/249] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:39.145239 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb2489-d0db-4776-9244-7ea3c327b513 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:39.160979 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb2489-d0db-4776-9244-7ea3c327b513 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:39.170466 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64db51-7bec-43b2-ab0b-6d75691af1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:39.171161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64db51-7bec-43b2-ab0b-6d75691af1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:39.171445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64db51-7bec-43b2-ab0b-6d75691af1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:39.171722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64db51-7bec-43b2-ab0b-6d75691af1c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:39.181361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64db51-7bec-43b2-ab0b-6d75691af1c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:39.183130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64db51-7bec-43b2-ab0b-6d75691af1c0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:39.193951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 127/250] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:39.199777 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6aad8a-6bfd-499f-b6a8-6c0a828c84ec admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:39.212564 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6aad8a-6bfd-499f-b6a8-6c0a828c84ec admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:39.223735 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a879b-1225-48a1-8732-69e9c7a887b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:39.224605 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a879b-1225-48a1-8732-69e9c7a887b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:39.224889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a879b-1225-48a1-8732-69e9c7a887b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:39.225169 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a879b-1225-48a1-8732-69e9c7a887b5 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:39.227079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a879b-1225-48a1-8732-69e9c7a887b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:39.229141 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a879b-1225-48a1-8732-69e9c7a887b5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:39.231064 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 124/251] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:39 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:39.237022 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64db51-7bec-43b2-ab0b-6d75691af1c0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:39.247799 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64db51-7bec-43b2-ab0b-6d75691af1c0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:39.254457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c2ed7-fbec-4f7d-b823-28c9da15b2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:39.255348 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c2ed7-fbec-4f7d-b823-28c9da15b2ef admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:39.255630 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c2ed7-fbec-4f7d-b823-28c9da15b2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:39.255904 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c2ed7-fbec-4f7d-b823-28c9da15b2ef admin admin] PATH_INFO: `/v3/groups/8e14738e36d54ec99b0c527589518646` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:39.257085 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c2ed7-fbec-4f7d-b823-28c9da15b2ef admin admin] RBAC: Authorizing `identity:get_group(group_id=8e14738e36d54ec99b0c527589518646)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:39.259031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c2ed7-fbec-4f7d-b823-28c9da15b2ef admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:39.265972 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 128/252] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:39 2021] GET /identity/v3/groups/8e14738e36d54ec99b0c527589518646 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:39.266947 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a879b-1225-48a1-8732-69e9c7a887b5 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:39.279601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a879b-1225-48a1-8732-69e9c7a887b5 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:39.288889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20256a-1c74-489f-bcc6-45794efd5a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:39.289559 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20256a-1c74-489f-bcc6-45794efd5a90 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:39.289846 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20256a-1c74-489f-bcc6-45794efd5a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:39.290203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20256a-1c74-489f-bcc6-45794efd5a90 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:39.291074 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20256a-1c74-489f-bcc6-45794efd5a90 admin admin] RBAC: Adding query filter params (group.id=8e14738e36d54ec99b0c527589518646, role.id=5f5b315594d34a0da8fd0e1cc476318e, scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:39.291393 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20256a-1c74-489f-bcc6-45794efd5a90 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:39.293329 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20256a-1c74-489f-bcc6-45794efd5a90 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:39.303791 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 125/253] 10.222.0.50 () {56 vars in 1397 bytes} [Tue Nov 16 00:19:39 2021] GET /identity/v3/role_assignments?group.id=8e14738e36d54ec99b0c527589518646&scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea&role.id=5f5b315594d34a0da8fd0e1cc476318e => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:39.723628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afede9c9-8a64-48a8-8324-e83926011a40 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:39.724318 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afede9c9-8a64-48a8-8324-e83926011a40 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:39.724318 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afede9c9-8a64-48a8-8324-e83926011a40 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:39.726109 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 129/254] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:39.734741 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb05337-6849-4b9e-8e79-02199fafd75d None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:39.735395 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb05337-6849-4b9e-8e79-02199fafd75d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:39.735395 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb05337-6849-4b9e-8e79-02199fafd75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:39.755521 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-dfb05337-6849-4b9e-8e79-02199fafd75d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:39.756752 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-dfb05337-6849-4b9e-8e79-02199fafd75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:39.764867 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 126/255] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:39.791494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afede9c9-8a64-48a8-8324-e83926011a40 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:39.808827 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afede9c9-8a64-48a8-8324-e83926011a40 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:39.813162 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afea91-25cd-496a-b8b2-7cf6346cf5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:39.813953 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afea91-25cd-496a-b8b2-7cf6346cf5ea admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:39.814238 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afea91-25cd-496a-b8b2-7cf6346cf5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:39.814512 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afea91-25cd-496a-b8b2-7cf6346cf5ea admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:39.834332 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afea91-25cd-496a-b8b2-7cf6346cf5ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:39.841132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-60afea91-25cd-496a-b8b2-7cf6346cf5ea admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:39.842354 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 130/256] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:39.849419 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb05337-6849-4b9e-8e79-02199fafd75d None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:39.858592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb05337-6849-4b9e-8e79-02199fafd75d None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:39.867115 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f540a4-047d-4647-a14c-e3ec299f2916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:39.867816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f540a4-047d-4647-a14c-e3ec299f2916 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:39.868098 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f540a4-047d-4647-a14c-e3ec299f2916 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:39.868371 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f540a4-047d-4647-a14c-e3ec299f2916 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:39.869130 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f540a4-047d-4647-a14c-e3ec299f2916 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:39.869435 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f540a4-047d-4647-a14c-e3ec299f2916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:39.871069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f540a4-047d-4647-a14c-e3ec299f2916 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:39.880475 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 127/257] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:39.886707 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afea91-25cd-496a-b8b2-7cf6346cf5ea admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:39.900446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afea91-25cd-496a-b8b2-7cf6346cf5ea admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:39.904889 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a50756-002e-4376-8733-62efc4091061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:39.905533 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50756-002e-4376-8733-62efc4091061 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:39.905814 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50756-002e-4376-8733-62efc4091061 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:39.906090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50756-002e-4376-8733-62efc4091061 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:39.916728 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a50756-002e-4376-8733-62efc4091061 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:39.918509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a50756-002e-4376-8733-62efc4091061 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:39.937608 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 131/258] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:39.944528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f540a4-047d-4647-a14c-e3ec299f2916 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:39.960320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f540a4-047d-4647-a14c-e3ec299f2916 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:39.964721 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918b2a7-c982-446f-b382-b521d7482520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:39.965577 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918b2a7-c982-446f-b382-b521d7482520 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:39.965856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918b2a7-c982-446f-b382-b521d7482520 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:39.966129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918b2a7-c982-446f-b382-b521d7482520 admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:39.967348 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918b2a7-c982-446f-b382-b521d7482520 admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:39.969398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918b2a7-c982-446f-b382-b521d7482520 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:39.971211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 128/259] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:39 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:39.988955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a50756-002e-4376-8733-62efc4091061 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:39.999831 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a50756-002e-4376-8733-62efc4091061 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:40.004367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1353c-778f-40f4-9931-d895d7fb4f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:40.005276 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1353c-778f-40f4-9931-d895d7fb4f32 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:40.005557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1353c-778f-40f4-9931-d895d7fb4f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:40.005833 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1353c-778f-40f4-9931-d895d7fb4f32 admin admin] PATH_INFO: `/v3/groups/8e14738e36d54ec99b0c527589518646` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:40.007044 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1353c-778f-40f4-9931-d895d7fb4f32 admin admin] RBAC: Authorizing `identity:get_group(group_id=8e14738e36d54ec99b0c527589518646)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:40.008946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1353c-778f-40f4-9931-d895d7fb4f32 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:40.010651 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 132/260] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:39 2021] GET /identity/v3/groups/8e14738e36d54ec99b0c527589518646 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:40.017037 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918b2a7-c982-446f-b382-b521d7482520 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:40.027110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918b2a7-c982-446f-b382-b521d7482520 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:40.031537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693212fb-9bc6-4d85-b8e8-76d5a4a3bf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:40.032188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693212fb-9bc6-4d85-b8e8-76d5a4a3bf87 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:40.032507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693212fb-9bc6-4d85-b8e8-76d5a4a3bf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:40.032744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693212fb-9bc6-4d85-b8e8-76d5a4a3bf87 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:40.033534 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693212fb-9bc6-4d85-b8e8-76d5a4a3bf87 admin admin] RBAC: Adding query filter params (group.id=8e14738e36d54ec99b0c527589518646, role.id=e338c12e36c04cffba27cfe873d606aa, scope.project.id=dc0ea87d14e741a29f7ed0df7614186c) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:40.033847 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693212fb-9bc6-4d85-b8e8-76d5a4a3bf87 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:40.036845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693212fb-9bc6-4d85-b8e8-76d5a4a3bf87 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:40.045435 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 129/261] 10.222.0.50 () {56 vars in 1397 bytes} [Tue Nov 16 00:19:40 2021] GET /identity/v3/role_assignments?group.id=8e14738e36d54ec99b0c527589518646&scope.project.id=dc0ea87d14e741a29f7ed0df7614186c&role.id=e338c12e36c04cffba27cfe873d606aa => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:40.168130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c716a-ec63-4221-9171-d99af54ba3fe None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:40.168443 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c716a-ec63-4221-9171-d99af54ba3fe None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:40.168682 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c716a-ec63-4221-9171-d99af54ba3fe None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:40.170634 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 133/262] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:40.179662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4a195-1af2-4175-b40f-9cccb3db486b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:40.179961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4a195-1af2-4175-b40f-9cccb3db486b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:40.180210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4a195-1af2-4175-b40f-9cccb3db486b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:40.205197 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-98c4a195-1af2-4175-b40f-9cccb3db486b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:40.206414 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-98c4a195-1af2-4175-b40f-9cccb3db486b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:40.221080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 130/263] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:40.259406 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c716a-ec63-4221-9171-d99af54ba3fe None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:40.277081 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c716a-ec63-4221-9171-d99af54ba3fe None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:40.287224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd6cfe-62d4-488e-875d-8890e6d4f2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:40.288041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd6cfe-62d4-488e-875d-8890e6d4f2db admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:40.288323 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd6cfe-62d4-488e-875d-8890e6d4f2db admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:40.288598 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd6cfe-62d4-488e-875d-8890e6d4f2db admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:40.299561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd6cfe-62d4-488e-875d-8890e6d4f2db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:40.307204 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-65cd6cfe-62d4-488e-875d-8890e6d4f2db admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 00:19:40.313847 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 134/264] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:19:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:40.314751 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4a195-1af2-4175-b40f-9cccb3db486b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:40.331557 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4a195-1af2-4175-b40f-9cccb3db486b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:40.341236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd73ac4-336c-430a-920a-8a264a7ef13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:40.341915 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd73ac4-336c-430a-920a-8a264a7ef13d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:40.342196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd73ac4-336c-430a-920a-8a264a7ef13d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:40.342468 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd73ac4-336c-430a-920a-8a264a7ef13d admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:40.343260 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd73ac4-336c-430a-920a-8a264a7ef13d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:40.343565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd73ac4-336c-430a-920a-8a264a7ef13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:40.345188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd73ac4-336c-430a-920a-8a264a7ef13d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:40.357546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 131/265] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:40.364381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd6cfe-62d4-488e-875d-8890e6d4f2db admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:40.375973 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd6cfe-62d4-488e-875d-8890e6d4f2db admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:40.380591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6887fa-9b24-4440-93dc-94f8393cf354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:40.381238 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6887fa-9b24-4440-93dc-94f8393cf354 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:40.381522 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6887fa-9b24-4440-93dc-94f8393cf354 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:40.381804 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6887fa-9b24-4440-93dc-94f8393cf354 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:40.393321 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6887fa-9b24-4440-93dc-94f8393cf354 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:40.395750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6887fa-9b24-4440-93dc-94f8393cf354 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:40.405027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 135/266] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:40.413023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd73ac4-336c-430a-920a-8a264a7ef13d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:40.423002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd73ac4-336c-430a-920a-8a264a7ef13d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:40.429881 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187180a1-e73e-4a0f-9417-d059638c935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:40.430740 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187180a1-e73e-4a0f-9417-d059638c935a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:40.431051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187180a1-e73e-4a0f-9417-d059638c935a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:40.431328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187180a1-e73e-4a0f-9417-d059638c935a admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:40.432527 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187180a1-e73e-4a0f-9417-d059638c935a admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:40.434599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187180a1-e73e-4a0f-9417-d059638c935a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:40.436320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 132/267] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:40 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:40.442743 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6887fa-9b24-4440-93dc-94f8393cf354 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:40.451964 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6887fa-9b24-4440-93dc-94f8393cf354 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:40.462378 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96846c-78d7-4ce2-b622-a415643e6ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:40.463277 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96846c-78d7-4ce2-b622-a415643e6ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:40.463559 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96846c-78d7-4ce2-b622-a415643e6ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:40.463834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96846c-78d7-4ce2-b622-a415643e6ec2 admin admin] PATH_INFO: `/v3/groups/8e14738e36d54ec99b0c527589518646` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:40.465027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96846c-78d7-4ce2-b622-a415643e6ec2 admin admin] RBAC: Authorizing `identity:get_group(group_id=8e14738e36d54ec99b0c527589518646)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:40.466955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96846c-78d7-4ce2-b622-a415643e6ec2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:40.468906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 136/268] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:40 2021] GET /identity/v3/groups/8e14738e36d54ec99b0c527589518646 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:40.476560 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187180a1-e73e-4a0f-9417-d059638c935a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:40.495035 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187180a1-e73e-4a0f-9417-d059638c935a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:40.507035 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadac17-61ae-4ad8-ad54-2270614b00c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:40.507705 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadac17-61ae-4ad8-ad54-2270614b00c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:40.507987 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadac17-61ae-4ad8-ad54-2270614b00c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:40.508264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadac17-61ae-4ad8-ad54-2270614b00c1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:40.509108 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadac17-61ae-4ad8-ad54-2270614b00c1 admin admin] RBAC: Adding query filter params (group.id=8e14738e36d54ec99b0c527589518646, role.id=5f5b315594d34a0da8fd0e1cc476318e, scope.project.id=dc0ea87d14e741a29f7ed0df7614186c) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:40.509475 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadac17-61ae-4ad8-ad54-2270614b00c1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:40.511294 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadac17-61ae-4ad8-ad54-2270614b00c1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:40.523032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 133/269] 10.222.0.50 () {56 vars in 1397 bytes} [Tue Nov 16 00:19:40 2021] GET /identity/v3/role_assignments?group.id=8e14738e36d54ec99b0c527589518646&scope.project.id=dc0ea87d14e741a29f7ed0df7614186c&role.id=5f5b315594d34a0da8fd0e1cc476318e => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:40.852868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d522-7e69-4154-b267-9a54a6c4bb59 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:40.853852 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d522-7e69-4154-b267-9a54a6c4bb59 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:40.854337 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d522-7e69-4154-b267-9a54a6c4bb59 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:40.856604 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 137/270] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:40.865442 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd019b-687d-4c96-bbee-1e314b436e78 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:40.866350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd019b-687d-4c96-bbee-1e314b436e78 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:40.866822 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd019b-687d-4c96-bbee-1e314b436e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:40.893578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-5edd019b-687d-4c96-bbee-1e314b436e78 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:40.895379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-5edd019b-687d-4c96-bbee-1e314b436e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:40.911211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 134/271] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:40.942883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5d522-7e69-4154-b267-9a54a6c4bb59 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:40.962318 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5d522-7e69-4154-b267-9a54a6c4bb59 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:40.974863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1a4e1-2524-4ded-b3a9-9780a061e0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:40.975682 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a4e1-2524-4ded-b3a9-9780a061e0ea admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:40.975972 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a4e1-2524-4ded-b3a9-9780a061e0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:40.976253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a4e1-2524-4ded-b3a9-9780a061e0ea admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:40.991246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1a4e1-2524-4ded-b3a9-9780a061e0ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:40.998273 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-9ba1a4e1-2524-4ded-b3a9-9780a061e0ea admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:19:40.999893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 138/272] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:19:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:41.007257 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd019b-687d-4c96-bbee-1e314b436e78 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:41.016811 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd019b-687d-4c96-bbee-1e314b436e78 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:41.026586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046979a-38f0-4702-83e3-4d62a9882ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:41.027544 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046979a-38f0-4702-83e3-4d62a9882ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:41.028058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046979a-38f0-4702-83e3-4d62a9882ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:41.028539 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046979a-38f0-4702-83e3-4d62a9882ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:41.029509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046979a-38f0-4702-83e3-4d62a9882ae3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:41.030016 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046979a-38f0-4702-83e3-4d62a9882ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:41.031935 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046979a-38f0-4702-83e3-4d62a9882ae3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:41.045635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 135/273] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:41.053608 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1a4e1-2524-4ded-b3a9-9780a061e0ea admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:41.064456 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaf4ce-3a1b-4fe7-8eed-35544af42178 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:41.065043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaf4ce-3a1b-4fe7-8eed-35544af42178 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:41.065239 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1a4e1-2524-4ded-b3a9-9780a061e0ea admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:41.065714 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaf4ce-3a1b-4fe7-8eed-35544af42178 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:41.068674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 136/274] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:41.073864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3634cbe-ae9b-4153-acea-a2bd856cd132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:41.074533 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3634cbe-ae9b-4153-acea-a2bd856cd132 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:41.074881 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3634cbe-ae9b-4153-acea-a2bd856cd132 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:41.075153 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3634cbe-ae9b-4153-acea-a2bd856cd132 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:41.076534 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a61f-6b96-4828-aca5-a5ba3aface57 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:41.077067 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a61f-6b96-4828-aca5-a5ba3aface57 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:41.077545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a61f-6b96-4828-aca5-a5ba3aface57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:41.087807 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3634cbe-ae9b-4153-acea-a2bd856cd132 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:41.090234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3634cbe-ae9b-4153-acea-a2bd856cd132 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:41.106595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 139/275] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:41.109296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-0b24a61f-6b96-4828-aca5-a5ba3aface57 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:41.110503 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0b24a61f-6b96-4828-aca5-a5ba3aface57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:41.114135 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3634cbe-ae9b-4153-acea-a2bd856cd132 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:41.123924 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3634cbe-ae9b-4153-acea-a2bd856cd132 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:41.129971 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 137/276] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:41.131393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529838e3-05aa-4bbb-9752-13dad931984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:41.132312 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529838e3-05aa-4bbb-9752-13dad931984e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:41.132604 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529838e3-05aa-4bbb-9752-13dad931984e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:41.132887 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529838e3-05aa-4bbb-9752-13dad931984e admin admin] PATH_INFO: `/v3/projects/7aec0bf3f5ba404495a1eab25f1fe71c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:41.134277 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529838e3-05aa-4bbb-9752-13dad931984e admin admin] RBAC: Authorizing `identity:get_project(project_id=7aec0bf3f5ba404495a1eab25f1fe71c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:41.136294 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529838e3-05aa-4bbb-9752-13dad931984e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:41.138693 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 140/277] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:41 2021] GET /identity/v3/projects/7aec0bf3f5ba404495a1eab25f1fe71c => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:41.145798 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24a61f-6b96-4828-aca5-a5ba3aface57 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:41.155822 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24a61f-6b96-4828-aca5-a5ba3aface57 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:41.162265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570152-9e37-4df5-95c0-00f75cdefa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:41.163210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570152-9e37-4df5-95c0-00f75cdefa84 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:41.163497 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570152-9e37-4df5-95c0-00f75cdefa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:41.163835 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570152-9e37-4df5-95c0-00f75cdefa84 admin admin] PATH_INFO: `/v3/groups/8791ecc8c9174afe830af51bfb8cab49` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:41.170436 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6570152-9e37-4df5-95c0-00f75cdefa84 admin admin] RBAC: Authorizing `identity:get_group(group_id=8791ecc8c9174afe830af51bfb8cab49)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:41.171561 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-d6570152-9e37-4df5-95c0-00f75cdefa84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:41.171561 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:19:41.171561 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:19:41.172910 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6570152-9e37-4df5-95c0-00f75cdefa84 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:41.174639 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 138/278] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:41 2021] GET /identity/v3/groups/8791ecc8c9174afe830af51bfb8cab49 => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:41.176943 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529838e3-05aa-4bbb-9752-13dad931984e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:41.183754 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570152-9e37-4df5-95c0-00f75cdefa84 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:41.193868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529838e3-05aa-4bbb-9752-13dad931984e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:41.202532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570152-9e37-4df5-95c0-00f75cdefa84 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:41.204588 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfc97e-6568-4c1f-b83f-ba6af8b7a2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:41.205384 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfc97e-6568-4c1f-b83f-ba6af8b7a2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:41.205671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfc97e-6568-4c1f-b83f-ba6af8b7a2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:41.205948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfc97e-6568-4c1f-b83f-ba6af8b7a2f4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:41.215664 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99174f4c-2961-4096-8ce1-2ad9608b65d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:41.216319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99174f4c-2961-4096-8ce1-2ad9608b65d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:41.216607 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99174f4c-2961-4096-8ce1-2ad9608b65d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:41.216888 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99174f4c-2961-4096-8ce1-2ad9608b65d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:41.217726 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99174f4c-2961-4096-8ce1-2ad9608b65d9 admin admin] RBAC: Adding query filter params (group.id=8791ecc8c9174afe830af51bfb8cab49, role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=7aec0bf3f5ba404495a1eab25f1fe71c) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:41.218040 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99174f4c-2961-4096-8ce1-2ad9608b65d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:41.219932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99174f4c-2961-4096-8ce1-2ad9608b65d9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:41.228173 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfc97e-6568-4c1f-b83f-ba6af8b7a2f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:41.235078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-9fbfc97e-6568-4c1f-b83f-ba6af8b7a2f4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:41.243768 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 139/279] 10.222.0.50 () {56 vars in 1397 bytes} [Tue Nov 16 00:19:41 2021] GET /identity/v3/role_assignments?group.id=8791ecc8c9174afe830af51bfb8cab49&scope.project.id=7aec0bf3f5ba404495a1eab25f1fe71c&role.id=2813231cc8954b998440e4bf5ede2945 => generated 260 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:41.245527 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 141/280] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:41.246122 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99174f4c-2961-4096-8ce1-2ad9608b65d9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:41.259822 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99174f4c-2961-4096-8ce1-2ad9608b65d9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:41.264520 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda5e90-15d7-4443-89dd-e984fedea78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:41.265209 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda5e90-15d7-4443-89dd-e984fedea78d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:41.265496 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda5e90-15d7-4443-89dd-e984fedea78d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:41.265775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda5e90-15d7-4443-89dd-e984fedea78d admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:41.266542 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda5e90-15d7-4443-89dd-e984fedea78d admin admin] RBAC: Adding query filter params (name=member) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:41.266899 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda5e90-15d7-4443-89dd-e984fedea78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:41.268579 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda5e90-15d7-4443-89dd-e984fedea78d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:41.278758 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 140/281] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:41.285419 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfc97e-6568-4c1f-b83f-ba6af8b7a2f4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:41.295772 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfc97e-6568-4c1f-b83f-ba6af8b7a2f4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:41.300393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905b8fa-a0ab-4b08-969d-80a1a22a5b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:41.301922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905b8fa-a0ab-4b08-969d-80a1a22a5b77 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:41.302200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905b8fa-a0ab-4b08-969d-80a1a22a5b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:41.302480 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905b8fa-a0ab-4b08-969d-80a1a22a5b77 admin admin] PATH_INFO: `/v3/groups/8e14738e36d54ec99b0c527589518646` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:41.303742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905b8fa-a0ab-4b08-969d-80a1a22a5b77 admin admin] RBAC: Authorizing `identity:get_group(group_id=8e14738e36d54ec99b0c527589518646)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:41.305708 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905b8fa-a0ab-4b08-969d-80a1a22a5b77 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:41.307442 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 142/282] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:41 2021] GET /identity/v3/groups/8e14738e36d54ec99b0c527589518646 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:41.313740 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda5e90-15d7-4443-89dd-e984fedea78d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:41.324244 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda5e90-15d7-4443-89dd-e984fedea78d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:41.328795 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f0d6c-4d60-46cb-92f4-708bd13d4ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:41.329654 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f0d6c-4d60-46cb-92f4-708bd13d4ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:41.329937 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f0d6c-4d60-46cb-92f4-708bd13d4ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:41.330211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f0d6c-4d60-46cb-92f4-708bd13d4ab3 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:41.331450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f0d6c-4d60-46cb-92f4-708bd13d4ab3 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:41.333826 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f0d6c-4d60-46cb-92f4-708bd13d4ab3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:41.335601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 141/283] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:41 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:41.341981 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905b8fa-a0ab-4b08-969d-80a1a22a5b77 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:41.353452 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905b8fa-a0ab-4b08-969d-80a1a22a5b77 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:41.358419 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be5571-fa82-445a-b49a-af494fac833f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:41.359363 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be5571-fa82-445a-b49a-af494fac833f admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:41.359711 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be5571-fa82-445a-b49a-af494fac833f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:41.359996 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be5571-fa82-445a-b49a-af494fac833f admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea/groups/8e14738e36d54ec99b0c527589518646/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:41.362207 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be5571-fa82-445a-b49a-af494fac833f admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3488c6af544a1aa2bc5fdd48f927ea, group_id=8e14738e36d54ec99b0c527589518646, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:41.365785 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be5571-fa82-445a-b49a-af494fac833f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:41.387823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 143/284] 10.222.0.50 () {58 vars in 1463 bytes} [Tue Nov 16 00:19:41 2021] PUT /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea/groups/8e14738e36d54ec99b0c527589518646/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:42.312151 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ea5b6-265f-4151-b1ab-7e8c25bb1c4a None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:42.312925 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ea5b6-265f-4151-b1ab-7e8c25bb1c4a None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:42.312925 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ea5b6-265f-4151-b1ab-7e8c25bb1c4a None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:42.314504 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 142/285] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:42.323734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe184-5fb8-4e92-8c62-e479d4cfca57 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:42.324268 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe184-5fb8-4e92-8c62-e479d4cfca57 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:42.324450 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe184-5fb8-4e92-8c62-e479d4cfca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:42.345215 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-a90fe184-5fb8-4e92-8c62-e479d4cfca57 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:42.346408 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a90fe184-5fb8-4e92-8c62-e479d4cfca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:42.427057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 144/286] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:42.457147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ea5b6-265f-4151-b1ab-7e8c25bb1c4a None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:42.480614 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ea5b6-265f-4151-b1ab-7e8c25bb1c4a None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:42.488521 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e923e-49bf-4126-b9d3-3a513fdb3bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:42.489346 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e923e-49bf-4126-b9d3-3a513fdb3bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:42.489636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e923e-49bf-4126-b9d3-3a513fdb3bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:42.489916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e923e-49bf-4126-b9d3-3a513fdb3bb2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:42.506308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e923e-49bf-4126-b9d3-3a513fdb3bb2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:42.524770 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-5f3e923e-49bf-4126-b9d3-3a513fdb3bb2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 00:19:42.524770 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 143/287] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:19:42 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:42.530867 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fe184-5fb8-4e92-8c62-e479d4cfca57 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:42.543861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fe184-5fb8-4e92-8c62-e479d4cfca57 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:42.556403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bc585-3117-4948-8efa-dff21866e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:42.557423 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bc585-3117-4948-8efa-dff21866e657 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:42.557923 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bc585-3117-4948-8efa-dff21866e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:42.558391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bc585-3117-4948-8efa-dff21866e657 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:42.559373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bc585-3117-4948-8efa-dff21866e657 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:42.559893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bc585-3117-4948-8efa-dff21866e657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:42.561711 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bc585-3117-4948-8efa-dff21866e657 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:42.572138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 145/288] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:42.577800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e923e-49bf-4126-b9d3-3a513fdb3bb2 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:42.589484 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e923e-49bf-4126-b9d3-3a513fdb3bb2 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:42.599022 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecab200-84db-43c3-bf2a-ddb33f3c28eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:42.599901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecab200-84db-43c3-bf2a-ddb33f3c28eb admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:42.600192 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecab200-84db-43c3-bf2a-ddb33f3c28eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:42.600473 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecab200-84db-43c3-bf2a-ddb33f3c28eb admin admin] PATH_INFO: `/v3/groups/8e14738e36d54ec99b0c527589518646` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:42.601699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecab200-84db-43c3-bf2a-ddb33f3c28eb admin admin] RBAC: Authorizing `identity:get_group(group_id=8e14738e36d54ec99b0c527589518646)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:42.603669 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecab200-84db-43c3-bf2a-ddb33f3c28eb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:42.605307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 144/289] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:42 2021] GET /identity/v3/groups/8e14738e36d54ec99b0c527589518646 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:42.611744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bc585-3117-4948-8efa-dff21866e657 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:42.622011 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bc585-3117-4948-8efa-dff21866e657 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:42.627017 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0aa16-fd19-44a3-b70d-f2d285d22dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:42.628235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0aa16-fd19-44a3-b70d-f2d285d22dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:42.629022 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0aa16-fd19-44a3-b70d-f2d285d22dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:42.629509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0aa16-fd19-44a3-b70d-f2d285d22dd6 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:42.631043 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0aa16-fd19-44a3-b70d-f2d285d22dd6 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:42.633398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0aa16-fd19-44a3-b70d-f2d285d22dd6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:42.635735 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 146/290] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:42 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:42.641758 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecab200-84db-43c3-bf2a-ddb33f3c28eb admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:42.652816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecab200-84db-43c3-bf2a-ddb33f3c28eb admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:42.658018 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48732009-109e-47a3-b857-988bb10d8124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:42.659307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48732009-109e-47a3-b857-988bb10d8124 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:42.660517 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48732009-109e-47a3-b857-988bb10d8124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:42.661009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48732009-109e-47a3-b857-988bb10d8124 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea/groups/8e14738e36d54ec99b0c527589518646/roles/5f5b315594d34a0da8fd0e1cc476318e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:42.663648 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48732009-109e-47a3-b857-988bb10d8124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3488c6af544a1aa2bc5fdd48f927ea, group_id=8e14738e36d54ec99b0c527589518646, role_id=5f5b315594d34a0da8fd0e1cc476318e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:42.666591 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48732009-109e-47a3-b857-988bb10d8124 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:42.683266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 145/291] 10.222.0.50 () {58 vars in 1463 bytes} [Tue Nov 16 00:19:42 2021] PUT /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea/groups/8e14738e36d54ec99b0c527589518646/roles/5f5b315594d34a0da8fd0e1cc476318e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:43.207843 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ade284-26ce-4296-afde-cefb4ca0be80 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:43.208632 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ade284-26ce-4296-afde-cefb4ca0be80 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:43.209138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ade284-26ce-4296-afde-cefb4ca0be80 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:43.211682 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 147/292] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:43.219187 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72739c44-7ece-42eb-bef3-9560a235fbb2 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:43.219765 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72739c44-7ece-42eb-bef3-9560a235fbb2 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:43.220248 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72739c44-7ece-42eb-bef3-9560a235fbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:43.244996 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-72739c44-7ece-42eb-bef3-9560a235fbb2 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:43.246549 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-72739c44-7ece-42eb-bef3-9560a235fbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:43.312701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 146/293] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:43.339722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ade284-26ce-4296-afde-cefb4ca0be80 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:43.365015 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ade284-26ce-4296-afde-cefb4ca0be80 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:43.372231 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946f623-56bf-4141-909c-02b25b944612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:43.373047 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946f623-56bf-4141-909c-02b25b944612 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:43.373326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946f623-56bf-4141-909c-02b25b944612 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:43.373599 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946f623-56bf-4141-909c-02b25b944612 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:43.387906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946f623-56bf-4141-909c-02b25b944612 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:43.395216 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-f946f623-56bf-4141-909c-02b25b944612 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:43.401746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 148/294] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:43.403137 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72739c44-7ece-42eb-bef3-9560a235fbb2 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:43.413325 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72739c44-7ece-42eb-bef3-9560a235fbb2 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:43.428355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc742fd-f6bc-48e0-b01d-f628eae89124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:43.429287 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc742fd-f6bc-48e0-b01d-f628eae89124 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:43.429776 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc742fd-f6bc-48e0-b01d-f628eae89124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:43.430277 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc742fd-f6bc-48e0-b01d-f628eae89124 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:43.431271 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc742fd-f6bc-48e0-b01d-f628eae89124 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:43.431785 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc742fd-f6bc-48e0-b01d-f628eae89124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:43.433642 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc742fd-f6bc-48e0-b01d-f628eae89124 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:43.447072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 147/295] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:43.453411 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946f623-56bf-4141-909c-02b25b944612 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:43.455211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9aa9c-ed39-459b-bfd4-1efa868b99ed None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:43.455721 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9aa9c-ed39-459b-bfd4-1efa868b99ed None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:43.456394 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9aa9c-ed39-459b-bfd4-1efa868b99ed None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:43.459053 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 148/296] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:43.466001 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222e60-d9e7-4c2f-be8a-fae8299d1c4e None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:43.466289 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222e60-d9e7-4c2f-be8a-fae8299d1c4e None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:43.466565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222e60-d9e7-4c2f-be8a-fae8299d1c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:43.469268 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946f623-56bf-4141-909c-02b25b944612 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:43.482789 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654076f-3a1e-42de-b880-645706f63774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:43.483691 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654076f-3a1e-42de-b880-645706f63774 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:43.483946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654076f-3a1e-42de-b880-645706f63774 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:43.484219 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654076f-3a1e-42de-b880-645706f63774 admin admin] PATH_INFO: `/v3/groups/8e14738e36d54ec99b0c527589518646` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:43.485650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-86222e60-d9e7-4c2f-be8a-fae8299d1c4e None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:43.486867 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-86222e60-d9e7-4c2f-be8a-fae8299d1c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:43.491570 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654076f-3a1e-42de-b880-645706f63774 admin admin] RBAC: Authorizing `identity:get_group(group_id=8e14738e36d54ec99b0c527589518646)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:43.493485 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654076f-3a1e-42de-b880-645706f63774 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:43.495156 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 149/297] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:43 2021] GET /identity/v3/groups/8e14738e36d54ec99b0c527589518646 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:43.500476 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 149/298] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:43.507490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654076f-3a1e-42de-b880-645706f63774 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:43.517310 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654076f-3a1e-42de-b880-645706f63774 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:43.522526 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c85d-886a-41d4-9364-3ce6186d447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:43.523404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c85d-886a-41d4-9364-3ce6186d447e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:43.523687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c85d-886a-41d4-9364-3ce6186d447e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:43.523966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c85d-886a-41d4-9364-3ce6186d447e admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:43.525139 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082c85d-886a-41d4-9364-3ce6186d447e admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:43.527248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082c85d-886a-41d4-9364-3ce6186d447e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:43.528908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 150/299] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:43 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:43.536576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86222e60-d9e7-4c2f-be8a-fae8299d1c4e None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:43.543341 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c85d-886a-41d4-9364-3ce6186d447e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:43.551386 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86222e60-d9e7-4c2f-be8a-fae8299d1c4e None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:43.558784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c85d-886a-41d4-9364-3ce6186d447e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:43.560420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7feaa-8123-4778-b2b3-3cb1ed473a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:43.561298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7feaa-8123-4778-b2b3-3cb1ed473a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:43.561576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7feaa-8123-4778-b2b3-3cb1ed473a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:43.561843 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7feaa-8123-4778-b2b3-3cb1ed473a81 admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c/groups/8e14738e36d54ec99b0c527589518646/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:43.564366 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7feaa-8123-4778-b2b3-3cb1ed473a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0ea87d14e741a29f7ed0df7614186c, group_id=8e14738e36d54ec99b0c527589518646, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:43.567654 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7feaa-8123-4778-b2b3-3cb1ed473a81 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:43.574221 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240d3e9-d942-45de-8eaa-e59039650e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:43.575130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240d3e9-d942-45de-8eaa-e59039650e4a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:43.575369 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240d3e9-d942-45de-8eaa-e59039650e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:43.575901 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240d3e9-d942-45de-8eaa-e59039650e4a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:43.590311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 150/300] 10.222.0.50 () {58 vars in 1463 bytes} [Tue Nov 16 00:19:43 2021] PUT /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c/groups/8e14738e36d54ec99b0c527589518646/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:19:43.597185 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240d3e9-d942-45de-8eaa-e59039650e4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:43.606048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-6240d3e9-d942-45de-8eaa-e59039650e4a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 00:19:43.608165 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 151/301] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:19:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:43.614671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7feaa-8123-4778-b2b3-3cb1ed473a81 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:43.712652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7feaa-8123-4778-b2b3-3cb1ed473a81 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:43.719631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d734b-3cc2-429c-b65c-259daef749ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:43.720620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d734b-3cc2-429c-b65c-259daef749ea admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:43.721063 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d734b-3cc2-429c-b65c-259daef749ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:43.721493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d734b-3cc2-429c-b65c-259daef749ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:43.722767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d734b-3cc2-429c-b65c-259daef749ea admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:43.723286 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d734b-3cc2-429c-b65c-259daef749ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:43.725175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d734b-3cc2-429c-b65c-259daef749ea admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:43.735043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 151/302] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:43.742548 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240d3e9-d942-45de-8eaa-e59039650e4a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:43.753208 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240d3e9-d942-45de-8eaa-e59039650e4a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:43.762272 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9016e-3fdd-4085-85ad-82145c235c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:43.763177 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9016e-3fdd-4085-85ad-82145c235c12 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:43.763465 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9016e-3fdd-4085-85ad-82145c235c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:43.763744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9016e-3fdd-4085-85ad-82145c235c12 admin admin] PATH_INFO: `/v3/groups/8e14738e36d54ec99b0c527589518646` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:43.765063 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9016e-3fdd-4085-85ad-82145c235c12 admin admin] RBAC: Authorizing `identity:get_group(group_id=8e14738e36d54ec99b0c527589518646)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:43.767172 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9016e-3fdd-4085-85ad-82145c235c12 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:43.768964 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 152/303] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:43 2021] GET /identity/v3/groups/8e14738e36d54ec99b0c527589518646 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:43.776024 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d734b-3cc2-429c-b65c-259daef749ea admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:43.791446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d734b-3cc2-429c-b65c-259daef749ea admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:43.796911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13bc13-693a-4977-a4ed-15c215ea8385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:43.798190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13bc13-693a-4977-a4ed-15c215ea8385 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:43.798680 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13bc13-693a-4977-a4ed-15c215ea8385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:43.799183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13bc13-693a-4977-a4ed-15c215ea8385 admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:43.800989 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13bc13-693a-4977-a4ed-15c215ea8385 admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:43.803374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13bc13-693a-4977-a4ed-15c215ea8385 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:43.805493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 152/304] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:43 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:43.812259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9016e-3fdd-4085-85ad-82145c235c12 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:43.826615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9016e-3fdd-4085-85ad-82145c235c12 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:43.837025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06e5d3-82be-4214-8647-17517473aee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:43.837984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06e5d3-82be-4214-8647-17517473aee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:43.838269 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06e5d3-82be-4214-8647-17517473aee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:43.838604 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06e5d3-82be-4214-8647-17517473aee8 admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c/groups/8e14738e36d54ec99b0c527589518646/roles/5f5b315594d34a0da8fd0e1cc476318e` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:43.840979 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06e5d3-82be-4214-8647-17517473aee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0ea87d14e741a29f7ed0df7614186c, group_id=8e14738e36d54ec99b0c527589518646, role_id=5f5b315594d34a0da8fd0e1cc476318e)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:43.843809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06e5d3-82be-4214-8647-17517473aee8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:43.865625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 153/305] 10.222.0.50 () {58 vars in 1463 bytes} [Tue Nov 16 00:19:43 2021] PUT /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c/groups/8e14738e36d54ec99b0c527589518646/roles/5f5b315594d34a0da8fd0e1cc476318e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:44.401090 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b0a20-18d2-4f67-b1e8-2e1b95db0d0f None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.401630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b0a20-18d2-4f67-b1e8-2e1b95db0d0f None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.401630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b0a20-18d2-4f67-b1e8-2e1b95db0d0f None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.403823 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 153/306] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:44.412984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4b429-637f-4c58-8188-67a7b7cd2a3f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.413493 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4b429-637f-4c58-8188-67a7b7cd2a3f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.413566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4b429-637f-4c58-8188-67a7b7cd2a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.434398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-2cc4b429-637f-4c58-8188-67a7b7cd2a3f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:44.435752 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2cc4b429-637f-4c58-8188-67a7b7cd2a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:44.499085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e892c-cc0d-4ba8-b4ce-8b6d58533f47 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.499449 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e892c-cc0d-4ba8-b4ce-8b6d58533f47 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.499637 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e892c-cc0d-4ba8-b4ce-8b6d58533f47 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.501587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 154/307] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:44.502375 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 154/308] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:44.513149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16119f3f-a9b8-4768-bc5d-0a4cd2724fe2 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.513566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16119f3f-a9b8-4768-bc5d-0a4cd2724fe2 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.513967 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16119f3f-a9b8-4768-bc5d-0a4cd2724fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.538451 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-16119f3f-a9b8-4768-bc5d-0a4cd2724fe2 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:44.539900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-16119f3f-a9b8-4768-bc5d-0a4cd2724fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:44.548833 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4b429-637f-4c58-8188-67a7b7cd2a3f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:44.549255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 155/309] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:44.561796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4b429-637f-4c58-8188-67a7b7cd2a3f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:44.569933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb7013-8016-4756-adc1-acfaf376aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:44.571001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb7013-8016-4756-adc1-acfaf376aca8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.571436 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb7013-8016-4756-adc1-acfaf376aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.571895 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb7013-8016-4756-adc1-acfaf376aca8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.588581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb7013-8016-4756-adc1-acfaf376aca8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:44.595580 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-d0fb7013-8016-4756-adc1-acfaf376aca8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:19:44.597519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 155/310] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:19:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:19:44.604053 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16119f3f-a9b8-4768-bc5d-0a4cd2724fe2 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:44.612989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb7013-8016-4756-adc1-acfaf376aca8 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:44.617013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16119f3f-a9b8-4768-bc5d-0a4cd2724fe2 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:44.627847 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79082df2-18fd-4a40-95c3-3858c8a79e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:44.629225 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79082df2-18fd-4a40-95c3-3858c8a79e48 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.629578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79082df2-18fd-4a40-95c3-3858c8a79e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.629931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79082df2-18fd-4a40-95c3-3858c8a79e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.630788 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79082df2-18fd-4a40-95c3-3858c8a79e48 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:44.631101 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb7013-8016-4756-adc1-acfaf376aca8 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:44.631208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79082df2-18fd-4a40-95c3-3858c8a79e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:44.633043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79082df2-18fd-4a40-95c3-3858c8a79e48 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:44.643494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163a3a4-7049-4c27-afb3-812a01506723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:44.645368 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a3a4-7049-4c27-afb3-812a01506723 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.645842 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a3a4-7049-4c27-afb3-812a01506723 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.646302 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a3a4-7049-4c27-afb3-812a01506723 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.646691 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 156/311] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:44.652889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79082df2-18fd-4a40-95c3-3858c8a79e48 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:44.665588 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79082df2-18fd-4a40-95c3-3858c8a79e48 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:44.669058 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163a3a4-7049-4c27-afb3-812a01506723 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:44.670889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b68dd-3dc0-4462-88cf-67c6056ef77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:44.671876 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b68dd-3dc0-4462-88cf-67c6056ef77b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.672288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b68dd-3dc0-4462-88cf-67c6056ef77b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.672672 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b68dd-3dc0-4462-88cf-67c6056ef77b admin admin] PATH_INFO: `/v3/groups/8791ecc8c9174afe830af51bfb8cab49` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.674010 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b68dd-3dc0-4462-88cf-67c6056ef77b admin admin] RBAC: Authorizing `identity:get_group(group_id=8791ecc8c9174afe830af51bfb8cab49)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:44.676679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b68dd-3dc0-4462-88cf-67c6056ef77b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:44.678031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-4163a3a4-7049-4c27-afb3-812a01506723 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:44.679428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 156/313] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:19:44.684802 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 157/313] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:44 2021] GET /identity/v3/groups/8791ecc8c9174afe830af51bfb8cab49 => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:44.686226 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b68dd-3dc0-4462-88cf-67c6056ef77b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:44.687277 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163a3a4-7049-4c27-afb3-812a01506723 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:44.704840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b68dd-3dc0-4462-88cf-67c6056ef77b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:44.709294 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163a3a4-7049-4c27-afb3-812a01506723 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:44.715845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db859cb-8166-44fd-a84a-39ba7ceb96ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:44.717477 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db859cb-8166-44fd-a84a-39ba7ceb96ad admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.718751 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe349763-195f-4d26-a14c-9d871a9380d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:44.719321 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db859cb-8166-44fd-a84a-39ba7ceb96ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.719952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db859cb-8166-44fd-a84a-39ba7ceb96ad admin admin] PATH_INFO: `/v3/projects/7aec0bf3f5ba404495a1eab25f1fe71c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.721294 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe349763-195f-4d26-a14c-9d871a9380d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.721783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe349763-195f-4d26-a14c-9d871a9380d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.723598 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe349763-195f-4d26-a14c-9d871a9380d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.724587 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe349763-195f-4d26-a14c-9d871a9380d6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:44.725578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe349763-195f-4d26-a14c-9d871a9380d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:44.725780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db859cb-8166-44fd-a84a-39ba7ceb96ad admin admin] RBAC: Authorizing `identity:get_project(project_id=7aec0bf3f5ba404495a1eab25f1fe71c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:44.728519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe349763-195f-4d26-a14c-9d871a9380d6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:44.729701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db859cb-8166-44fd-a84a-39ba7ceb96ad admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:44.733194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 158/314] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:44 2021] GET /identity/v3/projects/7aec0bf3f5ba404495a1eab25f1fe71c => generated 344 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:44.739901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db859cb-8166-44fd-a84a-39ba7ceb96ad admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:44.749261 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 157/315] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:44.750310 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db859cb-8166-44fd-a84a-39ba7ceb96ad admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:44.757643 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe349763-195f-4d26-a14c-9d871a9380d6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:44.763036 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60775e9-df36-480f-ac42-7cc6cf9d293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:44.764134 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60775e9-df36-480f-ac42-7cc6cf9d293f admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.765796 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60775e9-df36-480f-ac42-7cc6cf9d293f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.766317 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60775e9-df36-480f-ac42-7cc6cf9d293f admin admin] PATH_INFO: `/v3/projects/7aec0bf3f5ba404495a1eab25f1fe71c/groups/8791ecc8c9174afe830af51bfb8cab49/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.770355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60775e9-df36-480f-ac42-7cc6cf9d293f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aec0bf3f5ba404495a1eab25f1fe71c, group_id=8791ecc8c9174afe830af51bfb8cab49, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:44.775382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60775e9-df36-480f-ac42-7cc6cf9d293f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:44.777986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe349763-195f-4d26-a14c-9d871a9380d6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:44.788220 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38129b9e-cc1e-4593-a659-20394b0678cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:44.789282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38129b9e-cc1e-4593-a659-20394b0678cb admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.789776 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38129b9e-cc1e-4593-a659-20394b0678cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.790332 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38129b9e-cc1e-4593-a659-20394b0678cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.805164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 159/316] 10.222.0.50 () {58 vars in 1463 bytes} [Tue Nov 16 00:19:44 2021] PUT /identity/v3/projects/7aec0bf3f5ba404495a1eab25f1fe71c/groups/8791ecc8c9174afe830af51bfb8cab49/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:44.807704 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38129b9e-cc1e-4593-a659-20394b0678cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:44.809833 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38129b9e-cc1e-4593-a659-20394b0678cb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:44.821284 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 158/317] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:44.828105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60775e9-df36-480f-ac42-7cc6cf9d293f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:44.896330 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60775e9-df36-480f-ac42-7cc6cf9d293f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:44.901168 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada486-feef-4555-83af-97ac8ded52cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:44.902266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada486-feef-4555-83af-97ac8ded52cd admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.903039 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada486-feef-4555-83af-97ac8ded52cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.903510 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada486-feef-4555-83af-97ac8ded52cd admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.904992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cada486-feef-4555-83af-97ac8ded52cd admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:44.907538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cada486-feef-4555-83af-97ac8ded52cd admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:44.909749 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 160/318] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:44 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:44.916490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38129b9e-cc1e-4593-a659-20394b0678cb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:44.927255 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38129b9e-cc1e-4593-a659-20394b0678cb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:44.932723 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3172c1-5b7c-410f-ac86-4121e26d2c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:44.933715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3172c1-5b7c-410f-ac86-4121e26d2c7d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.934002 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3172c1-5b7c-410f-ac86-4121e26d2c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.934293 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3172c1-5b7c-410f-ac86-4121e26d2c7d admin admin] PATH_INFO: `/v3/groups/8e14738e36d54ec99b0c527589518646` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.935698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3172c1-5b7c-410f-ac86-4121e26d2c7d admin admin] RBAC: Authorizing `identity:get_group(group_id=8e14738e36d54ec99b0c527589518646)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:44.937751 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3172c1-5b7c-410f-ac86-4121e26d2c7d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:44.939933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 159/319] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:44 2021] GET /identity/v3/groups/8e14738e36d54ec99b0c527589518646 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:44.947232 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada486-feef-4555-83af-97ac8ded52cd admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:44.958483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada486-feef-4555-83af-97ac8ded52cd admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:44.963592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68623a-64b1-486f-bb42-468034336414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:44.964265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68623a-64b1-486f-bb42-468034336414 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:44.964605 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68623a-64b1-486f-bb42-468034336414 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:44.964940 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68623a-64b1-486f-bb42-468034336414 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:44.965795 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68623a-64b1-486f-bb42-468034336414 admin admin] RBAC: Adding query filter params (group.id=8e14738e36d54ec99b0c527589518646, role.id=e338c12e36c04cffba27cfe873d606aa, scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:44.966163 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68623a-64b1-486f-bb42-468034336414 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:44.968213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68623a-64b1-486f-bb42-468034336414 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:44.975938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 161/320] 10.222.0.50 () {56 vars in 1397 bytes} [Tue Nov 16 00:19:44 2021] GET /identity/v3/role_assignments?group.id=8e14738e36d54ec99b0c527589518646&scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea&role.id=e338c12e36c04cffba27cfe873d606aa => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:45.679694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6859eb-ba0b-4244-808f-200afb74456b None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:45.680553 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6859eb-ba0b-4244-808f-200afb74456b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:45.680847 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6859eb-ba0b-4244-808f-200afb74456b None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:45.682797 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 160/321] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:45.690184 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47c4d-7afc-4a0f-a9a0-8d10b7b26f97 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:45.690622 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47c4d-7afc-4a0f-a9a0-8d10b7b26f97 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:45.690795 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47c4d-7afc-4a0f-a9a0-8d10b7b26f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:45.711426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-cbd47c4d-7afc-4a0f-a9a0-8d10b7b26f97 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:45.712618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-cbd47c4d-7afc-4a0f-a9a0-8d10b7b26f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:45.725740 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 162/322] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:45.752452 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6859eb-ba0b-4244-808f-200afb74456b None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:45.768895 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6859eb-ba0b-4244-808f-200afb74456b None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:45.774024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab422d-7692-4866-98b5-6a3ca9bb971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:45.774859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab422d-7692-4866-98b5-6a3ca9bb971f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:45.775148 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab422d-7692-4866-98b5-6a3ca9bb971f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:45.775427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab422d-7692-4866-98b5-6a3ca9bb971f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:45.792437 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab422d-7692-4866-98b5-6a3ca9bb971f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:45.800013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-44ab422d-7692-4866-98b5-6a3ca9bb971f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 00:19:45.806941 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 161/323] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:19:45 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:45.809000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd47c4d-7afc-4a0f-a9a0-8d10b7b26f97 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:45.818384 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd47c4d-7afc-4a0f-a9a0-8d10b7b26f97 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:45.825884 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c1a4d-1844-4f61-aa24-396198a95887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:45.826798 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c1a4d-1844-4f61-aa24-396198a95887 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:45.827305 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c1a4d-1844-4f61-aa24-396198a95887 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:45.827771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c1a4d-1844-4f61-aa24-396198a95887 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:45.828728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c1a4d-1844-4f61-aa24-396198a95887 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:45.829226 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c1a4d-1844-4f61-aa24-396198a95887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:45.831043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c1a4d-1844-4f61-aa24-396198a95887 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:45.840175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 163/324] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:45 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:45.846604 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab422d-7692-4866-98b5-6a3ca9bb971f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:45.859916 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab422d-7692-4866-98b5-6a3ca9bb971f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:45.865815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9d854-2e0d-4f8b-9e45-aea01fd15324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:45.866707 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9d854-2e0d-4f8b-9e45-aea01fd15324 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:45.867222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9d854-2e0d-4f8b-9e45-aea01fd15324 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:45.867715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9d854-2e0d-4f8b-9e45-aea01fd15324 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:45.876213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9d854-2e0d-4f8b-9e45-aea01fd15324 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:45.878222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9d854-2e0d-4f8b-9e45-aea01fd15324 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:45.894019 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 162/325] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:45.895706 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c1a4d-1844-4f61-aa24-396198a95887 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:45.905871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c1a4d-1844-4f61-aa24-396198a95887 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:45.911234 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0d380-cbf6-4a18-9c5e-bf65e2ae6288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:45.912361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0d380-cbf6-4a18-9c5e-bf65e2ae6288 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:45.912827 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0d380-cbf6-4a18-9c5e-bf65e2ae6288 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:45.913309 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0d380-cbf6-4a18-9c5e-bf65e2ae6288 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:45.914701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0d380-cbf6-4a18-9c5e-bf65e2ae6288 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:45.917133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0d380-cbf6-4a18-9c5e-bf65e2ae6288 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:45.919427 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 164/326] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:45 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:45.932557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9d854-2e0d-4f8b-9e45-aea01fd15324 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:45.943465 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9d854-2e0d-4f8b-9e45-aea01fd15324 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:45.953641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640902c-1563-4394-81ed-6a2471b59ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:45.954821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640902c-1563-4394-81ed-6a2471b59ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:45.955283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640902c-1563-4394-81ed-6a2471b59ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:45.955777 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640902c-1563-4394-81ed-6a2471b59ce1 admin admin] PATH_INFO: `/v3/groups/8e14738e36d54ec99b0c527589518646` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:45.957440 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640902c-1563-4394-81ed-6a2471b59ce1 admin admin] RBAC: Authorizing `identity:get_group(group_id=8e14738e36d54ec99b0c527589518646)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:45.959670 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640902c-1563-4394-81ed-6a2471b59ce1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:45.966975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 163/327] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:45 2021] GET /identity/v3/groups/8e14738e36d54ec99b0c527589518646 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:45.968491 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0d380-cbf6-4a18-9c5e-bf65e2ae6288 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:45.979614 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0d380-cbf6-4a18-9c5e-bf65e2ae6288 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:45.984588 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec65b8-18ad-40a9-8b1f-6731e8aea990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:45.985435 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec65b8-18ad-40a9-8b1f-6731e8aea990 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:45.985933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec65b8-18ad-40a9-8b1f-6731e8aea990 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:45.986354 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec65b8-18ad-40a9-8b1f-6731e8aea990 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:45.987431 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec65b8-18ad-40a9-8b1f-6731e8aea990 admin admin] RBAC: Adding query filter params (group.id=8e14738e36d54ec99b0c527589518646, role.id=5f5b315594d34a0da8fd0e1cc476318e, scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:45.987978 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec65b8-18ad-40a9-8b1f-6731e8aea990 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:45.990686 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec65b8-18ad-40a9-8b1f-6731e8aea990 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:46.000257 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 165/328] 10.222.0.50 () {56 vars in 1397 bytes} [Tue Nov 16 00:19:45 2021] GET /identity/v3/role_assignments?group.id=8e14738e36d54ec99b0c527589518646&scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea&role.id=5f5b315594d34a0da8fd0e1cc476318e => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:46.432455 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419f38-bdf8-43ca-b615-977eca8d9ff2 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.432740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419f38-bdf8-43ca-b615-977eca8d9ff2 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.433057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419f38-bdf8-43ca-b615-977eca8d9ff2 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.434898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 164/329] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:46.442680 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5772eae-22f0-4c90-8575-e5a967e8885c None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.443004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5772eae-22f0-4c90-8575-e5a967e8885c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.443285 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5772eae-22f0-4c90-8575-e5a967e8885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.461465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-e5772eae-22f0-4c90-8575-e5a967e8885c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:46.462659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e5772eae-22f0-4c90-8575-e5a967e8885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:46.471035 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 166/330] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:46.495384 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a419f38-bdf8-43ca-b615-977eca8d9ff2 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:46.508352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a419f38-bdf8-43ca-b615-977eca8d9ff2 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:46.513011 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be45a36-511f-4036-9cbf-bf18aab43a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:46.514011 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be45a36-511f-4036-9cbf-bf18aab43a74 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.514402 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be45a36-511f-4036-9cbf-bf18aab43a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.514784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be45a36-511f-4036-9cbf-bf18aab43a74 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.527770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be45a36-511f-4036-9cbf-bf18aab43a74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:46.535592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-0be45a36-511f-4036-9cbf-bf18aab43a74 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 00:19:46.537187 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 165/331] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:19:46.543686 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5772eae-22f0-4c90-8575-e5a967e8885c None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:46.553518 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5772eae-22f0-4c90-8575-e5a967e8885c None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:46.558215 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4741ec-0e25-4c8b-8201-c7311371b080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:46.559084 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4741ec-0e25-4c8b-8201-c7311371b080 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.559499 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4741ec-0e25-4c8b-8201-c7311371b080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.559930 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4741ec-0e25-4c8b-8201-c7311371b080 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.560817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4741ec-0e25-4c8b-8201-c7311371b080 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:46.561264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4741ec-0e25-4c8b-8201-c7311371b080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:46.563107 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4741ec-0e25-4c8b-8201-c7311371b080 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:46.572651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 167/332] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:19:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:46.578721 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be45a36-511f-4036-9cbf-bf18aab43a74 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:46.590492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be45a36-511f-4036-9cbf-bf18aab43a74 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:46.595017 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b1ea6-3a2f-42a3-a562-1dd2647fee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:46.595831 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b1ea6-3a2f-42a3-a562-1dd2647fee39 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.596256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b1ea6-3a2f-42a3-a562-1dd2647fee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.596670 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b1ea6-3a2f-42a3-a562-1dd2647fee39 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.602794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef5ee9-57df-4629-9f68-75d69098f47e None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.603123 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef5ee9-57df-4629-9f68-75d69098f47e None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.603404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef5ee9-57df-4629-9f68-75d69098f47e None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.605205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 168/333] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:46.606461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b1ea6-3a2f-42a3-a562-1dd2647fee39 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:46.608285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b1ea6-3a2f-42a3-a562-1dd2647fee39 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:46.612264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff162d-a584-4612-a94e-a26944feedb1 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.612554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff162d-a584-4612-a94e-a26944feedb1 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.613524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff162d-a584-4612-a94e-a26944feedb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.627750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 166/334] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:46.628921 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b1ea6-3a2f-42a3-a562-1dd2647fee39 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:46.633532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-e2ff162d-a584-4612-a94e-a26944feedb1 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:46.634736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e2ff162d-a584-4612-a94e-a26944feedb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:46.637902 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b1ea6-3a2f-42a3-a562-1dd2647fee39 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:46.642267 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e330c-3cba-495b-bff3-0feaad86f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:46.642389 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 169/335] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:46.643196 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e330c-3cba-495b-bff3-0feaad86f770 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.643483 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e330c-3cba-495b-bff3-0feaad86f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.643757 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e330c-3cba-495b-bff3-0feaad86f770 admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.644954 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e330c-3cba-495b-bff3-0feaad86f770 admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:46.647044 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e330c-3cba-495b-bff3-0feaad86f770 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:46.648827 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 167/336] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:46 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:46.654822 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff162d-a584-4612-a94e-a26944feedb1 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:46.664804 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff162d-a584-4612-a94e-a26944feedb1 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:46.667519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e330c-3cba-495b-bff3-0feaad86f770 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:46.669582 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff97f0-d605-4cc1-b784-60376ec6d370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:46.670428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff97f0-d605-4cc1-b784-60376ec6d370 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.670715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff97f0-d605-4cc1-b784-60376ec6d370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.671023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff97f0-d605-4cc1-b784-60376ec6d370 admin admin] PATH_INFO: `/v3/groups/8e14738e36d54ec99b0c527589518646` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.672201 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff97f0-d605-4cc1-b784-60376ec6d370 admin admin] RBAC: Authorizing `identity:get_group(group_id=8e14738e36d54ec99b0c527589518646)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:46.674326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff97f0-d605-4cc1-b784-60376ec6d370 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:46.676904 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 170/337] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:46 2021] GET /identity/v3/groups/8e14738e36d54ec99b0c527589518646 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:46.677728 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e330c-3cba-495b-bff3-0feaad86f770 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:46.682075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac7dc5-f1dd-4131-b78a-548be1078434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:46.682878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff97f0-d605-4cc1-b784-60376ec6d370 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:46.682980 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac7dc5-f1dd-4131-b78a-548be1078434 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.683190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac7dc5-f1dd-4131-b78a-548be1078434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.683474 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac7dc5-f1dd-4131-b78a-548be1078434 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.692479 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff97f0-d605-4cc1-b784-60376ec6d370 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:46.700519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac7dc5-f1dd-4131-b78a-548be1078434 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:46.700656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d14c49-afa7-4d47-bd8b-2efcb476cec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:46.700656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d14c49-afa7-4d47-bd8b-2efcb476cec9 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.700656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d14c49-afa7-4d47-bd8b-2efcb476cec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.700656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d14c49-afa7-4d47-bd8b-2efcb476cec9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.700940 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d14c49-afa7-4d47-bd8b-2efcb476cec9 admin admin] RBAC: Adding query filter params (group.id=8e14738e36d54ec99b0c527589518646, role.id=e338c12e36c04cffba27cfe873d606aa, scope.project.id=dc0ea87d14e741a29f7ed0df7614186c) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:46.700940 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d14c49-afa7-4d47-bd8b-2efcb476cec9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:46.701592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d14c49-afa7-4d47-bd8b-2efcb476cec9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:46.702492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-53ac7dc5-f1dd-4131-b78a-548be1078434 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 00:19:46.704136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 168/338] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:19:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:19:46.710125 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac7dc5-f1dd-4131-b78a-548be1078434 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:46.710596 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 171/339] 10.222.0.50 () {56 vars in 1397 bytes} [Tue Nov 16 00:19:46 2021] GET /identity/v3/role_assignments?group.id=8e14738e36d54ec99b0c527589518646&scope.project.id=dc0ea87d14e741a29f7ed0df7614186c&role.id=e338c12e36c04cffba27cfe873d606aa => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:46.727309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac7dc5-f1dd-4131-b78a-548be1078434 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:46.731866 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40912e-0fc5-4893-9895-fd590cdaf082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:46.732553 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40912e-0fc5-4893-9895-fd590cdaf082 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.732841 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40912e-0fc5-4893-9895-fd590cdaf082 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.733116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40912e-0fc5-4893-9895-fd590cdaf082 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.733882 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40912e-0fc5-4893-9895-fd590cdaf082 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:46.734189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40912e-0fc5-4893-9895-fd590cdaf082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:46.735868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40912e-0fc5-4893-9895-fd590cdaf082 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:46.752291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 169/340] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:46.753428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d14c49-afa7-4d47-bd8b-2efcb476cec9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:46.764234 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d14c49-afa7-4d47-bd8b-2efcb476cec9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:46.768717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd73661-0792-4fbd-bfa5-718f20129442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:46.770018 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd73661-0792-4fbd-bfa5-718f20129442 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.770333 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd73661-0792-4fbd-bfa5-718f20129442 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.770620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd73661-0792-4fbd-bfa5-718f20129442 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.779408 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd73661-0792-4fbd-bfa5-718f20129442 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:46.781203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd73661-0792-4fbd-bfa5-718f20129442 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:46.792585 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 172/341] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:46.798917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40912e-0fc5-4893-9895-fd590cdaf082 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:46.810572 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40912e-0fc5-4893-9895-fd590cdaf082 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:46.815825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b77f-5e97-41c1-8fa6-52896aba1581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:46.817000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b77f-5e97-41c1-8fa6-52896aba1581 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.817499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b77f-5e97-41c1-8fa6-52896aba1581 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.818071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b77f-5e97-41c1-8fa6-52896aba1581 admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.819618 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6b77f-5e97-41c1-8fa6-52896aba1581 admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:46.822116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6b77f-5e97-41c1-8fa6-52896aba1581 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:46.824429 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 170/342] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:46 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:46.830485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd73661-0792-4fbd-bfa5-718f20129442 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:46.839954 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd73661-0792-4fbd-bfa5-718f20129442 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:46.844609 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce8d5a-a26e-435b-8124-a1a9a77eef66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:46.845467 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce8d5a-a26e-435b-8124-a1a9a77eef66 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.845758 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce8d5a-a26e-435b-8124-a1a9a77eef66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.846039 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce8d5a-a26e-435b-8124-a1a9a77eef66 admin admin] PATH_INFO: `/v3/groups/8e14738e36d54ec99b0c527589518646` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.848273 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce8d5a-a26e-435b-8124-a1a9a77eef66 admin admin] RBAC: Authorizing `identity:get_group(group_id=8e14738e36d54ec99b0c527589518646)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:46.850211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce8d5a-a26e-435b-8124-a1a9a77eef66 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:46.852173 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 173/343] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:46 2021] GET /identity/v3/groups/8e14738e36d54ec99b0c527589518646 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:46.858617 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b77f-5e97-41c1-8fa6-52896aba1581 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:46.869416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b77f-5e97-41c1-8fa6-52896aba1581 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:46.873984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f8b35-9252-4e94-9e7c-6d5880fef845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:46.874640 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f8b35-9252-4e94-9e7c-6d5880fef845 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:46.874962 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f8b35-9252-4e94-9e7c-6d5880fef845 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:46.875708 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f8b35-9252-4e94-9e7c-6d5880fef845 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:46.876075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f8b35-9252-4e94-9e7c-6d5880fef845 admin admin] RBAC: Adding query filter params (group.id=8e14738e36d54ec99b0c527589518646, role.id=5f5b315594d34a0da8fd0e1cc476318e, scope.project.id=dc0ea87d14e741a29f7ed0df7614186c) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:46.876391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f8b35-9252-4e94-9e7c-6d5880fef845 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:46.878245 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f8b35-9252-4e94-9e7c-6d5880fef845 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:46.884901 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 171/344] 10.222.0.50 () {56 vars in 1397 bytes} [Tue Nov 16 00:19:46 2021] GET /identity/v3/role_assignments?group.id=8e14738e36d54ec99b0c527589518646&scope.project.id=dc0ea87d14e741a29f7ed0df7614186c&role.id=5f5b315594d34a0da8fd0e1cc476318e => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:47.322931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892d02c-134f-4a12-a018-08e9c770fbbf None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:47.323222 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892d02c-134f-4a12-a018-08e9c770fbbf None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:47.323503 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892d02c-134f-4a12-a018-08e9c770fbbf None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:47.325293 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 174/345] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:47.332517 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d03ef-b3e2-44cf-b37a-68dd2ce36aa5 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:47.332801 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d03ef-b3e2-44cf-b37a-68dd2ce36aa5 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:47.333082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d03ef-b3e2-44cf-b37a-68dd2ce36aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:47.351178 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-803d03ef-b3e2-44cf-b37a-68dd2ce36aa5 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:47.352358 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-803d03ef-b3e2-44cf-b37a-68dd2ce36aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:47.359725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 172/346] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:47.384531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892d02c-134f-4a12-a018-08e9c770fbbf None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:47.396682 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892d02c-134f-4a12-a018-08e9c770fbbf None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:47.400833 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf553162-7072-4344-9f80-50505b88ab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:47.401606 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf553162-7072-4344-9f80-50505b88ab93 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:47.401887 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf553162-7072-4344-9f80-50505b88ab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:47.402161 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf553162-7072-4344-9f80-50505b88ab93 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:47.412996 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf553162-7072-4344-9f80-50505b88ab93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:47.419613 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-bf553162-7072-4344-9f80-50505b88ab93 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:19:47.420730 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 175/347] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:19:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:47.427362 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d03ef-b3e2-44cf-b37a-68dd2ce36aa5 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:47.437025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d03ef-b3e2-44cf-b37a-68dd2ce36aa5 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:47.441523 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6223cc-c23f-4f90-b143-a498e22a889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:47.442229 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6223cc-c23f-4f90-b143-a498e22a889b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:47.442518 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6223cc-c23f-4f90-b143-a498e22a889b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:47.442824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6223cc-c23f-4f90-b143-a498e22a889b admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:47.443596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6223cc-c23f-4f90-b143-a498e22a889b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:47.443907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6223cc-c23f-4f90-b143-a498e22a889b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:47.445507 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6223cc-c23f-4f90-b143-a498e22a889b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:47.453513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 173/348] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:47.459326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf553162-7072-4344-9f80-50505b88ab93 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:47.468973 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf553162-7072-4344-9f80-50505b88ab93 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:47.474016 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9eba6-e646-41de-b949-b1e2e7392377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:47.474623 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9eba6-e646-41de-b949-b1e2e7392377 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:47.474939 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9eba6-e646-41de-b949-b1e2e7392377 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:47.475215 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9eba6-e646-41de-b949-b1e2e7392377 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:47.482647 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9eba6-e646-41de-b949-b1e2e7392377 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:47.484404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9eba6-e646-41de-b949-b1e2e7392377 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:47.493440 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 176/349] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:47.499107 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6223cc-c23f-4f90-b143-a498e22a889b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:47.509012 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6223cc-c23f-4f90-b143-a498e22a889b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:47.513319 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdafb92-ea59-4155-a196-36e00d080ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:47.514154 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdafb92-ea59-4155-a196-36e00d080ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:47.514443 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdafb92-ea59-4155-a196-36e00d080ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:47.514724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdafb92-ea59-4155-a196-36e00d080ba1 admin admin] PATH_INFO: `/v3/projects/7aec0bf3f5ba404495a1eab25f1fe71c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:47.515965 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdafb92-ea59-4155-a196-36e00d080ba1 admin admin] RBAC: Authorizing `identity:get_project(project_id=7aec0bf3f5ba404495a1eab25f1fe71c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:47.517708 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdafb92-ea59-4155-a196-36e00d080ba1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:47.520131 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 174/350] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:19:47 2021] GET /identity/v3/projects/7aec0bf3f5ba404495a1eab25f1fe71c => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:47.525759 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9eba6-e646-41de-b949-b1e2e7392377 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:47.534009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9eba6-e646-41de-b949-b1e2e7392377 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:47.538424 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def07890-fff6-455f-aa01-f6c2389e0110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:47.539256 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def07890-fff6-455f-aa01-f6c2389e0110 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:47.539537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def07890-fff6-455f-aa01-f6c2389e0110 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:47.539808 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def07890-fff6-455f-aa01-f6c2389e0110 admin admin] PATH_INFO: `/v3/groups/8791ecc8c9174afe830af51bfb8cab49` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:47.540966 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def07890-fff6-455f-aa01-f6c2389e0110 admin admin] RBAC: Authorizing `identity:get_group(group_id=8791ecc8c9174afe830af51bfb8cab49)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:47.542781 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def07890-fff6-455f-aa01-f6c2389e0110 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:47.544320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 177/351] 10.222.0.50 () {56 vars in 1201 bytes} [Tue Nov 16 00:19:47 2021] GET /identity/v3/groups/8791ecc8c9174afe830af51bfb8cab49 => generated 229 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:47.549943 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdafb92-ea59-4155-a196-36e00d080ba1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:47.559095 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdafb92-ea59-4155-a196-36e00d080ba1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:47.563381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddbdde-33c9-4e22-aca5-5b4249f3cd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:47.563986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddbdde-33c9-4e22-aca5-5b4249f3cd81 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:47.564277 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddbdde-33c9-4e22-aca5-5b4249f3cd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:47.564561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddbdde-33c9-4e22-aca5-5b4249f3cd81 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:47.565368 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddbdde-33c9-4e22-aca5-5b4249f3cd81 admin admin] RBAC: Adding query filter params (group.id=8791ecc8c9174afe830af51bfb8cab49, role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=7aec0bf3f5ba404495a1eab25f1fe71c) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:47.565681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddbdde-33c9-4e22-aca5-5b4249f3cd81 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:47.568139 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddbdde-33c9-4e22-aca5-5b4249f3cd81 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:47.573720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 175/352] 10.222.0.50 () {56 vars in 1397 bytes} [Tue Nov 16 00:19:47 2021] GET /identity/v3/role_assignments?group.id=8791ecc8c9174afe830af51bfb8cab49&scope.project.id=7aec0bf3f5ba404495a1eab25f1fe71c&role.id=2813231cc8954b998440e4bf5ede2945 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:50.302588 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd90c5-6f38-492a-b86d-13c1e97c12d7 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:50.303660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd90c5-6f38-492a-b86d-13c1e97c12d7 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:50.304157 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd90c5-6f38-492a-b86d-13c1e97c12d7 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:50.306482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 178/353] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:50.313746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208c7d0-1b0e-4969-b5d9-81e52fa15294 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:50.314636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208c7d0-1b0e-4969-b5d9-81e52fa15294 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:50.315168 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208c7d0-1b0e-4969-b5d9-81e52fa15294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:50.341851 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0208c7d0-1b0e-4969-b5d9-81e52fa15294 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:50.343466 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0208c7d0-1b0e-4969-b5d9-81e52fa15294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:50.355236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 176/354] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:50.398703 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd90c5-6f38-492a-b86d-13c1e97c12d7 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:50.415499 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd90c5-6f38-492a-b86d-13c1e97c12d7 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:50.420443 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6e00e-c6c4-4313-80c9-979088458dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:50.421487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6e00e-c6c4-4313-80c9-979088458dbb admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:50.421984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6e00e-c6c4-4313-80c9-979088458dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:50.422455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6e00e-c6c4-4313-80c9-979088458dbb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:50.433855 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6e00e-c6c4-4313-80c9-979088458dbb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:50.436027 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6e00e-c6c4-4313-80c9-979088458dbb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:50.453598 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1bfe2-aeda-4f86-b6da-2032e011fa3c None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:50.453905 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1bfe2-aeda-4f86-b6da-2032e011fa3c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:50.454154 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1bfe2-aeda-4f86-b6da-2032e011fa3c None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:50.456353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 177/355] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:50.459282 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-2dd6e00e-c6c4-4313-80c9-979088458dbb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:50.460755 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 179/356] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:50.467270 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1bfe2-aeda-4f86-b6da-2032e011fa3c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:50.475012 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e28ad-7fd7-48fb-a019-98f42cd79b50 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:50.475585 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e28ad-7fd7-48fb-a019-98f42cd79b50 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:50.476069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e28ad-7fd7-48fb-a019-98f42cd79b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:50.487388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1bfe2-aeda-4f86-b6da-2032e011fa3c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:50.501690 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d42de-d361-4b63-9876-239621df2a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:50.502692 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d42de-d361-4b63-9876-239621df2a3e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:50.503230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d42de-d361-4b63-9876-239621df2a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:50.504418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d42de-d361-4b63-9876-239621df2a3e admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:50.505379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d42de-d361-4b63-9876-239621df2a3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:50.505919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d42de-d361-4b63-9876-239621df2a3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:50.510098 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-4a2d42de-d361-4b63-9876-239621df2a3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:50.510098 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:19:50.510098 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:19:50.511391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d42de-d361-4b63-9876-239621df2a3e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:50.514303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c56e28ad-7fd7-48fb-a019-98f42cd79b50 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:50.515774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c56e28ad-7fd7-48fb-a019-98f42cd79b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:50.537679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 180/357] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:50.545435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 178/358] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:50.551728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e28ad-7fd7-48fb-a019-98f42cd79b50 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:50.562024 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e28ad-7fd7-48fb-a019-98f42cd79b50 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:50.571044 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca2fe8-ad26-4ce4-9df6-7246838242c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:50.571982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca2fe8-ad26-4ce4-9df6-7246838242c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:50.572483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca2fe8-ad26-4ce4-9df6-7246838242c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:50.573009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca2fe8-ad26-4ce4-9df6-7246838242c4 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:50.573947 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca2fe8-ad26-4ce4-9df6-7246838242c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:50.576114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca2fe8-ad26-4ce4-9df6-7246838242c4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:50.608582 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 181/359] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Nov 16 00:19:50 2021] POST /identity/v3/users => generated 246 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:19:50.632930 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d42de-d361-4b63-9876-239621df2a3e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:50.649314 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d42de-d361-4b63-9876-239621df2a3e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:50.656986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585977c7-175f-486f-86db-48dcf5f048dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:50.658142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585977c7-175f-486f-86db-48dcf5f048dd admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:50.658634 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585977c7-175f-486f-86db-48dcf5f048dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:50.659142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585977c7-175f-486f-86db-48dcf5f048dd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:50.676836 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585977c7-175f-486f-86db-48dcf5f048dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:50.679144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585977c7-175f-486f-86db-48dcf5f048dd admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:50.702486 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-585977c7-175f-486f-86db-48dcf5f048dd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:50.704215 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 179/360] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:50.713210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca2fe8-ad26-4ce4-9df6-7246838242c4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:50.728403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca2fe8-ad26-4ce4-9df6-7246838242c4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:50.736560 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304dfab-281a-4313-9571-80713e6db15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:50.737700 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304dfab-281a-4313-9571-80713e6db15e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:50.738201 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304dfab-281a-4313-9571-80713e6db15e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:50.738687 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304dfab-281a-4313-9571-80713e6db15e admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:50.739690 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304dfab-281a-4313-9571-80713e6db15e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:50.740288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304dfab-281a-4313-9571-80713e6db15e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:50.742263 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304dfab-281a-4313-9571-80713e6db15e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:50.759790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 182/361] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:50.766608 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585977c7-175f-486f-86db-48dcf5f048dd admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:50.778956 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585977c7-175f-486f-86db-48dcf5f048dd admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:50.787481 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce6302-caae-4369-a1be-1170b125f411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:50.788564 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce6302-caae-4369-a1be-1170b125f411 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:50.789059 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce6302-caae-4369-a1be-1170b125f411 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:50.789541 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce6302-caae-4369-a1be-1170b125f411 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:50.790488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce6302-caae-4369-a1be-1170b125f411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:50.791816 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-09ce6302-caae-4369-a1be-1170b125f411 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:50.791816 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:19:50.791816 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:19:50.793422 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce6302-caae-4369-a1be-1170b125f411 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:50.837495 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 180/362] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Nov 16 00:19:50 2021] POST /identity/v3/users => generated 248 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:19:50.849568 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d8f5d-f603-4e66-8129-4b57c026bed5 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:50.850226 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d8f5d-f603-4e66-8129-4b57c026bed5 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:50.850707 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d8f5d-f603-4e66-8129-4b57c026bed5 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:50.853236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 183/363] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:50.869158 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca031683-9744-47c7-92ff-7a1baa8e032c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:50.869811 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca031683-9744-47c7-92ff-7a1baa8e032c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:50.870380 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca031683-9744-47c7-92ff-7a1baa8e032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:50.900094 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-ca031683-9744-47c7-92ff-7a1baa8e032c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:50.901782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ca031683-9744-47c7-92ff-7a1baa8e032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:50.911139 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 181/364] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:50.942253 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d8f5d-f603-4e66-8129-4b57c026bed5 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:50.959381 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d8f5d-f603-4e66-8129-4b57c026bed5 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:50.964832 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc1b61-85a2-490a-93aa-e4ce8198f5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:50.966069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc1b61-85a2-490a-93aa-e4ce8198f5cf admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:50.966619 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc1b61-85a2-490a-93aa-e4ce8198f5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:50.967230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc1b61-85a2-490a-93aa-e4ce8198f5cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:50.984344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc1b61-85a2-490a-93aa-e4ce8198f5cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:50.986637 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc1b61-85a2-490a-93aa-e4ce8198f5cf admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:51.007441 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-54dc1b61-85a2-490a-93aa-e4ce8198f5cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:51.009409 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 184/365] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:51.015603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca031683-9744-47c7-92ff-7a1baa8e032c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:51.029147 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca031683-9744-47c7-92ff-7a1baa8e032c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:51.035232 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2aacaa-3633-4136-8f76-d7b221e4b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:51.036417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2aacaa-3633-4136-8f76-d7b221e4b859 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:51.036916 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2aacaa-3633-4136-8f76-d7b221e4b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:51.037422 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2aacaa-3633-4136-8f76-d7b221e4b859 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:51.038367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2aacaa-3633-4136-8f76-d7b221e4b859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:51.038911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2aacaa-3633-4136-8f76-d7b221e4b859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:51.040849 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2aacaa-3633-4136-8f76-d7b221e4b859 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:51.057184 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 182/366] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:51.064247 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc1b61-85a2-490a-93aa-e4ce8198f5cf admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:51.077308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc1b61-85a2-490a-93aa-e4ce8198f5cf admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:51.085434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca4b7f-d7c1-486f-8597-bf93429a0448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:51.086131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca4b7f-d7c1-486f-8597-bf93429a0448 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:51.086405 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca4b7f-d7c1-486f-8597-bf93429a0448 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:51.086686 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca4b7f-d7c1-486f-8597-bf93429a0448 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:51.087618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca4b7f-d7c1-486f-8597-bf93429a0448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:51.089680 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca4b7f-d7c1-486f-8597-bf93429a0448 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:51.122793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 185/367] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Nov 16 00:19:51 2021] POST /identity/v3/users => generated 248 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:19:51.192330 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd9262-45ed-4fa8-bf6d-b0834c37a3c8 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:51.192621 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd9262-45ed-4fa8-bf6d-b0834c37a3c8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:51.192906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd9262-45ed-4fa8-bf6d-b0834c37a3c8 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:51.195218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 183/368] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:51.204299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd4757-17ad-4e95-b018-1c92fc24b853 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:51.204610 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd4757-17ad-4e95-b018-1c92fc24b853 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:51.204868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd4757-17ad-4e95-b018-1c92fc24b853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:51.226614 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-59bd4757-17ad-4e95-b018-1c92fc24b853 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:51.227954 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-59bd4757-17ad-4e95-b018-1c92fc24b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:51.242739 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 186/369] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:51.270246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd9262-45ed-4fa8-bf6d-b0834c37a3c8 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:51.285609 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd9262-45ed-4fa8-bf6d-b0834c37a3c8 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:51.290785 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2e01f-0b57-436b-82d2-de2307b9bc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:51.291681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2e01f-0b57-436b-82d2-de2307b9bc08 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:51.291966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2e01f-0b57-436b-82d2-de2307b9bc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:51.292299 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2e01f-0b57-436b-82d2-de2307b9bc08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:51.304879 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2e01f-0b57-436b-82d2-de2307b9bc08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:51.309675 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2e01f-0b57-436b-82d2-de2307b9bc08 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:51.328037 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-51a2e01f-0b57-436b-82d2-de2307b9bc08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:51.335020 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 184/370] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:51.336696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd4757-17ad-4e95-b018-1c92fc24b853 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:51.350193 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd4757-17ad-4e95-b018-1c92fc24b853 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:51.356226 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bceb456-af32-4cb1-8f66-270dd8571c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:51.357108 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceb456-af32-4cb1-8f66-270dd8571c0b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:51.357571 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceb456-af32-4cb1-8f66-270dd8571c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:51.358026 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceb456-af32-4cb1-8f66-270dd8571c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:51.359017 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bceb456-af32-4cb1-8f66-270dd8571c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:51.359524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bceb456-af32-4cb1-8f66-270dd8571c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:51.361321 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bceb456-af32-4cb1-8f66-270dd8571c0b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:51.378940 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 187/371] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:51.381350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2e01f-0b57-436b-82d2-de2307b9bc08 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:51.391664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2e01f-0b57-436b-82d2-de2307b9bc08 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:51.399444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61c932-74b3-4f9c-a09f-7a000d07797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:51.400399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61c932-74b3-4f9c-a09f-7a000d07797d admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:51.400861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61c932-74b3-4f9c-a09f-7a000d07797d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:51.401313 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61c932-74b3-4f9c-a09f-7a000d07797d admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:51.402260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61c932-74b3-4f9c-a09f-7a000d07797d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:51.405413 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61c932-74b3-4f9c-a09f-7a000d07797d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:51.438415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 185/372] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Nov 16 00:19:51 2021] POST /identity/v3/users => generated 249 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:19:51.953774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d172a1-64bd-4690-8944-740e81d16365 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:51.954401 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d172a1-64bd-4690-8944-740e81d16365 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:51.954937 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d172a1-64bd-4690-8944-740e81d16365 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:51.956989 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 188/373] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:51.964816 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729018c6-b477-4862-bc20-2f19d8222936 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:51.965109 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729018c6-b477-4862-bc20-2f19d8222936 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:51.965389 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729018c6-b477-4862-bc20-2f19d8222936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:51.987050 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-729018c6-b477-4862-bc20-2f19d8222936 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:51.988863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-729018c6-b477-4862-bc20-2f19d8222936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:51.996565 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 186/374] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:52.041725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d172a1-64bd-4690-8944-740e81d16365 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:52.060537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d172a1-64bd-4690-8944-740e81d16365 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:52.065856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebee22-913a-44b7-8dd1-24d5ec564d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:52.066863 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebee22-913a-44b7-8dd1-24d5ec564d00 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:52.067353 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebee22-913a-44b7-8dd1-24d5ec564d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:52.067832 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebee22-913a-44b7-8dd1-24d5ec564d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:52.068784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebee22-913a-44b7-8dd1-24d5ec564d00 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:52.070613 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebee22-913a-44b7-8dd1-24d5ec564d00 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:52.082911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.sql.core [None req-cdebee22-913a-44b7-8dd1-24d5ec564d00 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 16 00:19:52.082911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 16 00:19:52.082911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [parameters: {'id': '14a0d226473c454ab974b6233e5727ee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 16 00:19:52.082911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86000) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 16 00:19:52.098278 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-cdebee22-913a-44b7-8dd1-24d5ec564d00 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 16 00:19:52.100355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 189/375] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:19:52 2021] POST /identity/v3/roles => generated 144 bytes in 59 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:52.106546 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729018c6-b477-4862-bc20-2f19d8222936 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:52.119908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729018c6-b477-4862-bc20-2f19d8222936 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:52.131598 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf2c4a-e630-4558-b715-f5f1376f5c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:52.132417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf2c4a-e630-4558-b715-f5f1376f5c69 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:52.132701 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf2c4a-e630-4558-b715-f5f1376f5c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:52.132978 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf2c4a-e630-4558-b715-f5f1376f5c69 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:52.155774 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf2c4a-e630-4558-b715-f5f1376f5c69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:52.163778 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-eecf2c4a-e630-4558-b715-f5f1376f5c69 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 00:19:52.165007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 187/376] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:19:52 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:52.171554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebee22-913a-44b7-8dd1-24d5ec564d00 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:52.193070 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebee22-913a-44b7-8dd1-24d5ec564d00 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:52.198162 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030ce7f-cef9-42b1-ac53-78cd4b651a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:52.199158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030ce7f-cef9-42b1-ac53-78cd4b651a19 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:52.199667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030ce7f-cef9-42b1-ac53-78cd4b651a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:52.200168 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030ce7f-cef9-42b1-ac53-78cd4b651a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:52.201170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030ce7f-cef9-42b1-ac53-78cd4b651a19 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:52.201726 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030ce7f-cef9-42b1-ac53-78cd4b651a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:52.203565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030ce7f-cef9-42b1-ac53-78cd4b651a19 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:52.213213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 190/377] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:52 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:53.584121 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f22daf-faf7-4a0e-b122-15342e55d564 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:53.584637 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f22daf-faf7-4a0e-b122-15342e55d564 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:53.584713 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f22daf-faf7-4a0e-b122-15342e55d564 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:53.586741 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 188/378] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:53.594091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba04051-f172-4349-b69a-aba3a868145b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:53.594513 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba04051-f172-4349-b69a-aba3a868145b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:53.594688 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba04051-f172-4349-b69a-aba3a868145b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:53.612660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-9ba04051-f172-4349-b69a-aba3a868145b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:53.613861 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9ba04051-f172-4349-b69a-aba3a868145b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:53.621829 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 191/379] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:53.651477 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f22daf-faf7-4a0e-b122-15342e55d564 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:53.667604 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f22daf-faf7-4a0e-b122-15342e55d564 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:53.672125 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9163b4-5e5a-42a4-afc0-997706c7b628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:53.672921 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9163b4-5e5a-42a4-afc0-997706c7b628 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:53.673202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9163b4-5e5a-42a4-afc0-997706c7b628 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:53.673480 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9163b4-5e5a-42a4-afc0-997706c7b628 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:53.695736 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9163b4-5e5a-42a4-afc0-997706c7b628 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:53.704778 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-dc9163b4-5e5a-42a4-afc0-997706c7b628 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:19:53.704778 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 189/380] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:19:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:53.712888 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba04051-f172-4349-b69a-aba3a868145b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:53.730105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba04051-f172-4349-b69a-aba3a868145b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:53.739023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80940d-97a3-4f9c-8784-0ee7cd7ddb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:53.739704 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80940d-97a3-4f9c-8784-0ee7cd7ddb49 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:53.739995 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80940d-97a3-4f9c-8784-0ee7cd7ddb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:53.740274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80940d-97a3-4f9c-8784-0ee7cd7ddb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:53.741033 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80940d-97a3-4f9c-8784-0ee7cd7ddb49 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:53.741339 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80940d-97a3-4f9c-8784-0ee7cd7ddb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:53.742972 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80940d-97a3-4f9c-8784-0ee7cd7ddb49 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:53.757214 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 192/381] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:19:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:53.763208 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9163b4-5e5a-42a4-afc0-997706c7b628 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:53.777145 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9163b4-5e5a-42a4-afc0-997706c7b628 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:53.792494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de797e-82dd-4fbf-924e-e4524d30cec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:53.793299 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de797e-82dd-4fbf-924e-e4524d30cec1 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:53.793741 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de797e-82dd-4fbf-924e-e4524d30cec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:53.794026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de797e-82dd-4fbf-924e-e4524d30cec1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:53.798306 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6d84e-0729-426b-a966-feadf91583f8 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:53.798597 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6d84e-0729-426b-a966-feadf91583f8 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:53.798894 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6d84e-0729-426b-a966-feadf91583f8 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:53.800880 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 193/382] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:53.808249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368251ae-4c3a-44ac-b018-d7bbae404e8b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:53.808538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368251ae-4c3a-44ac-b018-d7bbae404e8b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:53.808818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368251ae-4c3a-44ac-b018-d7bbae404e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:53.811525 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de797e-82dd-4fbf-924e-e4524d30cec1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:53.813371 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de797e-82dd-4fbf-924e-e4524d30cec1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:53.838537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-368251ae-4c3a-44ac-b018-d7bbae404e8b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:53.839701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-368251ae-4c3a-44ac-b018-d7bbae404e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:53.843103 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-a4de797e-82dd-4fbf-924e-e4524d30cec1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:53.844369 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 190/383] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:53.856143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de797e-82dd-4fbf-924e-e4524d30cec1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:53.863905 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 194/384] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:53.876542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de797e-82dd-4fbf-924e-e4524d30cec1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:53.885508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d83563-acb0-46bf-8625-f27cf8ed5b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:53.886165 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d83563-acb0-46bf-8625-f27cf8ed5b1a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:53.886451 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d83563-acb0-46bf-8625-f27cf8ed5b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:53.886730 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d83563-acb0-46bf-8625-f27cf8ed5b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:53.887490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d83563-acb0-46bf-8625-f27cf8ed5b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:53.887798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d83563-acb0-46bf-8625-f27cf8ed5b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:53.889437 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d83563-acb0-46bf-8625-f27cf8ed5b1a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:53.906249 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 191/385] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:53.912922 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368251ae-4c3a-44ac-b018-d7bbae404e8b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:53.929638 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d83563-acb0-46bf-8625-f27cf8ed5b1a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:53.930964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368251ae-4c3a-44ac-b018-d7bbae404e8b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:53.940509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d83563-acb0-46bf-8625-f27cf8ed5b1a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:53.942414 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4454d-1e16-4191-94af-0495a371e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:53.943431 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4454d-1e16-4191-94af-0495a371e194 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:53.943718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4454d-1e16-4191-94af-0495a371e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:53.943989 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4454d-1e16-4191-94af-0495a371e194 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:53.946280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957e3cf-5f56-4143-ad9d-3277280668f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:53.947329 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957e3cf-5f56-4143-ad9d-3277280668f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:53.947863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957e3cf-5f56-4143-ad9d-3277280668f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:53.948290 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957e3cf-5f56-4143-ad9d-3277280668f3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:53.959093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4454d-1e16-4191-94af-0495a371e194 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:53.961129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4454d-1e16-4191-94af-0495a371e194 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:53.963662 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957e3cf-5f56-4143-ad9d-3277280668f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:53.974118 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-7957e3cf-5f56-4143-ad9d-3277280668f3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:19:53.975572 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 192/386] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:19:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:53.982043 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0f3b-a54d-4913-836f-9735b2e31462 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:53.982163 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-afb4454d-1e16-4191-94af-0495a371e194 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 00:19:53.982820 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0f3b-a54d-4913-836f-9735b2e31462 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:53.983324 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0f3b-a54d-4913-836f-9735b2e31462 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:53.983942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 195/387] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Nov 16 00:19:53 2021] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:53.984836 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4454d-1e16-4191-94af-0495a371e194 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:53.985886 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 193/388] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:53 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:53.995800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe0f3b-a54d-4913-836f-9735b2e31462 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.006803 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4454d-1e16-4191-94af-0495a371e194 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.011853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2efaf-38e9-4219-a43c-2f3e4c1c5e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.012756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2efaf-38e9-4219-a43c-2f3e4c1c5e68 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.013270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2efaf-38e9-4219-a43c-2f3e4c1c5e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.013464 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe0f3b-a54d-4913-836f-9735b2e31462 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.013936 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2efaf-38e9-4219-a43c-2f3e4c1c5e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.014929 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2efaf-38e9-4219-a43c-2f3e4c1c5e68 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.015456 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2efaf-38e9-4219-a43c-2f3e4c1c5e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.017304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2efaf-38e9-4219-a43c-2f3e4c1c5e68 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.018191 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afa50c-679f-4585-905d-f77201fcd6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.019000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afa50c-679f-4585-905d-f77201fcd6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.019358 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afa50c-679f-4585-905d-f77201fcd6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.020182 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afa50c-679f-4585-905d-f77201fcd6b2 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.021101 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afa50c-679f-4585-905d-f77201fcd6b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.021832 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afa50c-679f-4585-905d-f77201fcd6b2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.022928 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-54afa50c-679f-4585-905d-f77201fcd6b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:54.022928 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:19:54.022928 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:19:54.024124 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afa50c-679f-4585-905d-f77201fcd6b2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.033057 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 196/389] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:19:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.035461 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541fc6-9b13-4880-a837-a49485e428cc None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.036035 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541fc6-9b13-4880-a837-a49485e428cc None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.036534 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541fc6-9b13-4880-a837-a49485e428cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.061248 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-58541fc6-9b13-4880-a837-a49485e428cc None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:54.062163 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-58541fc6-9b13-4880-a837-a49485e428cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:54.073212 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 194/390] 10.222.0.50 () {56 vars in 1154 bytes} [Tue Nov 16 00:19:53 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:54.074322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afa50c-679f-4585-905d-f77201fcd6b2 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.075008 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 197/391] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:54.088052 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58541fc6-9b13-4880-a837-a49485e428cc None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.090125 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afa50c-679f-4585-905d-f77201fcd6b2 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.100727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58541fc6-9b13-4880-a837-a49485e428cc None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.106009 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5590947-ad05-49e6-b8c0-733d76f37f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.106389 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3017f44-723d-411a-846b-c39dfa3f404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.106862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590947-ad05-49e6-b8c0-733d76f37f69 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.107175 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590947-ad05-49e6-b8c0-733d76f37f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.107458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590947-ad05-49e6-b8c0-733d76f37f69 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.108023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017f44-723d-411a-846b-c39dfa3f404f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.108540 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017f44-723d-411a-846b-c39dfa3f404f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.109024 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017f44-723d-411a-846b-c39dfa3f404f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.118967 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3017f44-723d-411a-846b-c39dfa3f404f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.121377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3017f44-723d-411a-846b-c39dfa3f404f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.121945 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5590947-ad05-49e6-b8c0-733d76f37f69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.123867 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5590947-ad05-49e6-b8c0-733d76f37f69 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.131058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 198/392] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:54.132086 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3017f44-723d-411a-846b-c39dfa3f404f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.141133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3017f44-723d-411a-846b-c39dfa3f404f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.144847 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-b5590947-ad05-49e6-b8c0-733d76f37f69 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:54.145767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312925d7-9f37-4194-9abc-b42d8a4fc48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.146917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 195/393] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:54.147038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312925d7-9f37-4194-9abc-b42d8a4fc48c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.147038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312925d7-9f37-4194-9abc-b42d8a4fc48c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.147191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312925d7-9f37-4194-9abc-b42d8a4fc48c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.147382 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59861bf3-7aa3-47e0-a975-4e9d8bd004e1 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.147599 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59861bf3-7aa3-47e0-a975-4e9d8bd004e1 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.147903 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59861bf3-7aa3-47e0-a975-4e9d8bd004e1 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.149750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 196/394] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:54.151603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59861bf3-7aa3-47e0-a975-4e9d8bd004e1 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.162182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312925d7-9f37-4194-9abc-b42d8a4fc48c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:54.166979 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59861bf3-7aa3-47e0-a975-4e9d8bd004e1 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.169166 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-312925d7-9f37-4194-9abc-b42d8a4fc48c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:19:54.170381 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 199/395] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:54.171170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312925d7-9f37-4194-9abc-b42d8a4fc48c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.172231 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49226964-1750-43fc-9ebb-c7d072bbe5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.173076 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49226964-1750-43fc-9ebb-c7d072bbe5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.173452 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49226964-1750-43fc-9ebb-c7d072bbe5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.173798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49226964-1750-43fc-9ebb-c7d072bbe5f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.183884 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312925d7-9f37-4194-9abc-b42d8a4fc48c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.185699 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49226964-1750-43fc-9ebb-c7d072bbe5f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.187639 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49226964-1750-43fc-9ebb-c7d072bbe5f0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.188692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883c10e-fee2-4bd4-8884-5ec49314c1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.189347 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883c10e-fee2-4bd4-8884-5ec49314c1ca admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.189636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883c10e-fee2-4bd4-8884-5ec49314c1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.189920 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883c10e-fee2-4bd4-8884-5ec49314c1ca admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.190792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883c10e-fee2-4bd4-8884-5ec49314c1ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.191223 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883c10e-fee2-4bd4-8884-5ec49314c1ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.192828 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883c10e-fee2-4bd4-8884-5ec49314c1ca admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.203864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-49226964-1750-43fc-9ebb-c7d072bbe5f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:54.210573 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 200/396] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.210732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 197/397] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:54.210824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76296b-046a-4c47-a2b1-0464884bf734 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.210824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76296b-046a-4c47-a2b1-0464884bf734 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.211068 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49226964-1750-43fc-9ebb-c7d072bbe5f0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.211159 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76296b-046a-4c47-a2b1-0464884bf734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.225061 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49226964-1750-43fc-9ebb-c7d072bbe5f0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.228052 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-0d76296b-046a-4c47-a2b1-0464884bf734 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:54.229251 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0d76296b-046a-4c47-a2b1-0464884bf734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:54.229610 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475581f-427b-44ca-b5f8-a83133af2da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.230267 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475581f-427b-44ca-b5f8-a83133af2da2 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.230550 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475581f-427b-44ca-b5f8-a83133af2da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.230829 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475581f-427b-44ca-b5f8-a83133af2da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.231599 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475581f-427b-44ca-b5f8-a83133af2da2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.231906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475581f-427b-44ca-b5f8-a83133af2da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.233503 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475581f-427b-44ca-b5f8-a83133af2da2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.237168 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 201/398] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:54.247778 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 198/399] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.247778 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475581f-427b-44ca-b5f8-a83133af2da2 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.248018 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76296b-046a-4c47-a2b1-0464884bf734 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.257665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76296b-046a-4c47-a2b1-0464884bf734 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.260528 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475581f-427b-44ca-b5f8-a83133af2da2 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.262430 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16682c-f473-4012-a97e-5577c8936380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.263271 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16682c-f473-4012-a97e-5577c8936380 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.263562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16682c-f473-4012-a97e-5577c8936380 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.263840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16682c-f473-4012-a97e-5577c8936380 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.264713 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16682c-f473-4012-a97e-5577c8936380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.265025 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16682c-f473-4012-a97e-5577c8936380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.266267 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e7e28-2732-435a-b2af-fae44cc06a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.266693 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16682c-f473-4012-a97e-5577c8936380 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.267090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e7e28-2732-435a-b2af-fae44cc06a85 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.267377 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e7e28-2732-435a-b2af-fae44cc06a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.267656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e7e28-2732-435a-b2af-fae44cc06a85 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.275206 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e7e28-2732-435a-b2af-fae44cc06a85 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.277601 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e7e28-2732-435a-b2af-fae44cc06a85 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.279184 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 202/400] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.280153 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16682c-f473-4012-a97e-5577c8936380 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.292451 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-7a3e7e28-2732-435a-b2af-fae44cc06a85 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 16 00:19:54.297436 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16682c-f473-4012-a97e-5577c8936380 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.297570 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 199/401] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:54.297570 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e7e28-2732-435a-b2af-fae44cc06a85 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.303203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cf044-2a0b-489c-aa97-5d32041f20bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.303985 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cf044-2a0b-489c-aa97-5d32041f20bb admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.304272 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cf044-2a0b-489c-aa97-5d32041f20bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.304551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cf044-2a0b-489c-aa97-5d32041f20bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.307365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e7e28-2732-435a-b2af-fae44cc06a85 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.311525 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe248db7-5858-40c7-9948-b9f29a4fa5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.312231 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248db7-5858-40c7-9948-b9f29a4fa5af admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.312516 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248db7-5858-40c7-9948-b9f29a4fa5af admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.312803 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248db7-5858-40c7-9948-b9f29a4fa5af admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.315419 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cf044-2a0b-489c-aa97-5d32041f20bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.317945 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cf044-2a0b-489c-aa97-5d32041f20bb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.324118 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe248db7-5858-40c7-9948-b9f29a4fa5af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:54.332812 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-fe248db7-5858-40c7-9948-b9f29a4fa5af admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:19:54.339138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 200/402] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:54.339138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe248db7-5858-40c7-9948-b9f29a4fa5af admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.339316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-625cf044-2a0b-489c-aa97-5d32041f20bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:54.339316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 203/403] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:54.341042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cf044-2a0b-489c-aa97-5d32041f20bb admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.351854 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cf044-2a0b-489c-aa97-5d32041f20bb admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.353182 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe248db7-5858-40c7-9948-b9f29a4fa5af admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.356532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24577279-2540-4833-bc0b-531487c64e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.357185 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24577279-2540-4833-bc0b-531487c64e7b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.357473 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24577279-2540-4833-bc0b-531487c64e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.357754 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24577279-2540-4833-bc0b-531487c64e7b admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.357951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e491b-cc7a-4308-b850-230784acda56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.358587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24577279-2540-4833-bc0b-531487c64e7b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.358694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e491b-cc7a-4308-b850-230784acda56 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.358935 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24577279-2540-4833-bc0b-531487c64e7b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.359030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e491b-cc7a-4308-b850-230784acda56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.359295 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e491b-cc7a-4308-b850-230784acda56 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.359992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-24577279-2540-4833-bc0b-531487c64e7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:54.359992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:19:54.359992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:19:54.361125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24577279-2540-4833-bc0b-531487c64e7b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.366334 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e491b-cc7a-4308-b850-230784acda56 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.368318 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e491b-cc7a-4308-b850-230784acda56 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.381350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-140e491b-cc7a-4308-b850-230784acda56 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:19:54.387807 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 201/404] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:54.387807 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e491b-cc7a-4308-b850-230784acda56 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.398247 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e491b-cc7a-4308-b850-230784acda56 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.400005 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 204/405] 10.222.0.50 () {56 vars in 1158 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.403746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24577279-2540-4833-bc0b-531487c64e7b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.407786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d0aea-7644-4956-b601-401a0861792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.408439 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d0aea-7644-4956-b601-401a0861792e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.408728 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d0aea-7644-4956-b601-401a0861792e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.409004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d0aea-7644-4956-b601-401a0861792e admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.409860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d0aea-7644-4956-b601-401a0861792e admin admin] RBAC: Adding query filter params (name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.410172 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d0aea-7644-4956-b601-401a0861792e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.411815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d0aea-7644-4956-b601-401a0861792e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.414130 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24577279-2540-4833-bc0b-531487c64e7b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.418826 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d360c4-522f-4e01-b41f-e2c6831f9235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.419581 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d360c4-522f-4e01-b41f-e2c6831f9235 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.419870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d360c4-522f-4e01-b41f-e2c6831f9235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.420373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d360c4-522f-4e01-b41f-e2c6831f9235 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.420474 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 202/406] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.420954 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d0aea-7644-4956-b601-401a0861792e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.423718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d360c4-522f-4e01-b41f-e2c6831f9235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.424239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d360c4-522f-4e01-b41f-e2c6831f9235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.426928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d360c4-522f-4e01-b41f-e2c6831f9235 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.430690 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d0aea-7644-4956-b601-401a0861792e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.435147 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36674ff4-f68f-4d73-be15-568dfa390c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.435773 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36674ff4-f68f-4d73-be15-568dfa390c76 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.436067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36674ff4-f68f-4d73-be15-568dfa390c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.436346 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36674ff4-f68f-4d73-be15-568dfa390c76 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.437114 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36674ff4-f68f-4d73-be15-568dfa390c76 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.437427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36674ff4-f68f-4d73-be15-568dfa390c76 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.438426 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-36674ff4-f68f-4d73-be15-568dfa390c76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:54.438426 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:19:54.438426 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:19:54.438634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 205/407] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.439437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d360c4-522f-4e01-b41f-e2c6831f9235 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.445426 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36674ff4-f68f-4d73-be15-568dfa390c76 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.449581 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d360c4-522f-4e01-b41f-e2c6831f9235 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.453958 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191ea0-d53a-45f4-8025-daf4e0700a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.454580 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191ea0-d53a-45f4-8025-daf4e0700a01 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.454894 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191ea0-d53a-45f4-8025-daf4e0700a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.455181 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191ea0-d53a-45f4-8025-daf4e0700a01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.463068 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93191ea0-d53a-45f4-8025-daf4e0700a01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.464887 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93191ea0-d53a-45f4-8025-daf4e0700a01 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.465236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 203/408] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.466169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36674ff4-f68f-4d73-be15-568dfa390c76 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.474498 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 206/409] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:54.475246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191ea0-d53a-45f4-8025-daf4e0700a01 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.483819 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36674ff4-f68f-4d73-be15-568dfa390c76 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.487208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191ea0-d53a-45f4-8025-daf4e0700a01 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.489041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346c70f-91de-4b54-b2b6-7ffe0854b48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.489912 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346c70f-91de-4b54-b2b6-7ffe0854b48a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.490203 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346c70f-91de-4b54-b2b6-7ffe0854b48a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.490485 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346c70f-91de-4b54-b2b6-7ffe0854b48a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.492455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ba6cd-1f03-422d-8961-333bb26c929b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.493228 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ba6cd-1f03-422d-8961-333bb26c929b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.493519 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ba6cd-1f03-422d-8961-333bb26c929b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.493800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ba6cd-1f03-422d-8961-333bb26c929b admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.501562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ba6cd-1f03-422d-8961-333bb26c929b admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.501849 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346c70f-91de-4b54-b2b6-7ffe0854b48a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.504233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ba6cd-1f03-422d-8961-333bb26c929b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.504916 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346c70f-91de-4b54-b2b6-7ffe0854b48a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.517498 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-3c1ba6cd-1f03-422d-8961-333bb26c929b admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 16 00:19:54.518679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 207/410] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/users/cinder => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:54.518679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ba6cd-1f03-422d-8961-333bb26c929b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.529500 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ba6cd-1f03-422d-8961-333bb26c929b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.529615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-1346c70f-91de-4b54-b2b6-7ffe0854b48a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:54.536200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 204/411] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:54.536200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346c70f-91de-4b54-b2b6-7ffe0854b48a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.539941 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9023f9-9ed4-4ede-a1f6-a0b6214d714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.540588 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9023f9-9ed4-4ede-a1f6-a0b6214d714b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.540874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9023f9-9ed4-4ede-a1f6-a0b6214d714b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.541158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9023f9-9ed4-4ede-a1f6-a0b6214d714b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.541734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346c70f-91de-4b54-b2b6-7ffe0854b48a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.541982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9023f9-9ed4-4ede-a1f6-a0b6214d714b admin admin] RBAC: Adding query filter params (role.id=de4c885bb354403b98a2f1aefb43754e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=442cc0e13dcb49f0a4a870c06e0edf1d) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.542296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9023f9-9ed4-4ede-a1f6-a0b6214d714b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.544182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9023f9-9ed4-4ede-a1f6-a0b6214d714b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.546385 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cc8ac-a793-4510-923d-f71c20a1db78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.547606 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cc8ac-a793-4510-923d-f71c20a1db78 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.547898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cc8ac-a793-4510-923d-f71c20a1db78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.548457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cc8ac-a793-4510-923d-f71c20a1db78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.550006 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 208/412] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/role_assignments?user.id=442cc0e13dcb49f0a4a870c06e0edf1d&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=de4c885bb354403b98a2f1aefb43754e => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.550728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9023f9-9ed4-4ede-a1f6-a0b6214d714b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.560587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9023f9-9ed4-4ede-a1f6-a0b6214d714b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.565284 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2789d9-2aa7-4b21-941d-7ca79aab3715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.566043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2789d9-2aa7-4b21-941d-7ca79aab3715 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.566322 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2789d9-2aa7-4b21-941d-7ca79aab3715 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.566626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2789d9-2aa7-4b21-941d-7ca79aab3715 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.567588 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2789d9-2aa7-4b21-941d-7ca79aab3715 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.567913 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2789d9-2aa7-4b21-941d-7ca79aab3715 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.569828 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2789d9-2aa7-4b21-941d-7ca79aab3715 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.570192 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cc8ac-a793-4510-923d-f71c20a1db78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.573656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cc8ac-a793-4510-923d-f71c20a1db78 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.599025 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 209/413] 10.222.0.50 () {56 vars in 1158 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.599025 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2789d9-2aa7-4b21-941d-7ca79aab3715 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.605734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-ea4cc8ac-a793-4510-923d-f71c20a1db78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:54.608042 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 205/414] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:54.609262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cc8ac-a793-4510-923d-f71c20a1db78 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.609393 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2789d9-2aa7-4b21-941d-7ca79aab3715 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.614791 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c049715-8f93-4478-a16b-b13641c510ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.615567 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c049715-8f93-4478-a16b-b13641c510ec admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.615854 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c049715-8f93-4478-a16b-b13641c510ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.616132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c049715-8f93-4478-a16b-b13641c510ec admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.616931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c049715-8f93-4478-a16b-b13641c510ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.617424 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c049715-8f93-4478-a16b-b13641c510ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.619245 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c049715-8f93-4478-a16b-b13641c510ec admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.623782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cc8ac-a793-4510-923d-f71c20a1db78 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.630897 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985faade-ba0c-4568-a7f1-e653fda27f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.631926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985faade-ba0c-4568-a7f1-e653fda27f8c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.632436 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985faade-ba0c-4568-a7f1-e653fda27f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.632911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985faade-ba0c-4568-a7f1-e653fda27f8c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.633015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 210/415] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.633970 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c049715-8f93-4478-a16b-b13641c510ec admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.647764 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985faade-ba0c-4568-a7f1-e653fda27f8c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.649231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c049715-8f93-4478-a16b-b13641c510ec admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.649562 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985faade-ba0c-4568-a7f1-e653fda27f8c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.654029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7b854-eecd-4461-9909-7a3634fb1a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.654702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7b854-eecd-4461-9909-7a3634fb1a79 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.655031 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7b854-eecd-4461-9909-7a3634fb1a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.655309 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7b854-eecd-4461-9909-7a3634fb1a79 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.656106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7b854-eecd-4461-9909-7a3634fb1a79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.656504 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7b854-eecd-4461-9909-7a3634fb1a79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.658159 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7b854-eecd-4461-9909-7a3634fb1a79 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.661030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 206/416] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:54.661429 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985faade-ba0c-4568-a7f1-e653fda27f8c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.672078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985faade-ba0c-4568-a7f1-e653fda27f8c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.677142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c6286-938b-456d-a90d-51cb948f5922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.678036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c6286-938b-456d-a90d-51cb948f5922 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.678377 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c6286-938b-456d-a90d-51cb948f5922 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.678660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c6286-938b-456d-a90d-51cb948f5922 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.688059 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c6286-938b-456d-a90d-51cb948f5922 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.690307 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c6286-938b-456d-a90d-51cb948f5922 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.707739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-aa1c6286-938b-456d-a90d-51cb948f5922 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 16 00:19:54.708677 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 207/417] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/users/neutron => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:54.709518 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c6286-938b-456d-a90d-51cb948f5922 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.726681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c6286-938b-456d-a90d-51cb948f5922 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.731556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e436b3a-cfdf-48ae-93f6-5c688d7b2330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.732377 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e436b3a-cfdf-48ae-93f6-5c688d7b2330 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.732662 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e436b3a-cfdf-48ae-93f6-5c688d7b2330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.732938 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e436b3a-cfdf-48ae-93f6-5c688d7b2330 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.745573 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e436b3a-cfdf-48ae-93f6-5c688d7b2330 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.747532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e436b3a-cfdf-48ae-93f6-5c688d7b2330 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.767391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-2e436b3a-cfdf-48ae-93f6-5c688d7b2330 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:54.769571 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 208/418] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:54.770500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e436b3a-cfdf-48ae-93f6-5c688d7b2330 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.780314 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 211/419] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.781236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7b854-eecd-4461-9909-7a3634fb1a79 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.781626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e436b3a-cfdf-48ae-93f6-5c688d7b2330 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.786887 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6d6e7-b304-48e8-ac34-e969a9386609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.787618 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6d6e7-b304-48e8-ac34-e969a9386609 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.787940 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6d6e7-b304-48e8-ac34-e969a9386609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.788475 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6d6e7-b304-48e8-ac34-e969a9386609 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.789328 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6d6e7-b304-48e8-ac34-e969a9386609 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.789652 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6d6e7-b304-48e8-ac34-e969a9386609 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.791585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6d6e7-b304-48e8-ac34-e969a9386609 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.792094 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7b854-eecd-4461-9909-7a3634fb1a79 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.796625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f0bc1-bc5a-49b9-91f5-325c21e23b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.797285 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f0bc1-bc5a-49b9-91f5-325c21e23b32 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.797668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f0bc1-bc5a-49b9-91f5-325c21e23b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.798164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f0bc1-bc5a-49b9-91f5-325c21e23b32 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.799486 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f0bc1-bc5a-49b9-91f5-325c21e23b32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.799665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f0bc1-bc5a-49b9-91f5-325c21e23b32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.801382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f0bc1-bc5a-49b9-91f5-325c21e23b32 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.813565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 212/420] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.819100 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f0bc1-bc5a-49b9-91f5-325c21e23b32 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.825424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 209/421] 10.222.0.50 () {56 vars in 1160 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.826560 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6d6e7-b304-48e8-ac34-e969a9386609 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.830658 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f0bc1-bc5a-49b9-91f5-325c21e23b32 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.838324 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6d6e7-b304-48e8-ac34-e969a9386609 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.841813 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe4fc-66d6-46b6-a9c1-6d6e10b36fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.842618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe4fc-66d6-46b6-a9c1-6d6e10b36fee admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.842909 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe4fc-66d6-46b6-a9c1-6d6e10b36fee admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.843188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe4fc-66d6-46b6-a9c1-6d6e10b36fee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.846642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5945e3-28e3-4d24-a7d6-1cf28a364109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.848878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5945e3-28e3-4d24-a7d6-1cf28a364109 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.849432 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5945e3-28e3-4d24-a7d6-1cf28a364109 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.850034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5945e3-28e3-4d24-a7d6-1cf28a364109 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.851723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fe4fc-66d6-46b6-a9c1-6d6e10b36fee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.853705 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fe4fc-66d6-46b6-a9c1-6d6e10b36fee admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.858662 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5945e3-28e3-4d24-a7d6-1cf28a364109 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.861003 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5945e3-28e3-4d24-a7d6-1cf28a364109 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.867847 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-140fe4fc-66d6-46b6-a9c1-6d6e10b36fee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:19:54.869075 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 213/422] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:54.869903 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe4fc-66d6-46b6-a9c1-6d6e10b36fee admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.877101 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-8f5945e3-28e3-4d24-a7d6-1cf28a364109 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:19:54.879123 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 210/423] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:54.885004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe4fc-66d6-46b6-a9c1-6d6e10b36fee admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.885147 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5945e3-28e3-4d24-a7d6-1cf28a364109 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.890551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f937b-a7b8-42bd-bbed-f04ef5871c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.891612 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f937b-a7b8-42bd-bbed-f04ef5871c95 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.892611 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f937b-a7b8-42bd-bbed-f04ef5871c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.893039 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f937b-a7b8-42bd-bbed-f04ef5871c95 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.896755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5945e3-28e3-4d24-a7d6-1cf28a364109 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.902166 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa50b4-e31d-4b36-9b56-3c10abfb3f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.903254 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa50b4-e31d-4b36-9b56-3c10abfb3f85 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.903678 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa50b4-e31d-4b36-9b56-3c10abfb3f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.903886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f937b-a7b8-42bd-bbed-f04ef5871c95 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.904150 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa50b4-e31d-4b36-9b56-3c10abfb3f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.905088 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa50b4-e31d-4b36-9b56-3c10abfb3f85 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.905536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa50b4-e31d-4b36-9b56-3c10abfb3f85 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.906255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f937b-a7b8-42bd-bbed-f04ef5871c95 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.907771 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa50b4-e31d-4b36-9b56-3c10abfb3f85 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.917952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 214/424] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:54.918957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f937b-a7b8-42bd-bbed-f04ef5871c95 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.930604 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f937b-a7b8-42bd-bbed-f04ef5871c95 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.933316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 211/425] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.934274 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa50b4-e31d-4b36-9b56-3c10abfb3f85 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.936897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b9cd1-715a-4916-8c81-798068611ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.937855 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b9cd1-715a-4916-8c81-798068611ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.938289 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b9cd1-715a-4916-8c81-798068611ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.938709 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b9cd1-715a-4916-8c81-798068611ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.939678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b9cd1-715a-4916-8c81-798068611ea6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.940131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b9cd1-715a-4916-8c81-798068611ea6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.942716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-cc8b9cd1-715a-4916-8c81-798068611ea6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:19:54.942716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:19:54.942716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:19:54.944491 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b9cd1-715a-4916-8c81-798068611ea6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.945997 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa50b4-e31d-4b36-9b56-3c10abfb3f85 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.954211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366f180-e09b-4de3-92e5-8ca71073b0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.955232 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f180-e09b-4de3-92e5-8ca71073b0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.955636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f180-e09b-4de3-92e5-8ca71073b0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.956079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f180-e09b-4de3-92e5-8ca71073b0b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.969730 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 215/426] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:54.976856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b9cd1-715a-4916-8c81-798068611ea6 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:54.978288 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366f180-e09b-4de3-92e5-8ca71073b0b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.980774 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366f180-e09b-4de3-92e5-8ca71073b0b9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:54.989391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b9cd1-715a-4916-8c81-798068611ea6 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:54.994816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387937d-b373-4517-94c5-f8f5f0390617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:54.995659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387937d-b373-4517-94c5-f8f5f0390617 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:54.996109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387937d-b373-4517-94c5-f8f5f0390617 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:54.996483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387937d-b373-4517-94c5-f8f5f0390617 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:54.997465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387937d-b373-4517-94c5-f8f5f0390617 admin admin] RBAC: Adding query filter params (role.id=de4c885bb354403b98a2f1aefb43754e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=8cab78404d3c4980a4b99da09edab426) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:54.997907 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387937d-b373-4517-94c5-f8f5f0390617 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:54.999962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387937d-b373-4517-94c5-f8f5f0390617 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:55.000646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-6366f180-e09b-4de3-92e5-8ca71073b0b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:55.001994 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 212/427] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:55.002984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366f180-e09b-4de3-92e5-8ca71073b0b9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:55.012563 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 216/428] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:54 2021] GET /identity/v3/role_assignments?user.id=8cab78404d3c4980a4b99da09edab426&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=de4c885bb354403b98a2f1aefb43754e => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:55.014236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387937d-b373-4517-94c5-f8f5f0390617 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:55.014544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366f180-e09b-4de3-92e5-8ca71073b0b9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:55.020655 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c2264-0440-4fd5-9be5-3ea028cad99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:55.021904 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c2264-0440-4fd5-9be5-3ea028cad99c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:55.022377 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c2264-0440-4fd5-9be5-3ea028cad99c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:55.022861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c2264-0440-4fd5-9be5-3ea028cad99c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:55.023991 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c2264-0440-4fd5-9be5-3ea028cad99c admin admin] RBAC: Adding query filter params (role.id=de4c885bb354403b98a2f1aefb43754e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=292b73337e674cdfa9c05fe67040cf94) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:55.024482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c2264-0440-4fd5-9be5-3ea028cad99c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:55.026543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387937d-b373-4517-94c5-f8f5f0390617 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:55.027071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c2264-0440-4fd5-9be5-3ea028cad99c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:55.032972 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bde7f-6149-4b49-a337-b52188c6ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:55.033767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bde7f-6149-4b49-a337-b52188c6ff54 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:55.034169 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bde7f-6149-4b49-a337-b52188c6ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:55.035316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bde7f-6149-4b49-a337-b52188c6ff54 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:55.036243 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bde7f-6149-4b49-a337-b52188c6ff54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:55.036678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bde7f-6149-4b49-a337-b52188c6ff54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:55.037636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 213/429] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:55 2021] GET /identity/v3/role_assignments?user.id=292b73337e674cdfa9c05fe67040cf94&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=de4c885bb354403b98a2f1aefb43754e => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:55.042933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bde7f-6149-4b49-a337-b52188c6ff54 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:55.055861 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 217/430] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:55.062524 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c2264-0440-4fd5-9be5-3ea028cad99c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:55.074017 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c2264-0440-4fd5-9be5-3ea028cad99c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:55.079146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e97e4d-c682-4351-9d3a-01e218133953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:55.080019 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e97e4d-c682-4351-9d3a-01e218133953 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:55.080358 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e97e4d-c682-4351-9d3a-01e218133953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:55.080635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e97e4d-c682-4351-9d3a-01e218133953 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:55.090023 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e97e4d-c682-4351-9d3a-01e218133953 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:55.092188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e97e4d-c682-4351-9d3a-01e218133953 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:55.107897 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-a6e97e4d-c682-4351-9d3a-01e218133953 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:19:55.115014 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 214/431] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:55.116631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bde7f-6149-4b49-a337-b52188c6ff54 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:55.129600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bde7f-6149-4b49-a337-b52188c6ff54 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:55.134651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e313e-f678-47dc-a1c2-bc6e54d96269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:55.135468 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e313e-f678-47dc-a1c2-bc6e54d96269 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:55.135760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e313e-f678-47dc-a1c2-bc6e54d96269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:55.136040 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e313e-f678-47dc-a1c2-bc6e54d96269 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:55.136938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e313e-f678-47dc-a1c2-bc6e54d96269 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:55.138690 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649ecc6-a21e-4df8-b2fb-8dbe58a4437a None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:55.138997 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649ecc6-a21e-4df8-b2fb-8dbe58a4437a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:55.139300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649ecc6-a21e-4df8-b2fb-8dbe58a4437a None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:55.141316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 215/432] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:55.141532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e313e-f678-47dc-a1c2-bc6e54d96269 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:55.143577 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e313e-f678-47dc-a1c2-bc6e54d96269 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:55.153749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296441d-2122-45e0-bc76-aeb81b96a751 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:55.154485 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296441d-2122-45e0-bc76-aeb81b96a751 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:55.155090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296441d-2122-45e0-bc76-aeb81b96a751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:55.162497 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 218/433] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:19:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:55.174871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e313e-f678-47dc-a1c2-bc6e54d96269 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:55.181665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e313e-f678-47dc-a1c2-bc6e54d96269 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:55.187466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eafe0b-73ae-49ef-b56f-ff7a4fbe801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:55.188204 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eafe0b-73ae-49ef-b56f-ff7a4fbe801a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:55.188494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eafe0b-73ae-49ef-b56f-ff7a4fbe801a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:55.188778 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eafe0b-73ae-49ef-b56f-ff7a4fbe801a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:55.189700 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eafe0b-73ae-49ef-b56f-ff7a4fbe801a admin admin] RBAC: Adding query filter params (role.id=de4c885bb354403b98a2f1aefb43754e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=7893cca0610b40abb9c45414f3690df0) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:55.190023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eafe0b-73ae-49ef-b56f-ff7a4fbe801a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:55.191167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f296441d-2122-45e0-bc76-aeb81b96a751 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:55.192293 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eafe0b-73ae-49ef-b56f-ff7a4fbe801a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:55.192905 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f296441d-2122-45e0-bc76-aeb81b96a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:55.198813 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 219/434] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:55 2021] GET /identity/v3/role_assignments?user.id=7893cca0610b40abb9c45414f3690df0&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=de4c885bb354403b98a2f1aefb43754e => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:55.201718 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 216/435] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:55.233482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eafe0b-73ae-49ef-b56f-ff7a4fbe801a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:55.243959 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eafe0b-73ae-49ef-b56f-ff7a4fbe801a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:55.255531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba535-3c3c-4ca1-855d-afacdb910610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:55.256447 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba535-3c3c-4ca1-855d-afacdb910610 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:55.256735 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba535-3c3c-4ca1-855d-afacdb910610 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:55.257014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba535-3c3c-4ca1-855d-afacdb910610 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:55.271243 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ba535-3c3c-4ca1-855d-afacdb910610 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:55.273127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ba535-3c3c-4ca1-855d-afacdb910610 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:55.298248 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-381ba535-3c3c-4ca1-855d-afacdb910610 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:55.299715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 220/436] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:55.307296 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296441d-2122-45e0-bc76-aeb81b96a751 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:55.318536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296441d-2122-45e0-bc76-aeb81b96a751 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:55.325007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1aa13-b2d2-4e6e-bea8-deb46a95840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:55.326071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1aa13-b2d2-4e6e-bea8-deb46a95840a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:55.326560 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1aa13-b2d2-4e6e-bea8-deb46a95840a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:55.327908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1aa13-b2d2-4e6e-bea8-deb46a95840a admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:55.328908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1aa13-b2d2-4e6e-bea8-deb46a95840a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:55.329417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1aa13-b2d2-4e6e-bea8-deb46a95840a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:55.332149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1aa13-b2d2-4e6e-bea8-deb46a95840a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:55.346028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 217/437] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:55.354459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba535-3c3c-4ca1-855d-afacdb910610 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:55.365559 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba535-3c3c-4ca1-855d-afacdb910610 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:55.370913 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f463f-dc32-4994-ba1d-8c81c15432b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:55.372084 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f463f-dc32-4994-ba1d-8c81c15432b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:55.372573 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f463f-dc32-4994-ba1d-8c81c15432b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:55.373048 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f463f-dc32-4994-ba1d-8c81c15432b2 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:55.374057 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f463f-dc32-4994-ba1d-8c81c15432b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:55.376309 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f463f-dc32-4994-ba1d-8c81c15432b2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:55.407064 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 221/438] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Nov 16 00:19:55 2021] POST /identity/v3/users => generated 247 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:19:57.248775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a380ede-9de2-4272-a46d-c41ada54c537 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.249748 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a380ede-9de2-4272-a46d-c41ada54c537 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.250226 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a380ede-9de2-4272-a46d-c41ada54c537 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.252525 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 218/439] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:57.260303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fb89c-8af9-4ff2-ad97-2813fd50c4f5 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.261183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fb89c-8af9-4ff2-ad97-2813fd50c4f5 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.261655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fb89c-8af9-4ff2-ad97-2813fd50c4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.285902 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-335fb89c-8af9-4ff2-ad97-2813fd50c4f5 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:57.287571 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-335fb89c-8af9-4ff2-ad97-2813fd50c4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:57.296038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 222/440] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:57.344360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a380ede-9de2-4272-a46d-c41ada54c537 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:57.362853 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a380ede-9de2-4272-a46d-c41ada54c537 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:57.371008 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab82487-a928-48d7-934c-6a3b39dc3316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:57.371813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab82487-a928-48d7-934c-6a3b39dc3316 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.372102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab82487-a928-48d7-934c-6a3b39dc3316 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.372380 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab82487-a928-48d7-934c-6a3b39dc3316 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.384858 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab82487-a928-48d7-934c-6a3b39dc3316 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:57.391694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-3ab82487-a928-48d7-934c-6a3b39dc3316 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:19:57.393235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 219/441] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:19:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:57.400117 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fb89c-8af9-4ff2-ad97-2813fd50c4f5 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:57.412177 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fb89c-8af9-4ff2-ad97-2813fd50c4f5 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:57.427575 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201abe-bf00-40fb-b96d-737cd9cc11ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:57.428532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201abe-bf00-40fb-b96d-737cd9cc11ee admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.428959 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201abe-bf00-40fb-b96d-737cd9cc11ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.429375 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201abe-bf00-40fb-b96d-737cd9cc11ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.430276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201abe-bf00-40fb-b96d-737cd9cc11ee admin admin] RBAC: Adding query filter params (name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:57.430725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201abe-bf00-40fb-b96d-737cd9cc11ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:57.432518 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201abe-bf00-40fb-b96d-737cd9cc11ee admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:57.442216 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 223/442] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:19:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:57.448615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab82487-a928-48d7-934c-6a3b39dc3316 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:57.463955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab82487-a928-48d7-934c-6a3b39dc3316 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:57.471063 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6de988-e9ab-4e1a-828f-98ec97d267d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:57.472224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6de988-e9ab-4e1a-828f-98ec97d267d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.472569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6de988-e9ab-4e1a-828f-98ec97d267d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.472853 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6de988-e9ab-4e1a-828f-98ec97d267d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.489043 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6de988-e9ab-4e1a-828f-98ec97d267d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:57.490954 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6de988-e9ab-4e1a-828f-98ec97d267d8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:57.508372 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-9d6de988-e9ab-4e1a-828f-98ec97d267d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:57.509883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 220/443] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:57.515918 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201abe-bf00-40fb-b96d-737cd9cc11ee admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:57.531834 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201abe-bf00-40fb-b96d-737cd9cc11ee admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:57.541910 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1ea58-2a41-4e3e-a371-a22ec487119d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:57.542871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1ea58-2a41-4e3e-a371-a22ec487119d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.543316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1ea58-2a41-4e3e-a371-a22ec487119d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.543733 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1ea58-2a41-4e3e-a371-a22ec487119d admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.544619 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1ea58-2a41-4e3e-a371-a22ec487119d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:57.545084 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1ea58-2a41-4e3e-a371-a22ec487119d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:57.546924 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1ea58-2a41-4e3e-a371-a22ec487119d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:57.567376 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 224/444] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:57.573840 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6de988-e9ab-4e1a-828f-98ec97d267d8 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:57.591952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6de988-e9ab-4e1a-828f-98ec97d267d8 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:57.601813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e60382-340e-4aa0-bfc5-4be659f16ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:57.602745 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e60382-340e-4aa0-bfc5-4be659f16ede admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.603158 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e60382-340e-4aa0-bfc5-4be659f16ede admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.603534 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e60382-340e-4aa0-bfc5-4be659f16ede admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.620027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e60382-340e-4aa0-bfc5-4be659f16ede admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:57.622223 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e60382-340e-4aa0-bfc5-4be659f16ede admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:57.639585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-61e60382-340e-4aa0-bfc5-4be659f16ede admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 00:19:57.641281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 221/445] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Nov 16 00:19:57 2021] GET /identity/v3/users/nova => generated 82 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:57.647832 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1ea58-2a41-4e3e-a371-a22ec487119d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:57.664935 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1ea58-2a41-4e3e-a371-a22ec487119d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:57.673260 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd18912-34ec-467c-a21f-88124c00ef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:57.674117 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd18912-34ec-467c-a21f-88124c00ef63 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.674543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd18912-34ec-467c-a21f-88124c00ef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.675017 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd18912-34ec-467c-a21f-88124c00ef63 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.675990 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd18912-34ec-467c-a21f-88124c00ef63 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:57.676440 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd18912-34ec-467c-a21f-88124c00ef63 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:57.678437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd18912-34ec-467c-a21f-88124c00ef63 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:57.705821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 225/446] 10.222.0.50 () {56 vars in 1154 bytes} [Tue Nov 16 00:19:57 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:57.712926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e60382-340e-4aa0-bfc5-4be659f16ede admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:57.727853 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e60382-340e-4aa0-bfc5-4be659f16ede admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:57.735457 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273b103-1cb6-4082-ab2c-c257eb0ec8de None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.735622 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bae4c-5a79-48dc-8354-9435efeb48c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:57.736054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273b103-1cb6-4082-ab2c-c257eb0ec8de None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.736470 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273b103-1cb6-4082-ab2c-c257eb0ec8de None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.736696 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bae4c-5a79-48dc-8354-9435efeb48c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.737048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bae4c-5a79-48dc-8354-9435efeb48c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.737337 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bae4c-5a79-48dc-8354-9435efeb48c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.739498 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 226/447] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:19:57.747172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5ec54-7c81-4bf1-bc30-8136304631f3 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.747727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5ec54-7c81-4bf1-bc30-8136304631f3 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.748198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5ec54-7c81-4bf1-bc30-8136304631f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.755962 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bae4c-5a79-48dc-8354-9435efeb48c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:57.758252 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bae4c-5a79-48dc-8354-9435efeb48c5 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:57.794603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-5d9bae4c-5a79-48dc-8354-9435efeb48c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:57.795784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-36b5ec54-7c81-4bf1-bc30-8136304631f3 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:57.797038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-36b5ec54-7c81-4bf1-bc30-8136304631f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:57.803626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 222/448] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:57.814882 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bae4c-5a79-48dc-8354-9435efeb48c5 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:57.815074 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 227/449] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:19:57.830859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bae4c-5a79-48dc-8354-9435efeb48c5 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:57.843763 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07326b6f-e8b3-4583-b6bb-74a3a557d8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:57.844458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07326b6f-e8b3-4583-b6bb-74a3a557d8cb admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.847311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07326b6f-e8b3-4583-b6bb-74a3a557d8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.847311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07326b6f-e8b3-4583-b6bb-74a3a557d8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.847311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07326b6f-e8b3-4583-b6bb-74a3a557d8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:57.847311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07326b6f-e8b3-4583-b6bb-74a3a557d8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:57.848492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07326b6f-e8b3-4583-b6bb-74a3a557d8cb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:57.852479 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5ec54-7c81-4bf1-bc30-8136304631f3 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:57.881538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5ec54-7c81-4bf1-bc30-8136304631f3 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:57.890882 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 223/450] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:57.896327 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07326b6f-e8b3-4583-b6bb-74a3a557d8cb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:57.914864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07326b6f-e8b3-4583-b6bb-74a3a557d8cb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:57.922861 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194e685-1f28-453e-a186-6bd5545a29bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:57.922861 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e685-1f28-453e-a186-6bd5545a29bf admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.922861 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e685-1f28-453e-a186-6bd5545a29bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.922861 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e685-1f28-453e-a186-6bd5545a29bf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.938168 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7aa3c-1f34-4947-803a-43f141b021cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:57.942865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7aa3c-1f34-4947-803a-43f141b021cd admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.942865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7aa3c-1f34-4947-803a-43f141b021cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.942865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7aa3c-1f34-4947-803a-43f141b021cd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.955004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194e685-1f28-453e-a186-6bd5545a29bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:57.956483 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7aa3c-1f34-4947-803a-43f141b021cd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:57.959217 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7aa3c-1f34-4947-803a-43f141b021cd admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:57.963453 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-5194e685-1f28-453e-a186-6bd5545a29bf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:19:57.964905 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 228/451] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:19:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:57.966353 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81996765-319b-4b1a-80bd-b54522d16ee8 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.966869 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81996765-319b-4b1a-80bd-b54522d16ee8 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.967372 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81996765-319b-4b1a-80bd-b54522d16ee8 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.969385 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 229/452] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:57.970663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67452cc-50a6-44ac-bdda-b5e0ef620acc None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.971183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67452cc-50a6-44ac-bdda-b5e0ef620acc None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.971668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67452cc-50a6-44ac-bdda-b5e0ef620acc None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:57.980216 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 230/453] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:57 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:57.980443 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-6cd7aa3c-1f34-4947-803a-43f141b021cd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:19:57.981438 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67452cc-50a6-44ac-bdda-b5e0ef620acc None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:57.982565 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 224/454] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:57.984036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcc7df-fcbe-40d6-a805-ae0475295f18 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:57.984520 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcc7df-fcbe-40d6-a805-ae0475295f18 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:57.984989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcc7df-fcbe-40d6-a805-ae0475295f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.004164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67452cc-50a6-44ac-bdda-b5e0ef620acc None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.007033 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-12fcc7df-fcbe-40d6-a805-ae0475295f18 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:58.008534 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-12fcc7df-fcbe-40d6-a805-ae0475295f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:58.011021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a2a5-a4d2-4360-b1a7-664b838c8ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.012348 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a2a5-a4d2-4360-b1a7-664b838c8ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.012877 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a2a5-a4d2-4360-b1a7-664b838c8ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.013301 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a2a5-a4d2-4360-b1a7-664b838c8ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.014263 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a2a5-a4d2-4360-b1a7-664b838c8ea7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.014723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a2a5-a4d2-4360-b1a7-664b838c8ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.017448 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a2a5-a4d2-4360-b1a7-664b838c8ea7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.020736 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 225/455] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:58.022157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698d927-4fa0-4d9e-a1c0-2b2cad155cf0 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.022455 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698d927-4fa0-4d9e-a1c0-2b2cad155cf0 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.022734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698d927-4fa0-4d9e-a1c0-2b2cad155cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.028853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 231/456] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:19:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.029878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a2a5-a4d2-4360-b1a7-664b838c8ea7 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.048682 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a2a5-a4d2-4360-b1a7-664b838c8ea7 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.052434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-d698d927-4fa0-4d9e-a1c0-2b2cad155cf0 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:58.054702 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d698d927-4fa0-4d9e-a1c0-2b2cad155cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:58.056703 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1c014-2c1d-4e57-9a72-f6c16a4c157f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.057687 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1c014-2c1d-4e57-9a72-f6c16a4c157f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.058165 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1c014-2c1d-4e57-9a72-f6c16a4c157f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.058665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1c014-2c1d-4e57-9a72-f6c16a4c157f admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.059694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1c014-2c1d-4e57-9a72-f6c16a4c157f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.060282 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1c014-2c1d-4e57-9a72-f6c16a4c157f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.062446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1c014-2c1d-4e57-9a72-f6c16a4c157f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.063476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 226/457] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:58.064282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698d927-4fa0-4d9e-a1c0-2b2cad155cf0 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.075458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698d927-4fa0-4d9e-a1c0-2b2cad155cf0 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.081422 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f520d06-1c60-41c8-b80d-e2c9db3e7e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.083028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f520d06-1c60-41c8-b80d-e2c9db3e7e3e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.083308 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f520d06-1c60-41c8-b80d-e2c9db3e7e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.083570 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f520d06-1c60-41c8-b80d-e2c9db3e7e3e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.084327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 232/458] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.086182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1c014-2c1d-4e57-9a72-f6c16a4c157f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.094670 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f520d06-1c60-41c8-b80d-e2c9db3e7e3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.098748 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f520d06-1c60-41c8-b80d-e2c9db3e7e3e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.100701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1c014-2c1d-4e57-9a72-f6c16a4c157f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.106178 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832362ab-4eec-40f5-9b41-a00ef6353f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.107113 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832362ab-4eec-40f5-9b41-a00ef6353f83 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.107845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832362ab-4eec-40f5-9b41-a00ef6353f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.108192 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832362ab-4eec-40f5-9b41-a00ef6353f83 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.120529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-6f520d06-1c60-41c8-b80d-e2c9db3e7e3e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:58.126796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 227/459] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.126796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f520d06-1c60-41c8-b80d-e2c9db3e7e3e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.133013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832362ab-4eec-40f5-9b41-a00ef6353f83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:58.133147 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f520d06-1c60-41c8-b80d-e2c9db3e7e3e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.136967 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5c282-f9fa-42b9-91ec-b45fd099ba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.137984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c282-f9fa-42b9-91ec-b45fd099ba22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.138332 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c282-f9fa-42b9-91ec-b45fd099ba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.138669 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c282-f9fa-42b9-91ec-b45fd099ba22 admin admin] PATH_INFO: `/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/442cc0e13dcb49f0a4a870c06e0edf1d/roles/de4c885bb354403b98a2f1aefb43754e` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.139312 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-832362ab-4eec-40f5-9b41-a00ef6353f83 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:19:58.141262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 233/460] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.142324 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832362ab-4eec-40f5-9b41-a00ef6353f83 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.154362 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832362ab-4eec-40f5-9b41-a00ef6353f83 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.160118 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990520-619f-45a9-93c2-67fe4c8c6b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.161076 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990520-619f-45a9-93c2-67fe4c8c6b48 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.161411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990520-619f-45a9-93c2-67fe4c8c6b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.161683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990520-619f-45a9-93c2-67fe4c8c6b48 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.162479 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5c282-f9fa-42b9-91ec-b45fd099ba22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce43bc1cdb744a2b2c65dd4c50d6599, user_id=442cc0e13dcb49f0a4a870c06e0edf1d, role_id=de4c885bb354403b98a2f1aefb43754e)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.165399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5c282-f9fa-42b9-91ec-b45fd099ba22 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.173123 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1990520-619f-45a9-93c2-67fe4c8c6b48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:58.181774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-e1990520-619f-45a9-93c2-67fe4c8c6b48 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:19:58.182523 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 228/461] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:19:58 2021] PUT /identity/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/442cc0e13dcb49f0a4a870c06e0edf1d/roles/de4c885bb354403b98a2f1aefb43754e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:58.183044 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 234/462] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.183845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990520-619f-45a9-93c2-67fe4c8c6b48 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.184365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5c282-f9fa-42b9-91ec-b45fd099ba22 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.198408 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990520-619f-45a9-93c2-67fe4c8c6b48 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.271491 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5c282-f9fa-42b9-91ec-b45fd099ba22 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.278011 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa579586-d85f-475f-93a5-19a0d0ac3cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.280435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa579586-d85f-475f-93a5-19a0d0ac3cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.281076 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa579586-d85f-475f-93a5-19a0d0ac3cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.281828 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa579586-d85f-475f-93a5-19a0d0ac3cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.282854 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa579586-d85f-475f-93a5-19a0d0ac3cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.283353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa579586-d85f-475f-93a5-19a0d0ac3cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.286391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a7fbc-61b5-4134-a442-22fd533ffa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.286919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa579586-d85f-475f-93a5-19a0d0ac3cf5 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.287221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7fbc-61b5-4134-a442-22fd533ffa97 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.287618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7fbc-61b5-4134-a442-22fd533ffa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.288020 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a7fbc-61b5-4134-a442-22fd533ffa97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.288906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a7fbc-61b5-4134-a442-22fd533ffa97 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.289288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a7fbc-61b5-4134-a442-22fd533ffa97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.291200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a7fbc-61b5-4134-a442-22fd533ffa97 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.309423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 235/463] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.309423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a7fbc-61b5-4134-a442-22fd533ffa97 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.310164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 229/464] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.311394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa579586-d85f-475f-93a5-19a0d0ac3cf5 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.320894 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a7fbc-61b5-4134-a442-22fd533ffa97 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.324445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa579586-d85f-475f-93a5-19a0d0ac3cf5 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.325896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1f526-1956-4b0a-9fef-ee7949293323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.326767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1f526-1956-4b0a-9fef-ee7949293323 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.327206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1f526-1956-4b0a-9fef-ee7949293323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.327624 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1f526-1956-4b0a-9fef-ee7949293323 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.328499 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1f526-1956-4b0a-9fef-ee7949293323 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.328904 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1f526-1956-4b0a-9fef-ee7949293323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.330359 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47e519-497a-4614-a75a-08098594a32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.330898 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1f526-1956-4b0a-9fef-ee7949293323 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.331649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47e519-497a-4614-a75a-08098594a32b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.332158 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47e519-497a-4614-a75a-08098594a32b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.332583 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47e519-497a-4614-a75a-08098594a32b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.346354 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47e519-497a-4614-a75a-08098594a32b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.348225 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 236/465] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.349220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1f526-1956-4b0a-9fef-ee7949293323 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.349392 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47e519-497a-4614-a75a-08098594a32b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.360573 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1f526-1956-4b0a-9fef-ee7949293323 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.369220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f44ff-ad1c-4555-98a0-cdb33f3a3d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.370410 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f44ff-ad1c-4555-98a0-cdb33f3a3d76 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.370796 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f44ff-ad1c-4555-98a0-cdb33f3a3d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.371195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f44ff-ad1c-4555-98a0-cdb33f3a3d76 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.373181 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-fd47e519-497a-4614-a75a-08098594a32b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:58.375414 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 230/466] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.383595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47e519-497a-4614-a75a-08098594a32b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.386398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f44ff-ad1c-4555-98a0-cdb33f3a3d76 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.388515 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f44ff-ad1c-4555-98a0-cdb33f3a3d76 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.397716 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47e519-497a-4614-a75a-08098594a32b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.402624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c0a35-1dd6-46c8-8205-98a91e994cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.403543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c0a35-1dd6-46c8-8205-98a91e994cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.403830 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c0a35-1dd6-46c8-8205-98a91e994cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.404202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c0a35-1dd6-46c8-8205-98a91e994cd2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.406256 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-bd7f44ff-ad1c-4555-98a0-cdb33f3a3d76 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 16 00:19:58.408442 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 237/467] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/users/glance => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.410688 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f44ff-ad1c-4555-98a0-cdb33f3a3d76 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.417983 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c0a35-1dd6-46c8-8205-98a91e994cd2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.419989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c0a35-1dd6-46c8-8205-98a91e994cd2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.422644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f44ff-ad1c-4555-98a0-cdb33f3a3d76 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.428416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769830d9-8f2e-478b-9208-cea85e9dee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.429465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769830d9-8f2e-478b-9208-cea85e9dee2b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.429894 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769830d9-8f2e-478b-9208-cea85e9dee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.430340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769830d9-8f2e-478b-9208-cea85e9dee2b admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.431259 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769830d9-8f2e-478b-9208-cea85e9dee2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.431727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769830d9-8f2e-478b-9208-cea85e9dee2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.433609 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769830d9-8f2e-478b-9208-cea85e9dee2b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.438657 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-f13c0a35-1dd6-46c8-8205-98a91e994cd2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:58.440319 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 231/468] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.441554 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c0a35-1dd6-46c8-8205-98a91e994cd2 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.447356 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 238/469] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.448387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769830d9-8f2e-478b-9208-cea85e9dee2b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.451121 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c0a35-1dd6-46c8-8205-98a91e994cd2 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.455728 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e02107-559c-4c66-ae4a-e031cd3a1b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.457402 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02107-559c-4c66-ae4a-e031cd3a1b5a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.457623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02107-559c-4c66-ae4a-e031cd3a1b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.457997 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02107-559c-4c66-ae4a-e031cd3a1b5a admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.458968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e02107-559c-4c66-ae4a-e031cd3a1b5a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.459376 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e02107-559c-4c66-ae4a-e031cd3a1b5a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.460775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769830d9-8f2e-478b-9208-cea85e9dee2b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.461458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e02107-559c-4c66-ae4a-e031cd3a1b5a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.468083 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e211e6-29dc-439d-9c11-d9eb25181c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.468907 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e211e6-29dc-439d-9c11-d9eb25181c4c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.469326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e211e6-29dc-439d-9c11-d9eb25181c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.469726 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e211e6-29dc-439d-9c11-d9eb25181c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.470903 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e211e6-29dc-439d-9c11-d9eb25181c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.471311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e211e6-29dc-439d-9c11-d9eb25181c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.475380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e211e6-29dc-439d-9c11-d9eb25181c4c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.482612 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 232/470] 10.222.0.50 () {56 vars in 1158 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.483798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e02107-559c-4c66-ae4a-e031cd3a1b5a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.489123 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 239/471] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.490356 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e211e6-29dc-439d-9c11-d9eb25181c4c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.496997 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e02107-559c-4c66-ae4a-e031cd3a1b5a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.501483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e211e6-29dc-439d-9c11-d9eb25181c4c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.502490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426b498-4931-4fc5-83f9-a1660d281e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.503860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426b498-4931-4fc5-83f9-a1660d281e1f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.504483 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426b498-4931-4fc5-83f9-a1660d281e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.505099 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426b498-4931-4fc5-83f9-a1660d281e1f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.506884 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d994718-ce87-41df-8a57-3f2472e4946d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.507661 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d994718-ce87-41df-8a57-3f2472e4946d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.508004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d994718-ce87-41df-8a57-3f2472e4946d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.508280 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d994718-ce87-41df-8a57-3f2472e4946d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.513956 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426b498-4931-4fc5-83f9-a1660d281e1f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.516149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426b498-4931-4fc5-83f9-a1660d281e1f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.520635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d994718-ce87-41df-8a57-3f2472e4946d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.522487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d994718-ce87-41df-8a57-3f2472e4946d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.532078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-f426b498-4931-4fc5-83f9-a1660d281e1f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 16 00:19:58.533404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 233/472] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/users/neutron => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.534911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426b498-4931-4fc5-83f9-a1660d281e1f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.540928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-7d994718-ce87-41df-8a57-3f2472e4946d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:58.542238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 240/473] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.543358 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075149d-ff54-49de-9081-8b7a34189cb7 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.543644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075149d-ff54-49de-9081-8b7a34189cb7 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.543921 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075149d-ff54-49de-9081-8b7a34189cb7 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.544459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426b498-4931-4fc5-83f9-a1660d281e1f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.545715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 241/474] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:19:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:19:58.546254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075149d-ff54-49de-9081-8b7a34189cb7 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.549254 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e0a68-e20b-42da-b719-ad9a9fff6cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.550036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e0a68-e20b-42da-b719-ad9a9fff6cea admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.550320 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e0a68-e20b-42da-b719-ad9a9fff6cea admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.550596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e0a68-e20b-42da-b719-ad9a9fff6cea admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.558621 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e0a68-e20b-42da-b719-ad9a9fff6cea admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.559645 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075149d-ff54-49de-9081-8b7a34189cb7 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.560692 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e0a68-e20b-42da-b719-ad9a9fff6cea admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.563873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22112331-5767-4659-929e-e4c69e130371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.564525 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22112331-5767-4659-929e-e4c69e130371 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.564806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22112331-5767-4659-929e-e4c69e130371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.565077 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22112331-5767-4659-929e-e4c69e130371 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.567006 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22112331-5767-4659-929e-e4c69e130371 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.567320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22112331-5767-4659-929e-e4c69e130371 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.569136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22112331-5767-4659-929e-e4c69e130371 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.574991 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-d95e0a68-e20b-42da-b719-ad9a9fff6cea admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 16 00:19:58.577182 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 234/475] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/users/cinder => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.577299 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e0a68-e20b-42da-b719-ad9a9fff6cea admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.588627 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 242/476] 10.222.0.50 () {56 vars in 1160 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.588779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e0a68-e20b-42da-b719-ad9a9fff6cea admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.589783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8142da-2c89-4507-ba37-0db286676740 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.590074 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8142da-2c89-4507-ba37-0db286676740 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.590350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8142da-2c89-4507-ba37-0db286676740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.594298 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429cee3-3f2a-482a-8920-e5d77cf2dca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.595215 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429cee3-3f2a-482a-8920-e5d77cf2dca5 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.595571 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429cee3-3f2a-482a-8920-e5d77cf2dca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.595848 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429cee3-3f2a-482a-8920-e5d77cf2dca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.596555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429cee3-3f2a-482a-8920-e5d77cf2dca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.597166 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429cee3-3f2a-482a-8920-e5d77cf2dca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.599423 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429cee3-3f2a-482a-8920-e5d77cf2dca5 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.608754 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-ec8142da-2c89-4507-ba37-0db286676740 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:19:58.609931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ec8142da-2c89-4507-ba37-0db286676740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:19:58.611051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 235/477] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.612301 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429cee3-3f2a-482a-8920-e5d77cf2dca5 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.621151 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 243/478] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:19:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:19:58.621613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429cee3-3f2a-482a-8920-e5d77cf2dca5 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.621901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8142da-2c89-4507-ba37-0db286676740 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.626047 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7131-a81f-48b4-bc66-81baea2c1ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.626685 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7131-a81f-48b4-bc66-81baea2c1ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.627004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7131-a81f-48b4-bc66-81baea2c1ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.627284 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7131-a81f-48b4-bc66-81baea2c1ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.628694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc7131-a81f-48b4-bc66-81baea2c1ca8 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.629003 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc7131-a81f-48b4-bc66-81baea2c1ca8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.630822 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc7131-a81f-48b4-bc66-81baea2c1ca8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.632367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8142da-2c89-4507-ba37-0db286676740 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.636822 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a4954-7d62-4892-88b5-44db35fce634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.637659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a4954-7d62-4892-88b5-44db35fce634 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.638014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a4954-7d62-4892-88b5-44db35fce634 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.638358 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a4954-7d62-4892-88b5-44db35fce634 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.649268 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 236/479] 10.222.0.50 () {56 vars in 1158 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.649826 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7131-a81f-48b4-bc66-81baea2c1ca8 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.654794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a4954-7d62-4892-88b5-44db35fce634 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.656896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a4954-7d62-4892-88b5-44db35fce634 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.659764 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7131-a81f-48b4-bc66-81baea2c1ca8 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.664169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc5472-8373-43ce-a88c-0fc8b9200b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.664936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc5472-8373-43ce-a88c-0fc8b9200b79 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.665218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc5472-8373-43ce-a88c-0fc8b9200b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.665494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc5472-8373-43ce-a88c-0fc8b9200b79 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.672347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc5472-8373-43ce-a88c-0fc8b9200b79 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.674289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc5472-8373-43ce-a88c-0fc8b9200b79 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.674400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-134a4954-7d62-4892-88b5-44db35fce634 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:58.676333 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 244/480] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.677501 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a4954-7d62-4892-88b5-44db35fce634 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.687057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-17cc5472-8373-43ce-a88c-0fc8b9200b79 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:19:58.688332 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 237/481] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.688948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc5472-8373-43ce-a88c-0fc8b9200b79 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.689970 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a4954-7d62-4892-88b5-44db35fce634 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.695709 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad30ad2-830c-470c-b796-c47587cfe23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.696845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad30ad2-830c-470c-b796-c47587cfe23a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.697135 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad30ad2-830c-470c-b796-c47587cfe23a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.697428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad30ad2-830c-470c-b796-c47587cfe23a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.699909 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc5472-8373-43ce-a88c-0fc8b9200b79 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.704430 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00ca02-96e9-4b10-9a94-7e19a0de3aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.705421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00ca02-96e9-4b10-9a94-7e19a0de3aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.705868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00ca02-96e9-4b10-9a94-7e19a0de3aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.706907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00ca02-96e9-4b10-9a94-7e19a0de3aa7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.708754 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad30ad2-830c-470c-b796-c47587cfe23a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.710575 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad30ad2-830c-470c-b796-c47587cfe23a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.717439 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00ca02-96e9-4b10-9a94-7e19a0de3aa7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:19:58.724505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-ad00ca02-96e9-4b10-9a94-7e19a0de3aa7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:19:58.729976 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 238/482] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.729976 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00ca02-96e9-4b10-9a94-7e19a0de3aa7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.730147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-dad30ad2-830c-470c-b796-c47587cfe23a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:58.730147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 245/483] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.730147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad30ad2-830c-470c-b796-c47587cfe23a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.739734 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad30ad2-830c-470c-b796-c47587cfe23a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.742672 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00ca02-96e9-4b10-9a94-7e19a0de3aa7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.743986 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf9b7a-dc34-46d9-a98d-6d02c5ba0b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.744591 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9b7a-dc34-46d9-a98d-6d02c5ba0b85 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.744875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9b7a-dc34-46d9-a98d-6d02c5ba0b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.745150 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9b7a-dc34-46d9-a98d-6d02c5ba0b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.745916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf9b7a-dc34-46d9-a98d-6d02c5ba0b85 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.746222 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf9b7a-dc34-46d9-a98d-6d02c5ba0b85 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.747174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13518aea-5d3d-4a77-b840-22126c0278f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.747794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13518aea-5d3d-4a77-b840-22126c0278f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.748077 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13518aea-5d3d-4a77-b840-22126c0278f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.748182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf9b7a-dc34-46d9-a98d-6d02c5ba0b85 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.748352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13518aea-5d3d-4a77-b840-22126c0278f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.749045 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13518aea-5d3d-4a77-b840-22126c0278f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.749353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13518aea-5d3d-4a77-b840-22126c0278f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.751010 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13518aea-5d3d-4a77-b840-22126c0278f6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.760650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 246/484] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.766003 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf9b7a-dc34-46d9-a98d-6d02c5ba0b85 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.770071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 239/485] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.770071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13518aea-5d3d-4a77-b840-22126c0278f6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.773076 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf9b7a-dc34-46d9-a98d-6d02c5ba0b85 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.776803 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed568273-4368-44f6-8a28-f5729a023fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.777431 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed568273-4368-44f6-8a28-f5729a023fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.777717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed568273-4368-44f6-8a28-f5729a023fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.777992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed568273-4368-44f6-8a28-f5729a023fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.778720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed568273-4368-44f6-8a28-f5729a023fe3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.779067 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed568273-4368-44f6-8a28-f5729a023fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.779903 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13518aea-5d3d-4a77-b840-22126c0278f6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.780647 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed568273-4368-44f6-8a28-f5729a023fe3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.784216 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9af8d5-1ebd-4995-b3e1-06ed69cc38e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.785163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9af8d5-1ebd-4995-b3e1-06ed69cc38e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.785455 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9af8d5-1ebd-4995-b3e1-06ed69cc38e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.785736 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9af8d5-1ebd-4995-b3e1-06ed69cc38e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.786442 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9af8d5-1ebd-4995-b3e1-06ed69cc38e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.786753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9af8d5-1ebd-4995-b3e1-06ed69cc38e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.788354 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9af8d5-1ebd-4995-b3e1-06ed69cc38e0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.794912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 247/486] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.794912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed568273-4368-44f6-8a28-f5729a023fe3 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.799712 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed568273-4368-44f6-8a28-f5729a023fe3 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.804344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56007c1c-efd2-4d71-84c5-382592980117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.805401 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56007c1c-efd2-4d71-84c5-382592980117 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.805624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 240/487] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:58.806043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56007c1c-efd2-4d71-84c5-382592980117 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.806423 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9af8d5-1ebd-4995-b3e1-06ed69cc38e0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.806723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56007c1c-efd2-4d71-84c5-382592980117 admin admin] PATH_INFO: `/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/8cab78404d3c4980a4b99da09edab426/roles/de4c885bb354403b98a2f1aefb43754e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.816366 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9af8d5-1ebd-4995-b3e1-06ed69cc38e0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.820732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d82844-7b1a-4b7b-a859-6d243afa3488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.821428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82844-7b1a-4b7b-a859-6d243afa3488 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.821713 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82844-7b1a-4b7b-a859-6d243afa3488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.821991 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82844-7b1a-4b7b-a859-6d243afa3488 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.824092 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56007c1c-efd2-4d71-84c5-382592980117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce43bc1cdb744a2b2c65dd4c50d6599, user_id=8cab78404d3c4980a4b99da09edab426, role_id=de4c885bb354403b98a2f1aefb43754e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.826925 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56007c1c-efd2-4d71-84c5-382592980117 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.828787 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d82844-7b1a-4b7b-a859-6d243afa3488 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.830707 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d82844-7b1a-4b7b-a859-6d243afa3488 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.840582 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 248/488] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:19:58 2021] PUT /identity/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/8cab78404d3c4980a4b99da09edab426/roles/de4c885bb354403b98a2f1aefb43754e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:58.847752 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-76d82844-7b1a-4b7b-a859-6d243afa3488 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:19:58.847752 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 241/489] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.848146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d82844-7b1a-4b7b-a859-6d243afa3488 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.849306 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56007c1c-efd2-4d71-84c5-382592980117 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.863576 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d82844-7b1a-4b7b-a859-6d243afa3488 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.928717 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328f931-0506-45fa-9cd4-fa3261799670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.929749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328f931-0506-45fa-9cd4-fa3261799670 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.930103 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328f931-0506-45fa-9cd4-fa3261799670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.930488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328f931-0506-45fa-9cd4-fa3261799670 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.936791 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56007c1c-efd2-4d71-84c5-382592980117 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.943446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce534b-1db5-4764-82d2-0a68495dd501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.943957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328f931-0506-45fa-9cd4-fa3261799670 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.944261 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce534b-1db5-4764-82d2-0a68495dd501 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.944542 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce534b-1db5-4764-82d2-0a68495dd501 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.944815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce534b-1db5-4764-82d2-0a68495dd501 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.946381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328f931-0506-45fa-9cd4-fa3261799670 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.957363 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce534b-1db5-4764-82d2-0a68495dd501 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.959709 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce534b-1db5-4764-82d2-0a68495dd501 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.965529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-2328f931-0506-45fa-9cd4-fa3261799670 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:58.967205 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 242/490] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.968124 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328f931-0506-45fa-9cd4-fa3261799670 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.974888 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-1fce534b-1db5-4764-82d2-0a68495dd501 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:19:58.976942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 249/491] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:58.977725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce534b-1db5-4764-82d2-0a68495dd501 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:58.981367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328f931-0506-45fa-9cd4-fa3261799670 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:58.986571 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d45c4-3ef8-4195-a257-b6094e3a9349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:58.987281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d45c4-3ef8-4195-a257-b6094e3a9349 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:58.988156 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d45c4-3ef8-4195-a257-b6094e3a9349 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:58.988440 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d45c4-3ef8-4195-a257-b6094e3a9349 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:58.989519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d45c4-3ef8-4195-a257-b6094e3a9349 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:58.989829 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d45c4-3ef8-4195-a257-b6094e3a9349 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:58.992389 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d45c4-3ef8-4195-a257-b6094e3a9349 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:58.995177 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce534b-1db5-4764-82d2-0a68495dd501 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:59.000107 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c14d4-083c-47b4-a580-5fc51d198ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:59.000952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c14d4-083c-47b4-a580-5fc51d198ecd admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:59.001300 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c14d4-083c-47b4-a580-5fc51d198ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:59.001723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c14d4-083c-47b4-a580-5fc51d198ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:59.002515 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c14d4-083c-47b4-a580-5fc51d198ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:59.002911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c14d4-083c-47b4-a580-5fc51d198ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:59.005960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c14d4-083c-47b4-a580-5fc51d198ecd admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:59.006653 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 243/492] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:59.011712 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d45c4-3ef8-4195-a257-b6094e3a9349 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:59.024329 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 250/493] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:59.025155 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c14d4-083c-47b4-a580-5fc51d198ecd admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:59.025506 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d45c4-3ef8-4195-a257-b6094e3a9349 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:59.030391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59570088-2994-4afa-8ee1-9a3c0b4b9bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:59.031343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59570088-2994-4afa-8ee1-9a3c0b4b9bfd admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:59.031630 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59570088-2994-4afa-8ee1-9a3c0b4b9bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:59.031909 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59570088-2994-4afa-8ee1-9a3c0b4b9bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:59.033303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59570088-2994-4afa-8ee1-9a3c0b4b9bfd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:59.033772 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59570088-2994-4afa-8ee1-9a3c0b4b9bfd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:59.035863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59570088-2994-4afa-8ee1-9a3c0b4b9bfd admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:59.036933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c14d4-083c-47b4-a580-5fc51d198ecd admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:59.041815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9e661-a2da-43bb-bf91-09666e12066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:59.042671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9e661-a2da-43bb-bf91-09666e12066d admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:59.043001 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9e661-a2da-43bb-bf91-09666e12066d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:59.043282 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9e661-a2da-43bb-bf91-09666e12066d admin admin] PATH_INFO: `/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/7893cca0610b40abb9c45414f3690df0/roles/de4c885bb354403b98a2f1aefb43754e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:59.051381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 244/494] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:19:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:59.052249 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59570088-2994-4afa-8ee1-9a3c0b4b9bfd admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:59.063455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9e661-a2da-43bb-bf91-09666e12066d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce43bc1cdb744a2b2c65dd4c50d6599, user_id=7893cca0610b40abb9c45414f3690df0, role_id=de4c885bb354403b98a2f1aefb43754e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:59.063628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59570088-2994-4afa-8ee1-9a3c0b4b9bfd admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:59.067489 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9e661-a2da-43bb-bf91-09666e12066d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:59.070600 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963c2c1-3a2b-49fc-8a7e-e08bb3018c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:59.071427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963c2c1-3a2b-49fc-8a7e-e08bb3018c71 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:59.071979 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963c2c1-3a2b-49fc-8a7e-e08bb3018c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:59.072420 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963c2c1-3a2b-49fc-8a7e-e08bb3018c71 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:59.081105 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963c2c1-3a2b-49fc-8a7e-e08bb3018c71 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:59.083395 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963c2c1-3a2b-49fc-8a7e-e08bb3018c71 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:59.086364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 251/495] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:19:59 2021] PUT /identity/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/7893cca0610b40abb9c45414f3690df0/roles/de4c885bb354403b98a2f1aefb43754e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:59.087610 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9e661-a2da-43bb-bf91-09666e12066d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:59.098443 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-6963c2c1-3a2b-49fc-8a7e-e08bb3018c71 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 16 00:19:59.099723 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 245/496] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:19:59 2021] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:59.106404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963c2c1-3a2b-49fc-8a7e-e08bb3018c71 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:59.116642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963c2c1-3a2b-49fc-8a7e-e08bb3018c71 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:59.154502 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9e661-a2da-43bb-bf91-09666e12066d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:59.160746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed75da8-ebf4-4caf-8815-68ad00e48c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:59.162024 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed75da8-ebf4-4caf-8815-68ad00e48c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:59.162513 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed75da8-ebf4-4caf-8815-68ad00e48c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:59.162997 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed75da8-ebf4-4caf-8815-68ad00e48c22 admin admin] PATH_INFO: `/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/292b73337e674cdfa9c05fe67040cf94/roles/de4c885bb354403b98a2f1aefb43754e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:59.179816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed75da8-ebf4-4caf-8815-68ad00e48c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce43bc1cdb744a2b2c65dd4c50d6599, user_id=292b73337e674cdfa9c05fe67040cf94, role_id=de4c885bb354403b98a2f1aefb43754e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:59.183897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed75da8-ebf4-4caf-8815-68ad00e48c22 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:59.193986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0737c2-f2f7-4c50-b678-7e99c0e4245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:59.194674 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0737c2-f2f7-4c50-b678-7e99c0e4245e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:59.195065 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0737c2-f2f7-4c50-b678-7e99c0e4245e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:59.195343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0737c2-f2f7-4c50-b678-7e99c0e4245e admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:59.196278 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0737c2-f2f7-4c50-b678-7e99c0e4245e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:59.196595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0737c2-f2f7-4c50-b678-7e99c0e4245e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:59.198716 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0737c2-f2f7-4c50-b678-7e99c0e4245e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:59.204202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 252/497] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:19:59 2021] PUT /identity/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/292b73337e674cdfa9c05fe67040cf94/roles/de4c885bb354403b98a2f1aefb43754e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:19:59.219614 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 246/498] 10.222.0.50 () {56 vars in 1156 bytes} [Tue Nov 16 00:19:59 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:19:59.226591 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed75da8-ebf4-4caf-8815-68ad00e48c22 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:59.311467 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed75da8-ebf4-4caf-8815-68ad00e48c22 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:59.316958 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e062fa-b9c9-4cf2-ab75-de9f51d2b379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:59.317716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e062fa-b9c9-4cf2-ab75-de9f51d2b379 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:59.317921 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e062fa-b9c9-4cf2-ab75-de9f51d2b379 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:59.318214 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e062fa-b9c9-4cf2-ab75-de9f51d2b379 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:59.327247 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e062fa-b9c9-4cf2-ab75-de9f51d2b379 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:59.329121 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e062fa-b9c9-4cf2-ab75-de9f51d2b379 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:59.339994 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 253/499] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:19:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:19:59.347549 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0737c2-f2f7-4c50-b678-7e99c0e4245e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:59.358420 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0737c2-f2f7-4c50-b678-7e99c0e4245e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:59.363294 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1783b1b-f38e-4968-859b-2f7c48dab784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:59.364163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1783b1b-f38e-4968-859b-2f7c48dab784 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:59.364526 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1783b1b-f38e-4968-859b-2f7c48dab784 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:59.364828 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1783b1b-f38e-4968-859b-2f7c48dab784 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:59.377307 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1783b1b-f38e-4968-859b-2f7c48dab784 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:59.379820 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1783b1b-f38e-4968-859b-2f7c48dab784 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:59.403822 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-f1783b1b-f38e-4968-859b-2f7c48dab784 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:19:59.405078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 247/500] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:19:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:59.412484 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e062fa-b9c9-4cf2-ab75-de9f51d2b379 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:59.425436 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e062fa-b9c9-4cf2-ab75-de9f51d2b379 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:59.431775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b1b57-3fc6-4f57-bf62-014698183b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:59.432440 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b1b57-3fc6-4f57-bf62-014698183b95 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:59.432721 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b1b57-3fc6-4f57-bf62-014698183b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:59.432997 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b1b57-3fc6-4f57-bf62-014698183b95 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:59.433724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b1b57-3fc6-4f57-bf62-014698183b95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:59.434030 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b1b57-3fc6-4f57-bf62-014698183b95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:59.435689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b1b57-3fc6-4f57-bf62-014698183b95 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:59.450630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 254/501] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:19:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:59.457968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1783b1b-f38e-4968-859b-2f7c48dab784 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:59.468659 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1783b1b-f38e-4968-859b-2f7c48dab784 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:59.476216 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0e132-3064-492a-8eb9-450dbd3839e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:59.477003 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0e132-3064-492a-8eb9-450dbd3839e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:59.477289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0e132-3064-492a-8eb9-450dbd3839e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:59.477570 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0e132-3064-492a-8eb9-450dbd3839e1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:59.484774 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0e132-3064-492a-8eb9-450dbd3839e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:59.486802 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0e132-3064-492a-8eb9-450dbd3839e1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:59.501891 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-52b0e132-3064-492a-8eb9-450dbd3839e1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:19:59.503540 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 248/502] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:19:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:19:59.509828 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b1b57-3fc6-4f57-bf62-014698183b95 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:59.528319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b1b57-3fc6-4f57-bf62-014698183b95 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:59.534955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a548bf-ac1e-4f6d-aa54-587145b07a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:59.535898 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a548bf-ac1e-4f6d-aa54-587145b07a10 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:59.536386 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a548bf-ac1e-4f6d-aa54-587145b07a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:59.536865 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a548bf-ac1e-4f6d-aa54-587145b07a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:59.537946 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a548bf-ac1e-4f6d-aa54-587145b07a10 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:59.538457 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a548bf-ac1e-4f6d-aa54-587145b07a10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:59.540606 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a548bf-ac1e-4f6d-aa54-587145b07a10 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:59.554580 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 255/503] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:19:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:19:59.561627 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0e132-3064-492a-8eb9-450dbd3839e1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:19:59.579992 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0e132-3064-492a-8eb9-450dbd3839e1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:19:59.591479 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98e543-a9f4-41ca-92d1-c901d879904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:19:59.592141 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e543-a9f4-41ca-92d1-c901d879904b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:19:59.592428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e543-a9f4-41ca-92d1-c901d879904b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:19:59.592710 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e543-a9f4-41ca-92d1-c901d879904b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:19:59.593538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98e543-a9f4-41ca-92d1-c901d879904b admin admin] RBAC: Adding query filter params (role.id=de4c885bb354403b98a2f1aefb43754e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=0ac32c6730654a889472a3bad95374bc) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:19:59.593852 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98e543-a9f4-41ca-92d1-c901d879904b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:19:59.595749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98e543-a9f4-41ca-92d1-c901d879904b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:19:59.602433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 249/504] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:19:59 2021] GET /identity/v3/role_assignments?user.id=0ac32c6730654a889472a3bad95374bc&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=de4c885bb354403b98a2f1aefb43754e => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:00.919604 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6e68e-6388-4f31-b970-46507be910fb None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:00.922984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6e68e-6388-4f31-b970-46507be910fb None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:00.922984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6e68e-6388-4f31-b970-46507be910fb None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:00.922984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 256/505] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:00.931289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c9b0f-95f6-4d9c-a518-981cf4adb7b8 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:00.931833 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c9b0f-95f6-4d9c-a518-981cf4adb7b8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:00.931833 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c9b0f-95f6-4d9c-a518-981cf4adb7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:00.960086 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-ad1c9b0f-95f6-4d9c-a518-981cf4adb7b8 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:00.961301 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ad1c9b0f-95f6-4d9c-a518-981cf4adb7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:00.974781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 250/506] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:01.011518 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6e68e-6388-4f31-b970-46507be910fb None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.032396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6e68e-6388-4f31-b970-46507be910fb None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.038070 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99200b-b578-4b5c-ad09-8881b97945df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.039156 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99200b-b578-4b5c-ad09-8881b97945df admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.039665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99200b-b578-4b5c-ad09-8881b97945df admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.040151 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99200b-b578-4b5c-ad09-8881b97945df admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.060216 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99200b-b578-4b5c-ad09-8881b97945df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:01.067280 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-fa99200b-b578-4b5c-ad09-8881b97945df admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:20:01.068727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 257/507] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:01.074940 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c9b0f-95f6-4d9c-a518-981cf4adb7b8 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.087758 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c9b0f-95f6-4d9c-a518-981cf4adb7b8 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.109028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9306d7d-cef9-4f25-b69a-aa44421b345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.110051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9306d7d-cef9-4f25-b69a-aa44421b345d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.110536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9306d7d-cef9-4f25-b69a-aa44421b345d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.111057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9306d7d-cef9-4f25-b69a-aa44421b345d admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.113445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9306d7d-cef9-4f25-b69a-aa44421b345d admin admin] RBAC: Adding query filter params (name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:01.113984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9306d7d-cef9-4f25-b69a-aa44421b345d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:01.115837 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9306d7d-cef9-4f25-b69a-aa44421b345d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:01.128331 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 251/508] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:01.134143 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99200b-b578-4b5c-ad09-8881b97945df admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.147227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99200b-b578-4b5c-ad09-8881b97945df admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.154542 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4991c-152e-4ce9-883c-85d8471d67d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.155417 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4991c-152e-4ce9-883c-85d8471d67d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.155709 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4991c-152e-4ce9-883c-85d8471d67d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.155988 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4991c-152e-4ce9-883c-85d8471d67d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.176255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4991c-152e-4ce9-883c-85d8471d67d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:01.178720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4991c-152e-4ce9-883c-85d8471d67d9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:01.205157 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-4ce4991c-152e-4ce9-883c-85d8471d67d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:01.207213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 258/509] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:01.213805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9306d7d-cef9-4f25-b69a-aa44421b345d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.231833 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9306d7d-cef9-4f25-b69a-aa44421b345d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.243166 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1da8b5-ec69-4b9c-9290-ff98e401c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.244130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da8b5-ec69-4b9c-9290-ff98e401c89a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.244618 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da8b5-ec69-4b9c-9290-ff98e401c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.245124 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da8b5-ec69-4b9c-9290-ff98e401c89a admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.246045 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1da8b5-ec69-4b9c-9290-ff98e401c89a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:01.246552 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1da8b5-ec69-4b9c-9290-ff98e401c89a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:01.248395 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1da8b5-ec69-4b9c-9290-ff98e401c89a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:01.271125 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 252/510] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:01.276793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4991c-152e-4ce9-883c-85d8471d67d9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.291922 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4991c-152e-4ce9-883c-85d8471d67d9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.303053 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b21db-da95-4b95-9fa9-78a831571284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.303910 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b21db-da95-4b95-9fa9-78a831571284 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.304198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b21db-da95-4b95-9fa9-78a831571284 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.304475 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b21db-da95-4b95-9fa9-78a831571284 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.316526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b21db-da95-4b95-9fa9-78a831571284 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:01.318548 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b21db-da95-4b95-9fa9-78a831571284 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:01.337578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-7c5b21db-da95-4b95-9fa9-78a831571284 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 00:20:01.339007 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 259/511] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:01.344946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1da8b5-ec69-4b9c-9290-ff98e401c89a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.359951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1da8b5-ec69-4b9c-9290-ff98e401c89a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.370178 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedb335-9ec0-4477-98be-63338f385bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.371121 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedb335-9ec0-4477-98be-63338f385bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.371612 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedb335-9ec0-4477-98be-63338f385bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.372110 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedb335-9ec0-4477-98be-63338f385bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.373163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedb335-9ec0-4477-98be-63338f385bb7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:01.373673 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedb335-9ec0-4477-98be-63338f385bb7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:01.375760 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedb335-9ec0-4477-98be-63338f385bb7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:01.406614 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 253/512] 10.222.0.50 () {56 vars in 1154 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:01.414031 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b21db-da95-4b95-9fa9-78a831571284 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.428956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b21db-da95-4b95-9fa9-78a831571284 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.439063 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4546ced-5d21-4428-8c52-aaffba43b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.439792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4546ced-5d21-4428-8c52-aaffba43b582 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.440080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4546ced-5d21-4428-8c52-aaffba43b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.440462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4546ced-5d21-4428-8c52-aaffba43b582 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.452310 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4546ced-5d21-4428-8c52-aaffba43b582 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:01.454138 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4546ced-5d21-4428-8c52-aaffba43b582 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:01.469449 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 260/513] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:20:01.478353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedb335-9ec0-4477-98be-63338f385bb7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.492098 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedb335-9ec0-4477-98be-63338f385bb7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.504631 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41bb93-2717-46a3-a636-583d9c7bb74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.505435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41bb93-2717-46a3-a636-583d9c7bb74b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.505718 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41bb93-2717-46a3-a636-583d9c7bb74b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.505994 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41bb93-2717-46a3-a636-583d9c7bb74b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.523419 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41bb93-2717-46a3-a636-583d9c7bb74b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:01.525274 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41bb93-2717-46a3-a636-583d9c7bb74b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:01.553808 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-9a41bb93-2717-46a3-a636-583d9c7bb74b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:01.555333 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 254/514] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:01.561389 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4546ced-5d21-4428-8c52-aaffba43b582 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.563775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975fd82-5391-4faa-8550-e7e05327a141 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.564064 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975fd82-5391-4faa-8550-e7e05327a141 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.564347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975fd82-5391-4faa-8550-e7e05327a141 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.567477 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 255/515] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:01.574498 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4546ced-5d21-4428-8c52-aaffba43b582 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.583474 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06656d1f-b8b5-4484-ac3c-1dfcbd42d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.584141 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656d1f-b8b5-4484-ac3c-1dfcbd42d974 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.584422 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656d1f-b8b5-4484-ac3c-1dfcbd42d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.584522 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdd2af-4220-460b-9981-ed0aa22139b2 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.584696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656d1f-b8b5-4484-ac3c-1dfcbd42d974 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.584800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdd2af-4220-460b-9981-ed0aa22139b2 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.585015 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdd2af-4220-460b-9981-ed0aa22139b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.585423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06656d1f-b8b5-4484-ac3c-1dfcbd42d974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:01.585727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06656d1f-b8b5-4484-ac3c-1dfcbd42d974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:01.587367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06656d1f-b8b5-4484-ac3c-1dfcbd42d974 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:01.601338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 261/516] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:01.606913 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06656d1f-b8b5-4484-ac3c-1dfcbd42d974 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.615850 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-74bdd2af-4220-460b-9981-ed0aa22139b2 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:01.617055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-74bdd2af-4220-460b-9981-ed0aa22139b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:01.617565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06656d1f-b8b5-4484-ac3c-1dfcbd42d974 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.625224 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753c413-0d41-4e1a-b3bd-ef8fdf9aed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.626816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c413-0d41-4e1a-b3bd-ef8fdf9aed15 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.628730 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c413-0d41-4e1a-b3bd-ef8fdf9aed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.629219 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c413-0d41-4e1a-b3bd-ef8fdf9aed15 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.633858 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 256/517] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Nov 16 00:20:01.639735 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753c413-0d41-4e1a-b3bd-ef8fdf9aed15 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:01.641919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753c413-0d41-4e1a-b3bd-ef8fdf9aed15 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:01.661417 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-b753c413-0d41-4e1a-b3bd-ef8fdf9aed15 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:01.662676 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdd2af-4220-460b-9981-ed0aa22139b2 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.662942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 262/518] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:01.675459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753c413-0d41-4e1a-b3bd-ef8fdf9aed15 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.676262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdd2af-4220-460b-9981-ed0aa22139b2 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.685253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86badc-102a-481e-9ac4-7d30efd2e0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.686224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86badc-102a-481e-9ac4-7d30efd2e0eb admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.686687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86badc-102a-481e-9ac4-7d30efd2e0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.687181 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86badc-102a-481e-9ac4-7d30efd2e0eb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.688542 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753c413-0d41-4e1a-b3bd-ef8fdf9aed15 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.694245 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b45059-9b99-482d-a5fd-49d822ede63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.695024 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b45059-9b99-482d-a5fd-49d822ede63d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.695378 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b45059-9b99-482d-a5fd-49d822ede63d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.695724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b45059-9b99-482d-a5fd-49d822ede63d admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.696583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b45059-9b99-482d-a5fd-49d822ede63d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:01.696961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b45059-9b99-482d-a5fd-49d822ede63d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:01.698909 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b45059-9b99-482d-a5fd-49d822ede63d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:01.700656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86badc-102a-481e-9ac4-7d30efd2e0eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:01.708700 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-4f86badc-102a-481e-9ac4-7d30efd2e0eb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:20:01.710423 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 257/519] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:01.712233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 263/520] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:01.718204 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86badc-102a-481e-9ac4-7d30efd2e0eb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.732496 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86badc-102a-481e-9ac4-7d30efd2e0eb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.736543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b45059-9b99-482d-a5fd-49d822ede63d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.738368 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d72548-d037-4cab-b6a6-0fd085422121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.739518 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d72548-d037-4cab-b6a6-0fd085422121 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.739945 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d72548-d037-4cab-b6a6-0fd085422121 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.740359 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d72548-d037-4cab-b6a6-0fd085422121 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.741298 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d72548-d037-4cab-b6a6-0fd085422121 admin admin] RBAC: Adding query filter params (role.id=de4c885bb354403b98a2f1aefb43754e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=442cc0e13dcb49f0a4a870c06e0edf1d) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:01.741791 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d72548-d037-4cab-b6a6-0fd085422121 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:01.746874 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d72548-d037-4cab-b6a6-0fd085422121 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:01.751162 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 258/521] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/role_assignments?user.id=442cc0e13dcb49f0a4a870c06e0edf1d&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=de4c885bb354403b98a2f1aefb43754e => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:01.753509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b45059-9b99-482d-a5fd-49d822ede63d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.775801 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c588b9-e49f-436a-87cf-7ccf47f7ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.776755 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c588b9-e49f-436a-87cf-7ccf47f7ab6c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.777251 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c588b9-e49f-436a-87cf-7ccf47f7ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.777674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c588b9-e49f-436a-87cf-7ccf47f7ab6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.778603 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c588b9-e49f-436a-87cf-7ccf47f7ab6c admin admin] RBAC: Adding query filter params (name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:01.779125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c588b9-e49f-436a-87cf-7ccf47f7ab6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:01.781013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c588b9-e49f-436a-87cf-7ccf47f7ab6c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:01.796451 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 264/522] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:01.802907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d72548-d037-4cab-b6a6-0fd085422121 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.821614 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d72548-d037-4cab-b6a6-0fd085422121 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.832773 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41cdb8-a08e-4b3a-8816-3e238a67026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.833626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41cdb8-a08e-4b3a-8816-3e238a67026f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.833962 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41cdb8-a08e-4b3a-8816-3e238a67026f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.834244 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41cdb8-a08e-4b3a-8816-3e238a67026f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.851482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41cdb8-a08e-4b3a-8816-3e238a67026f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:01.853463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41cdb8-a08e-4b3a-8816-3e238a67026f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:01.875761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-be41cdb8-a08e-4b3a-8816-3e238a67026f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:01.876980 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 259/523] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:01.883592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c588b9-e49f-436a-87cf-7ccf47f7ab6c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.896998 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c588b9-e49f-436a-87cf-7ccf47f7ab6c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.900934 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d6b3-0ca8-40b0-ae13-f041337feac2 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.901229 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d6b3-0ca8-40b0-ae13-f041337feac2 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.901508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d6b3-0ca8-40b0-ae13-f041337feac2 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.903607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 260/524] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:01.911940 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e869275-ac99-4b85-a7e7-d5b7824d0d0a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.912542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e869275-ac99-4b85-a7e7-d5b7824d0d0a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.913004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e869275-ac99-4b85-a7e7-d5b7824d0d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.915556 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a08fb-37b1-4c0b-a5e2-ceb48b44bb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.916245 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a08fb-37b1-4c0b-a5e2-ceb48b44bb82 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.916533 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a08fb-37b1-4c0b-a5e2-ceb48b44bb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.916812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a08fb-37b1-4c0b-a5e2-ceb48b44bb82 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:01.917796 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a08fb-37b1-4c0b-a5e2-ceb48b44bb82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:01.918114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a08fb-37b1-4c0b-a5e2-ceb48b44bb82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:01.919904 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a08fb-37b1-4c0b-a5e2-ceb48b44bb82 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:01.942756 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-2e869275-ac99-4b85-a7e7-d5b7824d0d0a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:01.944739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2e869275-ac99-4b85-a7e7-d5b7824d0d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:01.959182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 265/525] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:01.967471 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a08fb-37b1-4c0b-a5e2-ceb48b44bb82 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:01.972851 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 261/526] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:01.981795 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a08fb-37b1-4c0b-a5e2-ceb48b44bb82 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:01.996075 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d963f07-b578-41e2-b478-346b0aeadf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:01.996889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d963f07-b578-41e2-b478-346b0aeadf80 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:01.997174 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d963f07-b578-41e2-b478-346b0aeadf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:01.997468 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d963f07-b578-41e2-b478-346b0aeadf80 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.004844 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e869275-ac99-4b85-a7e7-d5b7824d0d0a None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.007739 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d963f07-b578-41e2-b478-346b0aeadf80 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.009812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d963f07-b578-41e2-b478-346b0aeadf80 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.016746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e869275-ac99-4b85-a7e7-d5b7824d0d0a None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.023324 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66986d19-d130-4d87-b605-1847e4ed5945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.024566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66986d19-d130-4d87-b605-1847e4ed5945 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.025038 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66986d19-d130-4d87-b605-1847e4ed5945 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.025602 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66986d19-d130-4d87-b605-1847e4ed5945 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.027608 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-3d963f07-b578-41e2-b478-346b0aeadf80 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 16 00:20:02.029675 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 266/527] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:20:01 2021] GET /identity/v3/users/glance => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:02.043824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66986d19-d130-4d87-b605-1847e4ed5945 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:02.044992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d963f07-b578-41e2-b478-346b0aeadf80 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.052150 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-66986d19-d130-4d87-b605-1847e4ed5945 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:20:02.053822 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 262/528] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:02.061456 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d963f07-b578-41e2-b478-346b0aeadf80 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.061711 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66986d19-d130-4d87-b605-1847e4ed5945 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.067429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9365f-fd6c-4676-99cf-c4de128e9be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.068351 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9365f-fd6c-4676-99cf-c4de128e9be4 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.068817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9365f-fd6c-4676-99cf-c4de128e9be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.069274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9365f-fd6c-4676-99cf-c4de128e9be4 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.070307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9365f-fd6c-4676-99cf-c4de128e9be4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.070797 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9365f-fd6c-4676-99cf-c4de128e9be4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.073136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9365f-fd6c-4676-99cf-c4de128e9be4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.079964 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66986d19-d130-4d87-b605-1847e4ed5945 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.085839 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160a865-0d0f-420f-bcb8-ee9e7896d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.086804 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160a865-0d0f-420f-bcb8-ee9e7896d23a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.087396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160a865-0d0f-420f-bcb8-ee9e7896d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.087874 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160a865-0d0f-420f-bcb8-ee9e7896d23a admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.088875 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160a865-0d0f-420f-bcb8-ee9e7896d23a admin admin] RBAC: Adding query filter params (name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.089434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160a865-0d0f-420f-bcb8-ee9e7896d23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.091459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160a865-0d0f-420f-bcb8-ee9e7896d23a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.095435 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 267/529] 10.222.0.50 () {56 vars in 1158 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:02.102706 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9365f-fd6c-4676-99cf-c4de128e9be4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.104249 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 263/530] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:02.110951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160a865-0d0f-420f-bcb8-ee9e7896d23a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.114663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9365f-fd6c-4676-99cf-c4de128e9be4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.120771 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160a865-0d0f-420f-bcb8-ee9e7896d23a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.123049 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dce9f-9bfa-4395-80e0-72fe5aa6dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.123707 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dce9f-9bfa-4395-80e0-72fe5aa6dfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.123995 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dce9f-9bfa-4395-80e0-72fe5aa6dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.124273 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dce9f-9bfa-4395-80e0-72fe5aa6dfc2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.125779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4c812-8c3c-4fa9-a18f-1ddaf4220fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.126666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4c812-8c3c-4fa9-a18f-1ddaf4220fba admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.126994 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4c812-8c3c-4fa9-a18f-1ddaf4220fba admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.127340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4c812-8c3c-4fa9-a18f-1ddaf4220fba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.134744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64dce9f-9bfa-4395-80e0-72fe5aa6dfc2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.136614 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64dce9f-9bfa-4395-80e0-72fe5aa6dfc2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.141044 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4c812-8c3c-4fa9-a18f-1ddaf4220fba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.143106 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4c812-8c3c-4fa9-a18f-1ddaf4220fba admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.146883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 268/531] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:20:02.153211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dce9f-9bfa-4395-80e0-72fe5aa6dfc2 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.162597 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dce9f-9bfa-4395-80e0-72fe5aa6dfc2 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.163848 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-e0f4c812-8c3c-4fa9-a18f-1ddaf4220fba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:02.165403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 264/532] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:02.168957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb8b74-bf7f-45b7-ac5c-3b559e174e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.169837 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb8b74-bf7f-45b7-ac5c-3b559e174e6f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.170122 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb8b74-bf7f-45b7-ac5c-3b559e174e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.170402 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb8b74-bf7f-45b7-ac5c-3b559e174e6f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.171903 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4c812-8c3c-4fa9-a18f-1ddaf4220fba admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.183007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4c812-8c3c-4fa9-a18f-1ddaf4220fba admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.183373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb8b74-bf7f-45b7-ac5c-3b559e174e6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.185570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb8b74-bf7f-45b7-ac5c-3b559e174e6f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.188190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a789b01-983d-44ec-95de-62cfdd05fae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.188914 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a789b01-983d-44ec-95de-62cfdd05fae8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.189207 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a789b01-983d-44ec-95de-62cfdd05fae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.189491 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a789b01-983d-44ec-95de-62cfdd05fae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.190279 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a789b01-983d-44ec-95de-62cfdd05fae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.191266 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a789b01-983d-44ec-95de-62cfdd05fae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.193129 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a789b01-983d-44ec-95de-62cfdd05fae8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.205504 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 265/533] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:02.206566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-fdfb8b74-bf7f-45b7-ac5c-3b559e174e6f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:02.208236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 269/534] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:02.211984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a789b01-983d-44ec-95de-62cfdd05fae8 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.214473 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb8b74-bf7f-45b7-ac5c-3b559e174e6f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.222215 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a789b01-983d-44ec-95de-62cfdd05fae8 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.226934 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb8b74-bf7f-45b7-ac5c-3b559e174e6f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.227672 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767b156-a6b8-4909-8905-edea15d327fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.228695 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767b156-a6b8-4909-8905-edea15d327fe admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.229260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767b156-a6b8-4909-8905-edea15d327fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.229775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767b156-a6b8-4909-8905-edea15d327fe admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.231923 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35213492-6676-4bcc-993f-f9da248f2186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.232907 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35213492-6676-4bcc-993f-f9da248f2186 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.233267 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35213492-6676-4bcc-993f-f9da248f2186 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.234137 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35213492-6676-4bcc-993f-f9da248f2186 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.235001 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35213492-6676-4bcc-993f-f9da248f2186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.235442 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35213492-6676-4bcc-993f-f9da248f2186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.237128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35213492-6676-4bcc-993f-f9da248f2186 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.242095 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767b156-a6b8-4909-8905-edea15d327fe admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.244521 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767b156-a6b8-4909-8905-edea15d327fe admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.252232 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 270/535] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:02.258428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe7cbf-c72d-489b-9a46-27be153cdbf1 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.259009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe7cbf-c72d-489b-9a46-27be153cdbf1 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.259482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe7cbf-c72d-489b-9a46-27be153cdbf1 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.261550 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 271/536] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:20:02.262267 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe7cbf-c72d-489b-9a46-27be153cdbf1 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.268746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-9767b156-a6b8-4909-8905-edea15d327fe admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 16 00:20:02.274621 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 266/537] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/users/neutron => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:02.276609 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99cb5-e600-420c-b13e-afa26b3f6e3d None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.276907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99cb5-e600-420c-b13e-afa26b3f6e3d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.277188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99cb5-e600-420c-b13e-afa26b3f6e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.283375 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe7cbf-c72d-489b-9a46-27be153cdbf1 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.292957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3bb41-078c-4d7c-a96d-5648a2c991ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.293860 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3bb41-078c-4d7c-a96d-5648a2c991ed admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.294269 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3bb41-078c-4d7c-a96d-5648a2c991ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.294626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3bb41-078c-4d7c-a96d-5648a2c991ed admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.303786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3bb41-078c-4d7c-a96d-5648a2c991ed admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.304093 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-a8b99cb5-e600-420c-b13e-afa26b3f6e3d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:02.305540 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a8b99cb5-e600-420c-b13e-afa26b3f6e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:02.305973 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3bb41-078c-4d7c-a96d-5648a2c991ed admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.322051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-d4c3bb41-078c-4d7c-a96d-5648a2c991ed admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:02.322421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 267/538] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:02.323671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b99cb5-e600-420c-b13e-afa26b3f6e3d None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.323785 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 272/539] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:02.330458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3bb41-078c-4d7c-a96d-5648a2c991ed admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.342440 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3bb41-078c-4d7c-a96d-5648a2c991ed admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.348024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b99cb5-e600-420c-b13e-afa26b3f6e3d None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.352212 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd9104-3129-4901-855c-2fcc6a8e3bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.352907 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd9104-3129-4901-855c-2fcc6a8e3bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.353193 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd9104-3129-4901-855c-2fcc6a8e3bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.353472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd9104-3129-4901-855c-2fcc6a8e3bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.354276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd9104-3129-4901-855c-2fcc6a8e3bd5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.354592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd9104-3129-4901-855c-2fcc6a8e3bd5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.356490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd9104-3129-4901-855c-2fcc6a8e3bd5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.356896 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712bbe1-3e0c-43f1-8258-800217543b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.357850 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712bbe1-3e0c-43f1-8258-800217543b55 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.358626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712bbe1-3e0c-43f1-8258-800217543b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.359160 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712bbe1-3e0c-43f1-8258-800217543b55 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.360285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712bbe1-3e0c-43f1-8258-800217543b55 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.360858 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712bbe1-3e0c-43f1-8258-800217543b55 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.363250 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712bbe1-3e0c-43f1-8258-800217543b55 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.376473 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 273/540] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:02.377152 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd9104-3129-4901-855c-2fcc6a8e3bd5 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.389106 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 268/541] 10.222.0.50 () {56 vars in 1160 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:02.390032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712bbe1-3e0c-43f1-8258-800217543b55 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.395787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd9104-3129-4901-855c-2fcc6a8e3bd5 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.400460 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712bbe1-3e0c-43f1-8258-800217543b55 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.401727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183613cd-1532-4146-a725-7974c36e2b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.402942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183613cd-1532-4146-a725-7974c36e2b51 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.403427 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183613cd-1532-4146-a725-7974c36e2b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.404050 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183613cd-1532-4146-a725-7974c36e2b51 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.405265 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc94c1-e716-4613-8f98-0fb9fb099ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.405907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc94c1-e716-4613-8f98-0fb9fb099ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.406198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc94c1-e716-4613-8f98-0fb9fb099ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.406482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc94c1-e716-4613-8f98-0fb9fb099ba0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.407350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc94c1-e716-4613-8f98-0fb9fb099ba0 admin admin] RBAC: Adding query filter params (role.id=de4c885bb354403b98a2f1aefb43754e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=8cab78404d3c4980a4b99da09edab426) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.407668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc94c1-e716-4613-8f98-0fb9fb099ba0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.409574 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc94c1-e716-4613-8f98-0fb9fb099ba0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.415884 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 269/542] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/role_assignments?user.id=8cab78404d3c4980a4b99da09edab426&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=de4c885bb354403b98a2f1aefb43754e => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:02.416698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc94c1-e716-4613-8f98-0fb9fb099ba0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.418881 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183613cd-1532-4146-a725-7974c36e2b51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:02.426357 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-183613cd-1532-4146-a725-7974c36e2b51 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:20:02.428436 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 274/543] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:02.430612 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db286e2-0023-4aef-b899-69f9da88394d None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.431288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db286e2-0023-4aef-b899-69f9da88394d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.431673 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db286e2-0023-4aef-b899-69f9da88394d None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.433563 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc94c1-e716-4613-8f98-0fb9fb099ba0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.439199 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 275/544] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:02.439199 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db286e2-0023-4aef-b899-69f9da88394d None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.452399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1363587-f27a-48cc-a54e-4326fe175949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.452754 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1363587-f27a-48cc-a54e-4326fe175949 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.453145 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1363587-f27a-48cc-a54e-4326fe175949 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.453525 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1363587-f27a-48cc-a54e-4326fe175949 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.458600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db286e2-0023-4aef-b899-69f9da88394d None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.463656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1363587-f27a-48cc-a54e-4326fe175949 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.464190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd1521-6b44-4bd3-bf32-c634ed0dc1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.465130 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd1521-6b44-4bd3-bf32-c634ed0dc1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.465559 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd1521-6b44-4bd3-bf32-c634ed0dc1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.465879 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1363587-f27a-48cc-a54e-4326fe175949 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.466180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd1521-6b44-4bd3-bf32-c634ed0dc1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.467205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd1521-6b44-4bd3-bf32-c634ed0dc1b4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.467696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd1521-6b44-4bd3-bf32-c634ed0dc1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.469565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd1521-6b44-4bd3-bf32-c634ed0dc1b4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.477743 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 270/545] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:20:02.479397 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ccf2-3025-4b61-9969-970629b63ca2 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.479797 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ccf2-3025-4b61-9969-970629b63ca2 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.480176 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ccf2-3025-4b61-9969-970629b63ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.481126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 276/546] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:02.487272 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd1521-6b44-4bd3-bf32-c634ed0dc1b4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.498653 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd1521-6b44-4bd3-bf32-c634ed0dc1b4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.505623 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782ff62-5528-42c0-b95a-567118574309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.506547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782ff62-5528-42c0-b95a-567118574309 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.506868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782ff62-5528-42c0-b95a-567118574309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.507146 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782ff62-5528-42c0-b95a-567118574309 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.508852 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-5965ccf2-3025-4b61-9969-970629b63ca2 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:02.510850 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-5965ccf2-3025-4b61-9969-970629b63ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:02.519555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 271/547] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:02.520708 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965ccf2-3025-4b61-9969-970629b63ca2 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.524053 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782ff62-5528-42c0-b95a-567118574309 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.526127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782ff62-5528-42c0-b95a-567118574309 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.531315 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965ccf2-3025-4b61-9969-970629b63ca2 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.544385 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955c87a-a5fc-45a0-85c9-28f34f2c1bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.545443 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955c87a-a5fc-45a0-85c9-28f34f2c1bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.545878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955c87a-a5fc-45a0-85c9-28f34f2c1bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.546349 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955c87a-a5fc-45a0-85c9-28f34f2c1bb4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.551224 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-3782ff62-5528-42c0-b95a-567118574309 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:02.552483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 277/548] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:02.553275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782ff62-5528-42c0-b95a-567118574309 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.561724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955c87a-a5fc-45a0-85c9-28f34f2c1bb4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.564040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955c87a-a5fc-45a0-85c9-28f34f2c1bb4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.569421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782ff62-5528-42c0-b95a-567118574309 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.574165 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63574d6c-59f0-4fe3-9565-025e4a548e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.575021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63574d6c-59f0-4fe3-9565-025e4a548e2a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.575313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63574d6c-59f0-4fe3-9565-025e4a548e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.575608 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63574d6c-59f0-4fe3-9565-025e4a548e2a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.585786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-1955c87a-a5fc-45a0-85c9-28f34f2c1bb4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:02.587325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 272/549] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:02.592926 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63574d6c-59f0-4fe3-9565-025e4a548e2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:02.593745 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955c87a-a5fc-45a0-85c9-28f34f2c1bb4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.595646 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-63574d6c-59f0-4fe3-9565-025e4a548e2a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:20:02.597481 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 278/550] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:02.598258 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63574d6c-59f0-4fe3-9565-025e4a548e2a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.605461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955c87a-a5fc-45a0-85c9-28f34f2c1bb4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.608739 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63574d6c-59f0-4fe3-9565-025e4a548e2a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.611184 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc285a-9728-46c5-b796-bab391fc9196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.612157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc285a-9728-46c5-b796-bab391fc9196 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.613085 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc285a-9728-46c5-b796-bab391fc9196 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.614556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc285a-9728-46c5-b796-bab391fc9196 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.614556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc285a-9728-46c5-b796-bab391fc9196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.614718 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc285a-9728-46c5-b796-bab391fc9196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.614800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dca50e-4540-45cc-b8fa-e82f0424ba2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.615374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dca50e-4540-45cc-b8fa-e82f0424ba2c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.615660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dca50e-4540-45cc-b8fa-e82f0424ba2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.615942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dca50e-4540-45cc-b8fa-e82f0424ba2c admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.616242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc285a-9728-46c5-b796-bab391fc9196 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.616668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dca50e-4540-45cc-b8fa-e82f0424ba2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.616982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dca50e-4540-45cc-b8fa-e82f0424ba2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.618577 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dca50e-4540-45cc-b8fa-e82f0424ba2c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.628469 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 273/551] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:02.630052 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc285a-9728-46c5-b796-bab391fc9196 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.631410 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 279/552] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:02.636680 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dca50e-4540-45cc-b8fa-e82f0424ba2c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.644353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc285a-9728-46c5-b796-bab391fc9196 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.647690 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dca50e-4540-45cc-b8fa-e82f0424ba2c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.650485 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5f620-ff2c-44db-a3a9-1a4fcb042b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.651199 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f620-ff2c-44db-a3a9-1a4fcb042b86 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.651505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f620-ff2c-44db-a3a9-1a4fcb042b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.651773 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f620-ff2c-44db-a3a9-1a4fcb042b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.652522 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5f620-ff2c-44db-a3a9-1a4fcb042b86 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.652833 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5f620-ff2c-44db-a3a9-1a4fcb042b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.653703 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28922f-d31f-4cc9-b224-23bb54fbe6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.654432 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5f620-ff2c-44db-a3a9-1a4fcb042b86 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.654917 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28922f-d31f-4cc9-b224-23bb54fbe6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.655352 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28922f-d31f-4cc9-b224-23bb54fbe6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.655812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28922f-d31f-4cc9-b224-23bb54fbe6a0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.663951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28922f-d31f-4cc9-b224-23bb54fbe6a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.664135 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 274/553] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:02.664946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5f620-ff2c-44db-a3a9-1a4fcb042b86 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.666397 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28922f-d31f-4cc9-b224-23bb54fbe6a0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.676016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5f620-ff2c-44db-a3a9-1a4fcb042b86 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.680608 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eaa43-870c-4af8-959b-fc754d6f6d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.681392 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eaa43-870c-4af8-959b-fc754d6f6d01 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.681684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eaa43-870c-4af8-959b-fc754d6f6d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.681811 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-0c28922f-d31f-4cc9-b224-23bb54fbe6a0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:02.681966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eaa43-870c-4af8-959b-fc754d6f6d01 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.683298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 280/554] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:02.684191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28922f-d31f-4cc9-b224-23bb54fbe6a0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.692398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296eaa43-870c-4af8-959b-fc754d6f6d01 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.694777 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296eaa43-870c-4af8-959b-fc754d6f6d01 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.695608 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28922f-d31f-4cc9-b224-23bb54fbe6a0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.700874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f62e3b-43ba-4170-a990-50d0ff21ae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.701656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f62e3b-43ba-4170-a990-50d0ff21ae45 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.701946 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f62e3b-43ba-4170-a990-50d0ff21ae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.702230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f62e3b-43ba-4170-a990-50d0ff21ae45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.711816 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-296eaa43-870c-4af8-959b-fc754d6f6d01 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 16 00:20:02.717866 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 275/555] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:02.717866 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eaa43-870c-4af8-959b-fc754d6f6d01 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.718090 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f62e3b-43ba-4170-a990-50d0ff21ae45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.718090 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f62e3b-43ba-4170-a990-50d0ff21ae45 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.724100 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eaa43-870c-4af8-959b-fc754d6f6d01 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.730555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d6597-eccb-497b-b442-75ca6af19c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.731311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6597-eccb-497b-b442-75ca6af19c35 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.731603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6597-eccb-497b-b442-75ca6af19c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.731886 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6597-eccb-497b-b442-75ca6af19c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.732674 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d6597-eccb-497b-b442-75ca6af19c35 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.732987 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d6597-eccb-497b-b442-75ca6af19c35 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.734854 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d6597-eccb-497b-b442-75ca6af19c35 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.739610 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-85f62e3b-43ba-4170-a990-50d0ff21ae45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:02.741327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 281/556] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:02.742546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f62e3b-43ba-4170-a990-50d0ff21ae45 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.747998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 276/557] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:02.748823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d6597-eccb-497b-b442-75ca6af19c35 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.753122 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f62e3b-43ba-4170-a990-50d0ff21ae45 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.759973 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79091f00-43b5-4372-b003-3b4c22d691d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.760838 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d6597-eccb-497b-b442-75ca6af19c35 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.761088 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091f00-43b5-4372-b003-3b4c22d691d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.761546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091f00-43b5-4372-b003-3b4c22d691d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.762086 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091f00-43b5-4372-b003-3b4c22d691d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.763236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79091f00-43b5-4372-b003-3b4c22d691d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.763774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79091f00-43b5-4372-b003-3b4c22d691d9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.765324 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8597a5-e725-450d-8164-c11828501605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.765976 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8597a5-e725-450d-8164-c11828501605 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.766262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8597a5-e725-450d-8164-c11828501605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.766459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79091f00-43b5-4372-b003-3b4c22d691d9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.766578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8597a5-e725-450d-8164-c11828501605 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.767281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8597a5-e725-450d-8164-c11828501605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.767591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8597a5-e725-450d-8164-c11828501605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.769714 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8597a5-e725-450d-8164-c11828501605 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.782966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 277/558] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:02.783793 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8597a5-e725-450d-8164-c11828501605 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.786744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 282/559] 10.222.0.50 () {56 vars in 1158 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:02.791529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79091f00-43b5-4372-b003-3b4c22d691d9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.796970 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8597a5-e725-450d-8164-c11828501605 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.803201 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79091f00-43b5-4372-b003-3b4c22d691d9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.803622 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b11512-d0d7-49f9-ade2-07dfc736e695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.804280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11512-d0d7-49f9-ade2-07dfc736e695 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.804573 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11512-d0d7-49f9-ade2-07dfc736e695 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.804858 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11512-d0d7-49f9-ade2-07dfc736e695 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.805875 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b11512-d0d7-49f9-ade2-07dfc736e695 admin admin] RBAC: Adding query filter params (role.id=de4c885bb354403b98a2f1aefb43754e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=7893cca0610b40abb9c45414f3690df0) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.806016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b11512-d0d7-49f9-ade2-07dfc736e695 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.807928 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b11512-d0d7-49f9-ade2-07dfc736e695 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.810662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2659708-1b65-43c4-8846-4d658ba86f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.811794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2659708-1b65-43c4-8846-4d658ba86f35 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.812140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2659708-1b65-43c4-8846-4d658ba86f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.812485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2659708-1b65-43c4-8846-4d658ba86f35 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.818248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 278/560] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/role_assignments?user.id=7893cca0610b40abb9c45414f3690df0&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=de4c885bb354403b98a2f1aefb43754e => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:02.819402 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b11512-d0d7-49f9-ade2-07dfc736e695 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.830303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2659708-1b65-43c4-8846-4d658ba86f35 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.834453 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2659708-1b65-43c4-8846-4d658ba86f35 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.838365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b11512-d0d7-49f9-ade2-07dfc736e695 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.843965 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba349-d385-44ba-a37b-e8533d45be8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.845795 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba349-d385-44ba-a37b-e8533d45be8a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.846259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba349-d385-44ba-a37b-e8533d45be8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.847521 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba349-d385-44ba-a37b-e8533d45be8a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.857422 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ba349-d385-44ba-a37b-e8533d45be8a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.859585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ba349-d385-44ba-a37b-e8533d45be8a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.862528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-a2659708-1b65-43c4-8846-4d658ba86f35 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 16 00:20:02.870730 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 279/561] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:20:02.872352 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 283/562] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/users/swift => generated 83 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:02.880110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2659708-1b65-43c4-8846-4d658ba86f35 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.880284 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba349-d385-44ba-a37b-e8533d45be8a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.895312 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba349-d385-44ba-a37b-e8533d45be8a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.901197 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2659708-1b65-43c4-8846-4d658ba86f35 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.905292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f935b-fb15-44c9-9d89-9be463543113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.906196 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f935b-fb15-44c9-9d89-9be463543113 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.906492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f935b-fb15-44c9-9d89-9be463543113 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.906778 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f935b-fb15-44c9-9d89-9be463543113 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.913456 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75449d-685a-48dc-9774-e555df3fa0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.914201 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75449d-685a-48dc-9774-e555df3fa0fa admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.915216 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75449d-685a-48dc-9774-e555df3fa0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.915498 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75449d-685a-48dc-9774-e555df3fa0fa admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:02.916373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75449d-685a-48dc-9774-e555df3fa0fa admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:02.918526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75449d-685a-48dc-9774-e555df3fa0fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.923266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75449d-685a-48dc-9774-e555df3fa0fa admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.933329 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f935b-fb15-44c9-9d89-9be463543113 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:02.935616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f935b-fb15-44c9-9d89-9be463543113 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:02.963870 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-432f935b-fb15-44c9-9d89-9be463543113 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:02.965972 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 280/563] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:02.974896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 284/564] 10.222.0.50 () {56 vars in 1156 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:02.976409 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f935b-fb15-44c9-9d89-9be463543113 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.977972 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75449d-685a-48dc-9774-e555df3fa0fa admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:02.987966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f935b-fb15-44c9-9d89-9be463543113 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:02.993396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff28e96-0d0b-4238-ab5e-ab3df572f2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:02.994523 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28e96-0d0b-4238-ab5e-ab3df572f2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:02.994995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28e96-0d0b-4238-ab5e-ab3df572f2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:02.995423 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28e96-0d0b-4238-ab5e-ab3df572f2d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:03.006238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75449d-685a-48dc-9774-e555df3fa0fa admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:03.009697 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff28e96-0d0b-4238-ab5e-ab3df572f2d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:03.011952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff28e96-0d0b-4238-ab5e-ab3df572f2d7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:03.022108 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3179150-8304-4634-b506-c49fda8218ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:03.023005 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179150-8304-4634-b506-c49fda8218ef admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:03.023401 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179150-8304-4634-b506-c49fda8218ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:03.023877 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179150-8304-4634-b506-c49fda8218ef admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:03.024728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3179150-8304-4634-b506-c49fda8218ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:03.025168 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3179150-8304-4634-b506-c49fda8218ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:03.026933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3179150-8304-4634-b506-c49fda8218ef admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:03.035826 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-cff28e96-0d0b-4238-ab5e-ab3df572f2d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:03.037344 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 281/565] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:03.045645 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff28e96-0d0b-4238-ab5e-ab3df572f2d7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:03.048450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 285/566] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:03.055430 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3179150-8304-4634-b506-c49fda8218ef admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:03.058783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff28e96-0d0b-4238-ab5e-ab3df572f2d7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:03.064624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e752c0d-f416-4013-8f24-521a10a137fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:03.065634 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752c0d-f416-4013-8f24-521a10a137fe admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:03.066311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3179150-8304-4634-b506-c49fda8218ef admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:03.066795 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752c0d-f416-4013-8f24-521a10a137fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:03.067252 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752c0d-f416-4013-8f24-521a10a137fe admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:03.068218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e752c0d-f416-4013-8f24-521a10a137fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:03.068788 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e752c0d-f416-4013-8f24-521a10a137fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:03.071012 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e752c0d-f416-4013-8f24-521a10a137fe admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:03.071207 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71aaee-6cb7-4c3f-afc6-adea713fe8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:03.072116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71aaee-6cb7-4c3f-afc6-adea713fe8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:03.072508 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71aaee-6cb7-4c3f-afc6-adea713fe8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:03.072887 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71aaee-6cb7-4c3f-afc6-adea713fe8b5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:03.083449 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71aaee-6cb7-4c3f-afc6-adea713fe8b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:03.085454 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71aaee-6cb7-4c3f-afc6-adea713fe8b5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:03.087505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 282/567] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:03.104674 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e752c0d-f416-4013-8f24-521a10a137fe admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:03.106788 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-ce71aaee-6cb7-4c3f-afc6-adea713fe8b5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:03.108182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 286/568] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:03.115262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71aaee-6cb7-4c3f-afc6-adea713fe8b5 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:03.118350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e752c0d-f416-4013-8f24-521a10a137fe admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:03.127373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71aaee-6cb7-4c3f-afc6-adea713fe8b5 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:03.127710 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c75475-ef43-4af9-b17b-7876b68c935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:03.128857 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c75475-ef43-4af9-b17b-7876b68c935d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:03.129353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c75475-ef43-4af9-b17b-7876b68c935d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:03.129846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c75475-ef43-4af9-b17b-7876b68c935d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:03.134052 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc94596-66e9-41e5-b397-1c2f3ff3312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:03.134890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94596-66e9-41e5-b397-1c2f3ff3312f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:03.135319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94596-66e9-41e5-b397-1c2f3ff3312f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:03.135737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94596-66e9-41e5-b397-1c2f3ff3312f admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:03.136658 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc94596-66e9-41e5-b397-1c2f3ff3312f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:03.137133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc94596-66e9-41e5-b397-1c2f3ff3312f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:03.139452 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc94596-66e9-41e5-b397-1c2f3ff3312f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:03.140024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c75475-ef43-4af9-b17b-7876b68c935d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:03.142355 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c75475-ef43-4af9-b17b-7876b68c935d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:03.156556 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 287/569] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:03.161805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-19c75475-ef43-4af9-b17b-7876b68c935d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:03.161805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 283/570] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:03.166967 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc94596-66e9-41e5-b397-1c2f3ff3312f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:03.167131 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c75475-ef43-4af9-b17b-7876b68c935d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:03.180203 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c75475-ef43-4af9-b17b-7876b68c935d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:03.181576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc94596-66e9-41e5-b397-1c2f3ff3312f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:03.185473 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdae54-97d8-4001-8d80-1f97a2ae5b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:03.186389 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdae54-97d8-4001-8d80-1f97a2ae5b43 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:03.186781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdae54-97d8-4001-8d80-1f97a2ae5b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:03.186979 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525ba8b-251e-4d07-8d26-1d51bff43372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:03.187373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdae54-97d8-4001-8d80-1f97a2ae5b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:03.187930 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525ba8b-251e-4d07-8d26-1d51bff43372 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:03.188350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525ba8b-251e-4d07-8d26-1d51bff43372 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:03.188458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdae54-97d8-4001-8d80-1f97a2ae5b43 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:03.188863 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525ba8b-251e-4d07-8d26-1d51bff43372 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:03.189054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdae54-97d8-4001-8d80-1f97a2ae5b43 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:03.189960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525ba8b-251e-4d07-8d26-1d51bff43372 admin admin] RBAC: Adding query filter params (role.id=de4c885bb354403b98a2f1aefb43754e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=292b73337e674cdfa9c05fe67040cf94) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:03.190585 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525ba8b-251e-4d07-8d26-1d51bff43372 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:03.191457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdae54-97d8-4001-8d80-1f97a2ae5b43 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:03.194256 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525ba8b-251e-4d07-8d26-1d51bff43372 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:03.201562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 288/571] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:03 2021] GET /identity/v3/role_assignments?user.id=292b73337e674cdfa9c05fe67040cf94&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=de4c885bb354403b98a2f1aefb43754e => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:03.206944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 284/572] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:03.216947 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525ba8b-251e-4d07-8d26-1d51bff43372 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:03.233002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525ba8b-251e-4d07-8d26-1d51bff43372 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:03.242133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ad8e4-ef99-4df0-997b-6b99d5f25451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:03.243286 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ad8e4-ef99-4df0-997b-6b99d5f25451 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:03.243677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ad8e4-ef99-4df0-997b-6b99d5f25451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:03.244084 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ad8e4-ef99-4df0-997b-6b99d5f25451 admin admin] PATH_INFO: `/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/0ac32c6730654a889472a3bad95374bc/roles/de4c885bb354403b98a2f1aefb43754e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:03.270355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ad8e4-ef99-4df0-997b-6b99d5f25451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce43bc1cdb744a2b2c65dd4c50d6599, user_id=0ac32c6730654a889472a3bad95374bc, role_id=de4c885bb354403b98a2f1aefb43754e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:03.273242 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ad8e4-ef99-4df0-997b-6b99d5f25451 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:03.293760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 289/573] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:20:03 2021] PUT /identity/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/0ac32c6730654a889472a3bad95374bc/roles/de4c885bb354403b98a2f1aefb43754e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:20:04.721012 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73d10b-cb47-46df-9165-ba0039657b72 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:04.722315 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73d10b-cb47-46df-9165-ba0039657b72 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:04.722431 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73d10b-cb47-46df-9165-ba0039657b72 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:04.724474 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 285/574] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:04.732169 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7594d-8c24-46f9-83b9-7b2675e3866b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:04.732624 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7594d-8c24-46f9-83b9-7b2675e3866b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:04.732734 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7594d-8c24-46f9-83b9-7b2675e3866b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:04.751139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-d1f7594d-8c24-46f9-83b9-7b2675e3866b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:04.752347 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d1f7594d-8c24-46f9-83b9-7b2675e3866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:04.812213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 290/575] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:04.837843 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73d10b-cb47-46df-9165-ba0039657b72 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:04.851142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73d10b-cb47-46df-9165-ba0039657b72 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:04.855585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc9779-2b19-4c06-890a-1cb8a714c985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:04.856446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc9779-2b19-4c06-890a-1cb8a714c985 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:04.856742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc9779-2b19-4c06-890a-1cb8a714c985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:04.857026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc9779-2b19-4c06-890a-1cb8a714c985 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:04.875426 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc9779-2b19-4c06-890a-1cb8a714c985 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:04.882244 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-86bc9779-2b19-4c06-890a-1cb8a714c985 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:20:04.883778 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 286/576] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:20:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:04.890327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7594d-8c24-46f9-83b9-7b2675e3866b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:04.899550 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7594d-8c24-46f9-83b9-7b2675e3866b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:04.911461 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde640a-93be-436a-b330-e697a3023199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:04.912136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde640a-93be-436a-b330-e697a3023199 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:04.912428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde640a-93be-436a-b330-e697a3023199 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:04.912711 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde640a-93be-436a-b330-e697a3023199 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:04.913470 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde640a-93be-436a-b330-e697a3023199 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:04.913780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde640a-93be-436a-b330-e697a3023199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:04.915419 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde640a-93be-436a-b330-e697a3023199 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:04.929954 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 291/577] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:20:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:04.936074 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc9779-2b19-4c06-890a-1cb8a714c985 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:04.951959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc9779-2b19-4c06-890a-1cb8a714c985 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:04.957767 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16902ef5-0eae-462c-83b6-021859e302af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:04.958575 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16902ef5-0eae-462c-83b6-021859e302af admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:04.958889 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16902ef5-0eae-462c-83b6-021859e302af admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:04.959250 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16902ef5-0eae-462c-83b6-021859e302af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:04.975457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16902ef5-0eae-462c-83b6-021859e302af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:04.977251 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16902ef5-0eae-462c-83b6-021859e302af admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.007101 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-16902ef5-0eae-462c-83b6-021859e302af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:05.008331 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 287/578] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:05.014545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde640a-93be-436a-b330-e697a3023199 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.024837 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde640a-93be-436a-b330-e697a3023199 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.029467 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b8e9b-ce7b-4f98-81cc-5e3cecc59e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.030131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b8e9b-ce7b-4f98-81cc-5e3cecc59e4d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.030418 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b8e9b-ce7b-4f98-81cc-5e3cecc59e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.030700 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b8e9b-ce7b-4f98-81cc-5e3cecc59e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.031470 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b8e9b-ce7b-4f98-81cc-5e3cecc59e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:05.031781 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b8e9b-ce7b-4f98-81cc-5e3cecc59e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.033395 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b8e9b-ce7b-4f98-81cc-5e3cecc59e4d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.045890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 292/579] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:05.052535 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16902ef5-0eae-462c-83b6-021859e302af admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.067216 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16902ef5-0eae-462c-83b6-021859e302af admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.076390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f6423-3408-481e-8c7d-73f944b1d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.077186 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f6423-3408-481e-8c7d-73f944b1d095 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.077474 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f6423-3408-481e-8c7d-73f944b1d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.077983 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f6423-3408-481e-8c7d-73f944b1d095 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.092045 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f6423-3408-481e-8c7d-73f944b1d095 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.094158 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f6423-3408-481e-8c7d-73f944b1d095 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.114950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-fb2f6423-3408-481e-8c7d-73f944b1d095 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 00:20:05.116152 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 288/580] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:05.122319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b8e9b-ce7b-4f98-81cc-5e3cecc59e4d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.134391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b8e9b-ce7b-4f98-81cc-5e3cecc59e4d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.139063 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d73aa-e306-4746-ab74-ef441d287280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.139737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d73aa-e306-4746-ab74-ef441d287280 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.140025 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d73aa-e306-4746-ab74-ef441d287280 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.140303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d73aa-e306-4746-ab74-ef441d287280 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.141154 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d73aa-e306-4746-ab74-ef441d287280 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:05.141467 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d73aa-e306-4746-ab74-ef441d287280 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.143469 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d73aa-e306-4746-ab74-ef441d287280 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.171073 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 293/581] 10.222.0.50 () {56 vars in 1154 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:05.178883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f6423-3408-481e-8c7d-73f944b1d095 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.189356 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f6423-3408-481e-8c7d-73f944b1d095 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.195778 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1ee15-aa32-4151-9a1b-5a74c7f1f45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.196450 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1ee15-aa32-4151-9a1b-5a74c7f1f45b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.196746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1ee15-aa32-4151-9a1b-5a74c7f1f45b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.197030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1ee15-aa32-4151-9a1b-5a74c7f1f45b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.206955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1ee15-aa32-4151-9a1b-5a74c7f1f45b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.209165 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1ee15-aa32-4151-9a1b-5a74c7f1f45b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.222243 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 289/582] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:20:05.228542 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d73aa-e306-4746-ab74-ef441d287280 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.242374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d73aa-e306-4746-ab74-ef441d287280 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.247158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ec9cf-6779-48e6-aa71-d4c189d2cb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.247953 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ec9cf-6779-48e6-aa71-d4c189d2cb01 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.248239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ec9cf-6779-48e6-aa71-d4c189d2cb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.248519 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ec9cf-6779-48e6-aa71-d4c189d2cb01 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.262560 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ec9cf-6779-48e6-aa71-d4c189d2cb01 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.264565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ec9cf-6779-48e6-aa71-d4c189d2cb01 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.283037 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-405ec9cf-6779-48e6-aa71-d4c189d2cb01 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:05.285305 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 294/583] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:05.291324 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1ee15-aa32-4151-9a1b-5a74c7f1f45b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.299868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77783f3-6315-43e4-99c3-ee21079cd9cf None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.300162 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77783f3-6315-43e4-99c3-ee21079cd9cf None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.300446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77783f3-6315-43e4-99c3-ee21079cd9cf None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.304894 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1ee15-aa32-4151-9a1b-5a74c7f1f45b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.305557 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 295/584] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:20:05.309612 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec14417-4d0e-4a1e-986d-fbb90a98a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.310273 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec14417-4d0e-4a1e-986d-fbb90a98a862 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.310564 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec14417-4d0e-4a1e-986d-fbb90a98a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.310734 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091f2f-5940-4eed-9a90-b005fdf6de75 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.310826 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec14417-4d0e-4a1e-986d-fbb90a98a862 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.311071 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091f2f-5940-4eed-9a90-b005fdf6de75 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.311354 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091f2f-5940-4eed-9a90-b005fdf6de75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.311594 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec14417-4d0e-4a1e-986d-fbb90a98a862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:05.311908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec14417-4d0e-4a1e-986d-fbb90a98a862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.313531 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec14417-4d0e-4a1e-986d-fbb90a98a862 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.336036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 290/585] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:05.343448 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c9091f2f-5940-4eed-9a90-b005fdf6de75 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:05.344709 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c9091f2f-5940-4eed-9a90-b005fdf6de75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:05.350425 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec14417-4d0e-4a1e-986d-fbb90a98a862 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.360478 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 296/586] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:05.362170 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec14417-4d0e-4a1e-986d-fbb90a98a862 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.367134 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28bf7c-5efd-477b-bdcc-b87dd8a78d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.368207 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28bf7c-5efd-477b-bdcc-b87dd8a78d66 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.368500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28bf7c-5efd-477b-bdcc-b87dd8a78d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.368837 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28bf7c-5efd-477b-bdcc-b87dd8a78d66 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.389717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9091f2f-5940-4eed-9a90-b005fdf6de75 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.389893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28bf7c-5efd-477b-bdcc-b87dd8a78d66 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.389893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28bf7c-5efd-477b-bdcc-b87dd8a78d66 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.397383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9091f2f-5940-4eed-9a90-b005fdf6de75 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.402038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d36f77-97fd-49e6-b49a-e830659706db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.403004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d36f77-97fd-49e6-b49a-e830659706db admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.403289 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d36f77-97fd-49e6-b49a-e830659706db admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.403565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d36f77-97fd-49e6-b49a-e830659706db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.411011 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-4f28bf7c-5efd-477b-bdcc-b87dd8a78d66 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:05.412771 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 291/587] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:05.419800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28bf7c-5efd-477b-bdcc-b87dd8a78d66 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.422856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d36f77-97fd-49e6-b49a-e830659706db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.423149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d36f77-97fd-49e6-b49a-e830659706db admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.441358 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-49d36f77-97fd-49e6-b49a-e830659706db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:05.443068 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 297/588] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:05.445474 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28bf7c-5efd-477b-bdcc-b87dd8a78d66 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.449273 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d36f77-97fd-49e6-b49a-e830659706db admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.458037 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f762a46-ff7a-413b-b9cb-f3077f18898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.459861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f762a46-ff7a-413b-b9cb-f3077f18898b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.460443 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f762a46-ff7a-413b-b9cb-f3077f18898b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.462642 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d36f77-97fd-49e6-b49a-e830659706db admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.463079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f762a46-ff7a-413b-b9cb-f3077f18898b admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.463998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f762a46-ff7a-413b-b9cb-f3077f18898b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:05.464448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f762a46-ff7a-413b-b9cb-f3077f18898b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.466442 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f762a46-ff7a-413b-b9cb-f3077f18898b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.479031 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c482bb-3829-478d-bfb0-d021f8a3e844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.479769 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c482bb-3829-478d-bfb0-d021f8a3e844 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.480165 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c482bb-3829-478d-bfb0-d021f8a3e844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.480551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c482bb-3829-478d-bfb0-d021f8a3e844 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.481392 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c482bb-3829-478d-bfb0-d021f8a3e844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:05.481813 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c482bb-3829-478d-bfb0-d021f8a3e844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.483569 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c482bb-3829-478d-bfb0-d021f8a3e844 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.493887 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 292/589] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:05.505303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f762a46-ff7a-413b-b9cb-f3077f18898b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.512387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 298/590] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:05.517483 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f762a46-ff7a-413b-b9cb-f3077f18898b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.519256 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c482bb-3829-478d-bfb0-d021f8a3e844 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.529527 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c482bb-3829-478d-bfb0-d021f8a3e844 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.531877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eeb76-540b-4ade-afd8-4f2e62dfeaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.532703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eeb76-540b-4ade-afd8-4f2e62dfeaea admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.533135 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eeb76-540b-4ade-afd8-4f2e62dfeaea admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.533556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eeb76-540b-4ade-afd8-4f2e62dfeaea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.534678 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1eeb76-540b-4ade-afd8-4f2e62dfeaea admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=442cc0e13dcb49f0a4a870c06e0edf1d) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:05.535164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1eeb76-540b-4ade-afd8-4f2e62dfeaea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.535293 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b40a3-bbc1-4669-84a6-e78597fb2a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.536139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b40a3-bbc1-4669-84a6-e78597fb2a5b admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.536530 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b40a3-bbc1-4669-84a6-e78597fb2a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.536996 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b40a3-bbc1-4669-84a6-e78597fb2a5b admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.537798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1eeb76-540b-4ade-afd8-4f2e62dfeaea admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.537912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b40a3-bbc1-4669-84a6-e78597fb2a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.546857 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b40a3-bbc1-4669-84a6-e78597fb2a5b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.554171 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 293/591] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/role_assignments?user.id=442cc0e13dcb49f0a4a870c06e0edf1d&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=2813231cc8954b998440e4bf5ede2945 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:05.574048 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 299/592] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Nov 16 00:20:05 2021] POST /identity/v3/users => generated 254 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:20:05.820583 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615a27-7a7d-473a-8c3e-09064a4a2c33 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.821116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615a27-7a7d-473a-8c3e-09064a4a2c33 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.821371 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615a27-7a7d-473a-8c3e-09064a4a2c33 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.823436 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 294/593] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:05.831916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2111c-efec-4b2a-89e5-39c0906d6ae0 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.832450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2111c-efec-4b2a-89e5-39c0906d6ae0 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.832450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2111c-efec-4b2a-89e5-39c0906d6ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.838068 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b83c77-944e-4399-bd7c-5641be096f4c None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.838356 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b83c77-944e-4399-bd7c-5641be096f4c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.838772 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b83c77-944e-4399-bd7c-5641be096f4c None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.840434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 295/594] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:20:05.849521 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79ec63-afb5-4b7c-87ce-3ef19fed3f81 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.849815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79ec63-afb5-4b7c-87ce-3ef19fed3f81 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.850073 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79ec63-afb5-4b7c-87ce-3ef19fed3f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.855274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c6f2111c-efec-4b2a-89e5-39c0906d6ae0 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:05.856585 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c6f2111c-efec-4b2a-89e5-39c0906d6ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:05.869323 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 300/595] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:05.869514 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-1c79ec63-afb5-4b7c-87ce-3ef19fed3f81 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:05.870621 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1c79ec63-afb5-4b7c-87ce-3ef19fed3f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:05.880995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 296/596] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:05.895932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2111c-efec-4b2a-89e5-39c0906d6ae0 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.905510 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79ec63-afb5-4b7c-87ce-3ef19fed3f81 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.909121 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2111c-efec-4b2a-89e5-39c0906d6ae0 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.915081 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d05c8e-eef6-4c04-a6eb-8fa44387fd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.915255 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79ec63-afb5-4b7c-87ce-3ef19fed3f81 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.916552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d05c8e-eef6-4c04-a6eb-8fa44387fd83 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.917263 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d05c8e-eef6-4c04-a6eb-8fa44387fd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.918033 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d05c8e-eef6-4c04-a6eb-8fa44387fd83 admin admin] PATH_INFO: `/v3/services/network` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.919133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d05c8e-eef6-4c04-a6eb-8fa44387fd83 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.920412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd5a74-8ebd-4b98-b7eb-4ac302527a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.920767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-90d05c8e-eef6-4c04-a6eb-8fa44387fd83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:20:05.920767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:20:05.920767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:20:05.921355 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd5a74-8ebd-4b98-b7eb-4ac302527a06 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.921723 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd5a74-8ebd-4b98-b7eb-4ac302527a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.922070 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd5a74-8ebd-4b98-b7eb-4ac302527a06 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.928886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d05c8e-eef6-4c04-a6eb-8fa44387fd83 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.943247 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd5a74-8ebd-4b98-b7eb-4ac302527a06 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:05.946251 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-90d05c8e-eef6-4c04-a6eb-8fa44387fd83 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 16 00:20:05.950392 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-0cfd5a74-8ebd-4b98-b7eb-4ac302527a06 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:20:05.952099 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 297/597] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:05.956238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 301/598] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/services/network => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:05.959774 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd5a74-8ebd-4b98-b7eb-4ac302527a06 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.961099 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d05c8e-eef6-4c04-a6eb-8fa44387fd83 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:05.976675 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d05c8e-eef6-4c04-a6eb-8fa44387fd83 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.976852 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd5a74-8ebd-4b98-b7eb-4ac302527a06 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:05.983302 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b5123-346d-44be-87b5-7549bbaaef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.983701 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701c6c3-af04-4665-8a22-0e159dffec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:05.983967 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5123-346d-44be-87b5-7549bbaaef6e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.984253 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5123-346d-44be-87b5-7549bbaaef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.984356 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c6c3-af04-4665-8a22-0e159dffec78 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:05.984570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5123-346d-44be-87b5-7549bbaaef6e admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.984662 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c6c3-af04-4665-8a22-0e159dffec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:05.984899 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c6c3-af04-4665-8a22-0e159dffec78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:05.985232 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b5123-346d-44be-87b5-7549bbaaef6e admin admin] RBAC: Adding query filter params (name=network) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:05.985541 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b5123-346d-44be-87b5-7549bbaaef6e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.985648 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701c6c3-af04-4665-8a22-0e159dffec78 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:05.985936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701c6c3-af04-4665-8a22-0e159dffec78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:05.986566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-2d6b5123-346d-44be-87b5-7549bbaaef6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:20:05.986566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:20:05.986566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:20:05.988247 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b5123-346d-44be-87b5-7549bbaaef6e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.988447 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701c6c3-af04-4665-8a22-0e159dffec78 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:05.993301 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 302/599] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/services?name=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:05.998216 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 298/600] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:05.999983 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b5123-346d-44be-87b5-7549bbaaef6e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:06.005349 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701c6c3-af04-4665-8a22-0e159dffec78 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:06.014170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b5123-346d-44be-87b5-7549bbaaef6e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:06.014807 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701c6c3-af04-4665-8a22-0e159dffec78 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:06.019260 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7f5f4-7f5b-48ab-93f9-51447d838f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:06.020068 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7f5f4-7f5b-48ab-93f9-51447d838f84 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.020179 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67651cf-74cd-4529-8a64-d6154d1054c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:06.020392 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7f5f4-7f5b-48ab-93f9-51447d838f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.020679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7f5f4-7f5b-48ab-93f9-51447d838f84 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.020862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67651cf-74cd-4529-8a64-d6154d1054c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.021137 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67651cf-74cd-4529-8a64-d6154d1054c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.021398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7f5f4-7f5b-48ab-93f9-51447d838f84 admin admin] RBAC: Adding query filter params (type=network) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:06.021498 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67651cf-74cd-4529-8a64-d6154d1054c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.021818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7f5f4-7f5b-48ab-93f9-51447d838f84 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:06.023943 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7f5f4-7f5b-48ab-93f9-51447d838f84 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:06.031834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67651cf-74cd-4529-8a64-d6154d1054c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:06.031961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 303/601] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Nov 16 00:20:05 2021] GET /identity/v3/services?type=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:06.033660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67651cf-74cd-4529-8a64-d6154d1054c8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:06.055680 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-e67651cf-74cd-4529-8a64-d6154d1054c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:06.057312 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 299/602] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:06.063769 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7f5f4-7f5b-48ab-93f9-51447d838f84 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:06.075355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7f5f4-7f5b-48ab-93f9-51447d838f84 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:06.096325 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4c1b-f272-46af-bf2d-ea368756e0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:06.102868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4c1b-f272-46af-bf2d-ea368756e0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.102868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4c1b-f272-46af-bf2d-ea368756e0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.102868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4c1b-f272-46af-bf2d-ea368756e0f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.102868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c4c1b-f272-46af-bf2d-ea368756e0f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:06.102868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c4c1b-f272-46af-bf2d-ea368756e0f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:06.102868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c4c1b-f272-46af-bf2d-ea368756e0f4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:06.127636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 304/603] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:06.135140 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67651cf-74cd-4529-8a64-d6154d1054c8 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:06.157219 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67651cf-74cd-4529-8a64-d6154d1054c8 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:06.166794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d6c95-08e6-4454-8e37-5870b4781806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:06.167767 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d6c95-08e6-4454-8e37-5870b4781806 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.168061 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d6c95-08e6-4454-8e37-5870b4781806 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.168389 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d6c95-08e6-4454-8e37-5870b4781806 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.177951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d6c95-08e6-4454-8e37-5870b4781806 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:06.180183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d6c95-08e6-4454-8e37-5870b4781806 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:06.198101 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-197d6c95-08e6-4454-8e37-5870b4781806 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 16 00:20:06.199802 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 300/604] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:20:06 2021] GET /identity/v3/users/swift => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:06.206332 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4c1b-f272-46af-bf2d-ea368756e0f4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:06.216820 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4c1b-f272-46af-bf2d-ea368756e0f4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:06.222302 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79b13f-9112-4f19-bce5-ef2573411720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:06.223719 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79b13f-9112-4f19-bce5-ef2573411720 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.224004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79b13f-9112-4f19-bce5-ef2573411720 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.224318 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79b13f-9112-4f19-bce5-ef2573411720 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.225168 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79b13f-9112-4f19-bce5-ef2573411720 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:06.225475 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79b13f-9112-4f19-bce5-ef2573411720 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:06.227380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79b13f-9112-4f19-bce5-ef2573411720 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:06.247390 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 305/605] 10.222.0.50 () {56 vars in 1156 bytes} [Tue Nov 16 00:20:06 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:06.253528 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d6c95-08e6-4454-8e37-5870b4781806 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:06.264367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d6c95-08e6-4454-8e37-5870b4781806 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:06.269140 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc7e4e-dd21-4034-a593-8ed9ecffc52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:06.269859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc7e4e-dd21-4034-a593-8ed9ecffc52f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.270197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc7e4e-dd21-4034-a593-8ed9ecffc52f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.270483 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc7e4e-dd21-4034-a593-8ed9ecffc52f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.278897 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc7e4e-dd21-4034-a593-8ed9ecffc52f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:06.280664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc7e4e-dd21-4034-a593-8ed9ecffc52f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:06.290894 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 301/606] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:20:06.297043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79b13f-9112-4f19-bce5-ef2573411720 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:06.307505 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79b13f-9112-4f19-bce5-ef2573411720 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:06.312231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ee81b-6a22-4662-b928-cbaba2f28d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:06.313059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ee81b-6a22-4662-b928-cbaba2f28d45 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.313375 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ee81b-6a22-4662-b928-cbaba2f28d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.313659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ee81b-6a22-4662-b928-cbaba2f28d45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.324679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ee81b-6a22-4662-b928-cbaba2f28d45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:06.326659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ee81b-6a22-4662-b928-cbaba2f28d45 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:06.344818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-1a0ee81b-6a22-4662-b928-cbaba2f28d45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:06.346353 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 306/607] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:06.353529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc7e4e-dd21-4034-a593-8ed9ecffc52f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:06.364186 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc7e4e-dd21-4034-a593-8ed9ecffc52f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:06.369035 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c48c1-9360-42c7-bf78-a7b5068c6653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:06.369724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c48c1-9360-42c7-bf78-a7b5068c6653 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.370012 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c48c1-9360-42c7-bf78-a7b5068c6653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.370289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c48c1-9360-42c7-bf78-a7b5068c6653 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.371053 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c48c1-9360-42c7-bf78-a7b5068c6653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:06.371360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c48c1-9360-42c7-bf78-a7b5068c6653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:06.372999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c48c1-9360-42c7-bf78-a7b5068c6653 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:06.385563 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 302/608] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:06.391649 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ee81b-6a22-4662-b928-cbaba2f28d45 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:06.402702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ee81b-6a22-4662-b928-cbaba2f28d45 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:06.407384 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460f649-68e5-4e9d-9df2-04b6ba73e762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:06.408220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460f649-68e5-4e9d-9df2-04b6ba73e762 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.408502 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460f649-68e5-4e9d-9df2-04b6ba73e762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.408830 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460f649-68e5-4e9d-9df2-04b6ba73e762 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.416981 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460f649-68e5-4e9d-9df2-04b6ba73e762 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:06.419029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460f649-68e5-4e9d-9df2-04b6ba73e762 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:06.432755 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-8460f649-68e5-4e9d-9df2-04b6ba73e762 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:06.434150 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 307/609] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:06.440741 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c48c1-9360-42c7-bf78-a7b5068c6653 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:06.451344 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c48c1-9360-42c7-bf78-a7b5068c6653 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:06.458408 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d9c3f-35ab-4722-9e3a-81f809ddfdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:06.459170 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d9c3f-35ab-4722-9e3a-81f809ddfdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.459459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d9c3f-35ab-4722-9e3a-81f809ddfdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.459737 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d9c3f-35ab-4722-9e3a-81f809ddfdc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.460589 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d9c3f-35ab-4722-9e3a-81f809ddfdc3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:06.460903 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d9c3f-35ab-4722-9e3a-81f809ddfdc3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:06.462865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d9c3f-35ab-4722-9e3a-81f809ddfdc3 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:06.478255 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 303/610] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:06.485109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460f649-68e5-4e9d-9df2-04b6ba73e762 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:06.500110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460f649-68e5-4e9d-9df2-04b6ba73e762 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:06.507304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad3dad-f98f-4d4f-b7d9-b941724658f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:06.508171 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad3dad-f98f-4d4f-b7d9-b941724658f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.508518 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad3dad-f98f-4d4f-b7d9-b941724658f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.508794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad3dad-f98f-4d4f-b7d9-b941724658f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.509687 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad3dad-f98f-4d4f-b7d9-b941724658f1 admin admin] RBAC: Adding query filter params (role.id=de4c885bb354403b98a2f1aefb43754e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=0ac32c6730654a889472a3bad95374bc) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:06.510035 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad3dad-f98f-4d4f-b7d9-b941724658f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:06.512002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad3dad-f98f-4d4f-b7d9-b941724658f1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:06.520103 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 308/611] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:06 2021] GET /identity/v3/role_assignments?user.id=0ac32c6730654a889472a3bad95374bc&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=de4c885bb354403b98a2f1aefb43754e => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:06.605086 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e56a5-375d-4d58-b4ff-b273f5a0c261 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.605465 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e56a5-375d-4d58-b4ff-b273f5a0c261 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.605873 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e56a5-375d-4d58-b4ff-b273f5a0c261 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.608134 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 304/612] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:06.616028 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef4e7f-8608-4b62-8db2-ecd359fd4a0a None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.616463 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef4e7f-8608-4b62-8db2-ecd359fd4a0a None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.616848 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef4e7f-8608-4b62-8db2-ecd359fd4a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.635404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-0cef4e7f-8608-4b62-8db2-ecd359fd4a0a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:06.636663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0cef4e7f-8608-4b62-8db2-ecd359fd4a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:06.645828 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 309/613] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:06.670027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e56a5-375d-4d58-b4ff-b273f5a0c261 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:06.684346 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e56a5-375d-4d58-b4ff-b273f5a0c261 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:06.689000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caece75-c97e-4946-9a4a-cf7845a0b10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:06.689860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caece75-c97e-4946-9a4a-cf7845a0b10a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.690148 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caece75-c97e-4946-9a4a-cf7845a0b10a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.690452 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caece75-c97e-4946-9a4a-cf7845a0b10a admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.691441 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caece75-c97e-4946-9a4a-cf7845a0b10a admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:06.692530 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-9caece75-c97e-4946-9a4a-cf7845a0b10a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:20:06.692530 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:20:06.692530 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:20:06.693533 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caece75-c97e-4946-9a4a-cf7845a0b10a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:06.708328 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-9caece75-c97e-4946-9a4a-cf7845a0b10a admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 16 00:20:06.709866 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 305/614] 10.222.0.50 () {56 vars in 1150 bytes} [Tue Nov 16 00:20:06 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:06.716576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef4e7f-8608-4b62-8db2-ecd359fd4a0a None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:06.726910 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef4e7f-8608-4b62-8db2-ecd359fd4a0a None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:06.731705 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70054265-0e16-4d37-b84a-19d0aa9fb22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:06.732465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70054265-0e16-4d37-b84a-19d0aa9fb22a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.732744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70054265-0e16-4d37-b84a-19d0aa9fb22a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.733016 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70054265-0e16-4d37-b84a-19d0aa9fb22a admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.733782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70054265-0e16-4d37-b84a-19d0aa9fb22a admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:06.734084 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70054265-0e16-4d37-b84a-19d0aa9fb22a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:06.735872 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70054265-0e16-4d37-b84a-19d0aa9fb22a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:06.741139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 310/615] 10.222.0.50 () {56 vars in 1145 bytes} [Tue Nov 16 00:20:06 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:06.747347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caece75-c97e-4946-9a4a-cf7845a0b10a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:06.760242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caece75-c97e-4946-9a4a-cf7845a0b10a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:06.767278 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd17015-a1b0-418a-a9b2-652188b96574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:06.768013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17015-a1b0-418a-a9b2-652188b96574 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:06.768269 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17015-a1b0-418a-a9b2-652188b96574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:06.769265 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17015-a1b0-418a-a9b2-652188b96574 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:06.770014 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd17015-a1b0-418a-a9b2-652188b96574 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:06.770332 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd17015-a1b0-418a-a9b2-652188b96574 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:06.771421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-4cd17015-a1b0-418a-a9b2-652188b96574 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:20:06.771421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:20:06.771421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:20:06.772343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd17015-a1b0-418a-a9b2-652188b96574 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:06.785066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 306/616] 10.222.0.50 () {56 vars in 1145 bytes} [Tue Nov 16 00:20:06 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:08.165280 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68115935-2910-4786-a2c6-fa69ea45ed34 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.166323 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68115935-2910-4786-a2c6-fa69ea45ed34 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.166868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68115935-2910-4786-a2c6-fa69ea45ed34 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.169208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 311/617] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:08.177175 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f053d-36f9-4b44-9f2f-7a6d74599bd6 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.178083 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f053d-36f9-4b44-9f2f-7a6d74599bd6 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.178638 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f053d-36f9-4b44-9f2f-7a6d74599bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.203865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-c94f053d-36f9-4b44-9f2f-7a6d74599bd6 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:08.205395 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-c94f053d-36f9-4b44-9f2f-7a6d74599bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:08.218129 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 307/618] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:08.253524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68115935-2910-4786-a2c6-fa69ea45ed34 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.272663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68115935-2910-4786-a2c6-fa69ea45ed34 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.277369 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5d027-8263-4b24-9694-d85c75bef7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.278178 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d027-8263-4b24-9694-d85c75bef7da admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.278462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d027-8263-4b24-9694-d85c75bef7da admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.278735 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d027-8263-4b24-9694-d85c75bef7da admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.300059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5d027-8263-4b24-9694-d85c75bef7da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:08.306916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-18f5d027-8263-4b24-9694-d85c75bef7da admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:20:08.308174 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 312/619] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:08.314674 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f053d-36f9-4b44-9f2f-7a6d74599bd6 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.328824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f053d-36f9-4b44-9f2f-7a6d74599bd6 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.339220 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a70b5e-fc54-4b8b-a430-bc902946b7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.339906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a70b5e-fc54-4b8b-a430-bc902946b7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.340196 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a70b5e-fc54-4b8b-a430-bc902946b7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.340479 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a70b5e-fc54-4b8b-a430-bc902946b7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.341243 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a70b5e-fc54-4b8b-a430-bc902946b7e8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:08.341557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a70b5e-fc54-4b8b-a430-bc902946b7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.347531 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a70b5e-fc54-4b8b-a430-bc902946b7e8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.361286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 308/620] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:08.367472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5d027-8263-4b24-9694-d85c75bef7da admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.379071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4c20-3470-4f19-b2cd-0089ac69add0 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.379683 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4c20-3470-4f19-b2cd-0089ac69add0 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.380184 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4c20-3470-4f19-b2cd-0089ac69add0 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.380428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5d027-8263-4b24-9694-d85c75bef7da admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.382658 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 309/621] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:08.390547 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12cf25-3997-44af-84cf-c0abbbc9d5bd None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.390684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63495eb-40e4-420f-84a8-0e993ebf557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.391288 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12cf25-3997-44af-84cf-c0abbbc9d5bd None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.391475 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63495eb-40e4-420f-84a8-0e993ebf557c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.391718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63495eb-40e4-420f-84a8-0e993ebf557c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.391996 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63495eb-40e4-420f-84a8-0e993ebf557c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.392394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12cf25-3997-44af-84cf-c0abbbc9d5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.409376 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63495eb-40e4-420f-84a8-0e993ebf557c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.416192 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63495eb-40e4-420f-84a8-0e993ebf557c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.423223 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-6f12cf25-3997-44af-84cf-c0abbbc9d5bd None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:08.424416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6f12cf25-3997-44af-84cf-c0abbbc9d5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:08.439799 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-d63495eb-40e4-420f-84a8-0e993ebf557c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:08.441054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 310/622] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:08.441679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 313/623] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:08.447534 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12cf25-3997-44af-84cf-c0abbbc9d5bd None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.466398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12cf25-3997-44af-84cf-c0abbbc9d5bd None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.475409 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e85094-781a-45ec-8d3d-fa9493fb23e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.476322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e85094-781a-45ec-8d3d-fa9493fb23e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.476821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e85094-781a-45ec-8d3d-fa9493fb23e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.477330 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e85094-781a-45ec-8d3d-fa9493fb23e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.478270 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e85094-781a-45ec-8d3d-fa9493fb23e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:08.478789 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e85094-781a-45ec-8d3d-fa9493fb23e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.484764 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e85094-781a-45ec-8d3d-fa9493fb23e0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.497267 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63495eb-40e4-420f-84a8-0e993ebf557c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.499675 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 311/624] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:08.506216 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e85094-781a-45ec-8d3d-fa9493fb23e0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.507865 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63495eb-40e4-420f-84a8-0e993ebf557c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.516200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda63a90-7910-495b-8450-ef734f1bfae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.516200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda63a90-7910-495b-8450-ef734f1bfae2 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.516200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda63a90-7910-495b-8450-ef734f1bfae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.516200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda63a90-7910-495b-8450-ef734f1bfae2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.521098 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e85094-781a-45ec-8d3d-fa9493fb23e0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.531316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521edd3-492b-48d9-90a4-c3ebcb5a574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.532122 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521edd3-492b-48d9-90a4-c3ebcb5a574d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.532407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521edd3-492b-48d9-90a4-c3ebcb5a574d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.532685 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521edd3-492b-48d9-90a4-c3ebcb5a574d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.539363 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda63a90-7910-495b-8450-ef734f1bfae2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:08.550747 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-cda63a90-7910-495b-8450-ef734f1bfae2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:20:08.552553 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 314/625] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:08.553774 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521edd3-492b-48d9-90a4-c3ebcb5a574d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.555950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521edd3-492b-48d9-90a4-c3ebcb5a574d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.559819 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda63a90-7910-495b-8450-ef734f1bfae2 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.577032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-d521edd3-492b-48d9-90a4-c3ebcb5a574d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 00:20:08.580769 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda63a90-7910-495b-8450-ef734f1bfae2 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.584143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 312/626] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/users/nova => generated 82 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:08.587296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60416c6e-553d-4527-b0ab-9229b04f0864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.589006 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521edd3-492b-48d9-90a4-c3ebcb5a574d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.589438 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60416c6e-553d-4527-b0ab-9229b04f0864 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.589724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60416c6e-553d-4527-b0ab-9229b04f0864 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.589999 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60416c6e-553d-4527-b0ab-9229b04f0864 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.590748 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60416c6e-553d-4527-b0ab-9229b04f0864 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:08.591081 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60416c6e-553d-4527-b0ab-9229b04f0864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.598211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60416c6e-553d-4527-b0ab-9229b04f0864 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.603975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521edd3-492b-48d9-90a4-c3ebcb5a574d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.614126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 315/627] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:08.614715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3e6be-6bdc-4663-b53f-0c9f5f200f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.615459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3e6be-6bdc-4663-b53f-0c9f5f200f08 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.615748 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3e6be-6bdc-4663-b53f-0c9f5f200f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.616074 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3e6be-6bdc-4663-b53f-0c9f5f200f08 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.616963 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3e6be-6bdc-4663-b53f-0c9f5f200f08 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:08.617269 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3e6be-6bdc-4663-b53f-0c9f5f200f08 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.619209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3e6be-6bdc-4663-b53f-0c9f5f200f08 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.620938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60416c6e-553d-4527-b0ab-9229b04f0864 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.637354 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60416c6e-553d-4527-b0ab-9229b04f0864 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.651798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 313/628] 10.222.0.50 () {56 vars in 1154 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:08.656149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a39f9-82b6-479c-943b-0be820f0dc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.657098 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a39f9-82b6-479c-943b-0be820f0dc05 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.657386 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a39f9-82b6-479c-943b-0be820f0dc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.657672 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a39f9-82b6-479c-943b-0be820f0dc05 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.662691 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3e6be-6bdc-4663-b53f-0c9f5f200f08 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.674428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3e6be-6bdc-4663-b53f-0c9f5f200f08 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.680007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e25372-88c1-4f2c-9113-09bbf3aab76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.681466 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e25372-88c1-4f2c-9113-09bbf3aab76e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.681753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e25372-88c1-4f2c-9113-09bbf3aab76e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.682032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e25372-88c1-4f2c-9113-09bbf3aab76e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.684526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a39f9-82b6-479c-943b-0be820f0dc05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.686451 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a39f9-82b6-479c-943b-0be820f0dc05 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.693955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e25372-88c1-4f2c-9113-09bbf3aab76e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.696168 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e25372-88c1-4f2c-9113-09bbf3aab76e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.715936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-79e25372-88c1-4f2c-9113-09bbf3aab76e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:08.717435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 314/629] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:08.728237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-eb2a39f9-82b6-479c-943b-0be820f0dc05 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:08.729037 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e25372-88c1-4f2c-9113-09bbf3aab76e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.729847 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 316/630] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:08.738882 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a39f9-82b6-479c-943b-0be820f0dc05 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.745147 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e25372-88c1-4f2c-9113-09bbf3aab76e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.752116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7058-7a7c-419f-9f76-6d47c5185d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.754925 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a39f9-82b6-479c-943b-0be820f0dc05 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.755987 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7058-7a7c-419f-9f76-6d47c5185d00 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.756660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7058-7a7c-419f-9f76-6d47c5185d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.757151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7058-7a7c-419f-9f76-6d47c5185d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.758126 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e7058-7a7c-419f-9f76-6d47c5185d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:08.759244 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e7058-7a7c-419f-9f76-6d47c5185d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.761492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e7058-7a7c-419f-9f76-6d47c5185d00 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.771437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9d06d-4280-4169-9efa-6a27ff41a868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.772493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9d06d-4280-4169-9efa-6a27ff41a868 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.773017 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9d06d-4280-4169-9efa-6a27ff41a868 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.773507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9d06d-4280-4169-9efa-6a27ff41a868 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.774455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9d06d-4280-4169-9efa-6a27ff41a868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:08.775013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9d06d-4280-4169-9efa-6a27ff41a868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.776852 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9d06d-4280-4169-9efa-6a27ff41a868 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.792077 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 315/631] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:08.797927 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7058-7a7c-419f-9f76-6d47c5185d00 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.803729 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 317/632] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:08.810914 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9d06d-4280-4169-9efa-6a27ff41a868 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.815102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7058-7a7c-419f-9f76-6d47c5185d00 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.826184 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9d06d-4280-4169-9efa-6a27ff41a868 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.828906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57853e-7ee9-4cd6-820e-9315be0eaeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.829943 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57853e-7ee9-4cd6-820e-9315be0eaeda admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.830442 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57853e-7ee9-4cd6-820e-9315be0eaeda admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.831564 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57853e-7ee9-4cd6-820e-9315be0eaeda admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.840203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f4945-b1d8-402f-86aa-ac68b4a8989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.841280 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f4945-b1d8-402f-86aa-ac68b4a8989a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.843401 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f4945-b1d8-402f-86aa-ac68b4a8989a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.843685 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f4945-b1d8-402f-86aa-ac68b4a8989a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.844995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57853e-7ee9-4cd6-820e-9315be0eaeda admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.848163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57853e-7ee9-4cd6-820e-9315be0eaeda admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.852400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f4945-b1d8-402f-86aa-ac68b4a8989a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.854421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f4945-b1d8-402f-86aa-ac68b4a8989a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.863136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-eb57853e-7ee9-4cd6-820e-9315be0eaeda admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:08.870536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 316/633] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:08.870536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720ac1-aeba-42f5-87b5-fbb4d2bbb59c None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.870536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720ac1-aeba-42f5-87b5-fbb4d2bbb59c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.870536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720ac1-aeba-42f5-87b5-fbb4d2bbb59c None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.872077 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 317/634] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:08.872795 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5720ac1-aeba-42f5-87b5-fbb4d2bbb59c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.874671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-597f4945-b1d8-402f-86aa-ac68b4a8989a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 16 00:20:08.876390 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 318/635] 10.222.0.50 () {56 vars in 1138 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:08.884252 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d892f30-97c0-4a3a-902e-a87ce1b438ff None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.884888 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d892f30-97c0-4a3a-902e-a87ce1b438ff None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.885379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d892f30-97c0-4a3a-902e-a87ce1b438ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.892332 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5720ac1-aeba-42f5-87b5-fbb4d2bbb59c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.898282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7572bb-4058-4de2-83a3-3cddd601d203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.898978 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7572bb-4058-4de2-83a3-3cddd601d203 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.899269 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7572bb-4058-4de2-83a3-3cddd601d203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.899551 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7572bb-4058-4de2-83a3-3cddd601d203 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.900340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7572bb-4058-4de2-83a3-3cddd601d203 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:08.900653 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7572bb-4058-4de2-83a3-3cddd601d203 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.902986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7572bb-4058-4de2-83a3-3cddd601d203 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.908189 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-6d892f30-97c0-4a3a-902e-a87ce1b438ff None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:08.910405 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6d892f30-97c0-4a3a-902e-a87ce1b438ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:08.916573 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 318/636] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:08.917322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7572bb-4058-4de2-83a3-3cddd601d203 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.920960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 319/637] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:08.927836 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d892f30-97c0-4a3a-902e-a87ce1b438ff None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.938859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7572bb-4058-4de2-83a3-3cddd601d203 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.946934 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d873d1b-0a4a-46db-9f4b-08e8c0239d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.953475 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d892f30-97c0-4a3a-902e-a87ce1b438ff None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:08.954307 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d873d1b-0a4a-46db-9f4b-08e8c0239d24 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.954603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d873d1b-0a4a-46db-9f4b-08e8c0239d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.954910 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d873d1b-0a4a-46db-9f4b-08e8c0239d24 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.956508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d873d1b-0a4a-46db-9f4b-08e8c0239d24 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:08.956830 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d873d1b-0a4a-46db-9f4b-08e8c0239d24 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.958715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d873d1b-0a4a-46db-9f4b-08e8c0239d24 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.967093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008a988-4ed6-4199-8c0a-cea17b480649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:08.968594 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008a988-4ed6-4199-8c0a-cea17b480649 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:08.969886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008a988-4ed6-4199-8c0a-cea17b480649 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:08.970357 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008a988-4ed6-4199-8c0a-cea17b480649 admin admin] PATH_INFO: `/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/442cc0e13dcb49f0a4a870c06e0edf1d/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:08.973664 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008a988-4ed6-4199-8c0a-cea17b480649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce43bc1cdb744a2b2c65dd4c50d6599, user_id=442cc0e13dcb49f0a4a870c06e0edf1d, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:08.977658 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008a988-4ed6-4199-8c0a-cea17b480649 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:08.978898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 319/638] 10.222.0.50 () {56 vars in 1170 bytes} [Tue Nov 16 00:20:08 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:08.979786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d873d1b-0a4a-46db-9f4b-08e8c0239d24 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:08.996336 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d873d1b-0a4a-46db-9f4b-08e8c0239d24 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:09.001098 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 320/639] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:20:08 2021] PUT /identity/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/442cc0e13dcb49f0a4a870c06e0edf1d/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:20:09.010866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008a988-4ed6-4199-8c0a-cea17b480649 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:09.105922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd42ecc-3e24-422c-9164-e9bd1eec0895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:09.106635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd42ecc-3e24-422c-9164-e9bd1eec0895 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.107000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd42ecc-3e24-422c-9164-e9bd1eec0895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.107295 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd42ecc-3e24-422c-9164-e9bd1eec0895 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.108048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd42ecc-3e24-422c-9164-e9bd1eec0895 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:09.109959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-5bd42ecc-3e24-422c-9164-e9bd1eec0895 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:20:09.109959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:20:09.109959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:20:09.110893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd42ecc-3e24-422c-9164-e9bd1eec0895 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:09.132078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 320/640] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Nov 16 00:20:08 2021] POST /identity/v3/services => generated 240 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:20:09.144250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008a988-4ed6-4199-8c0a-cea17b480649 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:09.175709 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c15383-ec12-4e36-94cf-883c50e35715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:09.176492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c15383-ec12-4e36-94cf-883c50e35715 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.176789 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c15383-ec12-4e36-94cf-883c50e35715 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.177087 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c15383-ec12-4e36-94cf-883c50e35715 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.186286 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c15383-ec12-4e36-94cf-883c50e35715 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:09.188141 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c15383-ec12-4e36-94cf-883c50e35715 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:09.200371 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 321/641] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:09 2021] GET /identity/v3/auth/tokens => generated 1166 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:20:09.207458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd42ecc-3e24-422c-9164-e9bd1eec0895 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:09.218687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd42ecc-3e24-422c-9164-e9bd1eec0895 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:09.224594 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b7dd4-7aea-4151-878f-2c4a79ee788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:09.225411 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b7dd4-7aea-4151-878f-2c4a79ee788e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.225702 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b7dd4-7aea-4151-878f-2c4a79ee788e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.225987 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b7dd4-7aea-4151-878f-2c4a79ee788e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.240821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b7dd4-7aea-4151-878f-2c4a79ee788e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:09.242783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b7dd4-7aea-4151-878f-2c4a79ee788e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:09.261585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-c02b7dd4-7aea-4151-878f-2c4a79ee788e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:09.262863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 321/642] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:09.269286 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c15383-ec12-4e36-94cf-883c50e35715 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:09.279661 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c15383-ec12-4e36-94cf-883c50e35715 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:09.286288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4017397-718e-4268-ad42-5a15d711a931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:09.287089 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017397-718e-4268-ad42-5a15d711a931 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.287380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017397-718e-4268-ad42-5a15d711a931 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.287714 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017397-718e-4268-ad42-5a15d711a931 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.288450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4017397-718e-4268-ad42-5a15d711a931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:09.288763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4017397-718e-4268-ad42-5a15d711a931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:09.290481 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4017397-718e-4268-ad42-5a15d711a931 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:09.304693 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 322/643] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:09.311016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b7dd4-7aea-4151-878f-2c4a79ee788e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:09.322569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b7dd4-7aea-4151-878f-2c4a79ee788e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:09.327622 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef26c84-3c2e-4fd4-9175-0ae5f474e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:09.328553 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef26c84-3c2e-4fd4-9175-0ae5f474e5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.328896 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef26c84-3c2e-4fd4-9175-0ae5f474e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.329181 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef26c84-3c2e-4fd4-9175-0ae5f474e5f7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.338643 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef26c84-3c2e-4fd4-9175-0ae5f474e5f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:09.340984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef26c84-3c2e-4fd4-9175-0ae5f474e5f7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:09.357266 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-5ef26c84-3c2e-4fd4-9175-0ae5f474e5f7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:09.363083 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 322/644] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:09.367038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4017397-718e-4268-ad42-5a15d711a931 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:09.381705 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4017397-718e-4268-ad42-5a15d711a931 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:09.389140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc1888-ca66-4979-baab-e8765b011393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:09.389815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc1888-ca66-4979-baab-e8765b011393 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.390147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc1888-ca66-4979-baab-e8765b011393 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.390440 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc1888-ca66-4979-baab-e8765b011393 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.391285 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc1888-ca66-4979-baab-e8765b011393 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:09.391604 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc1888-ca66-4979-baab-e8765b011393 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:09.394528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc1888-ca66-4979-baab-e8765b011393 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:09.409436 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 323/645] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:09.415923 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef26c84-3c2e-4fd4-9175-0ae5f474e5f7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:09.427533 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef26c84-3c2e-4fd4-9175-0ae5f474e5f7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:09.434766 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78261aa3-cfff-490a-8c96-caaffac1aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:09.435518 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78261aa3-cfff-490a-8c96-caaffac1aeff admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.435807 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78261aa3-cfff-490a-8c96-caaffac1aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.436086 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78261aa3-cfff-490a-8c96-caaffac1aeff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.436980 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78261aa3-cfff-490a-8c96-caaffac1aeff admin admin] RBAC: Adding query filter params (role.id=de4c885bb354403b98a2f1aefb43754e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=f6af4c462c6347ff8abbcc8770874b44) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:09.437298 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78261aa3-cfff-490a-8c96-caaffac1aeff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:09.439264 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78261aa3-cfff-490a-8c96-caaffac1aeff admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:09.443966 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ca7ce-ff12-48f4-a3c9-776eddc3faff None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.444253 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ca7ce-ff12-48f4-a3c9-776eddc3faff None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.444532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ca7ce-ff12-48f4-a3c9-776eddc3faff None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.446799 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 324/646] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:09.447340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 323/647] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:09 2021] GET /identity/v3/role_assignments?user.id=f6af4c462c6347ff8abbcc8770874b44&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=de4c885bb354403b98a2f1aefb43754e => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:09.455146 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45575ae0-eece-4a07-b452-c7b2e58d0fcb None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.455437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45575ae0-eece-4a07-b452-c7b2e58d0fcb None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.455623 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45575ae0-eece-4a07-b452-c7b2e58d0fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.480631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-45575ae0-eece-4a07-b452-c7b2e58d0fcb None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:09.481852 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-45575ae0-eece-4a07-b452-c7b2e58d0fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:09.493636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 325/648] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:09 2021] POST /identity/v3/auth/tokens => generated 1166 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:09.516229 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78261aa3-cfff-490a-8c96-caaffac1aeff admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:09.527791 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78261aa3-cfff-490a-8c96-caaffac1aeff admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:09.532694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c086b9-00fe-40d9-9d19-8a23fc4b931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:09.533431 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c086b9-00fe-40d9-9d19-8a23fc4b931f admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.533766 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c086b9-00fe-40d9-9d19-8a23fc4b931f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.534618 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c086b9-00fe-40d9-9d19-8a23fc4b931f admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.535544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c086b9-00fe-40d9-9d19-8a23fc4b931f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:09.537251 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c086b9-00fe-40d9-9d19-8a23fc4b931f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:09.555460 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 324/649] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Nov 16 00:20:09 2021] POST /identity/v3/services => generated 251 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:20:09.792228 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51538f-0f48-4c79-8d15-2033b5526741 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.792228 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51538f-0f48-4c79-8d15-2033b5526741 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.792228 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51538f-0f48-4c79-8d15-2033b5526741 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.793195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 326/650] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:09.802911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386df43c-0c8e-438a-8d0f-5567d7c55cab None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.802911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386df43c-0c8e-438a-8d0f-5567d7c55cab None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.802911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386df43c-0c8e-438a-8d0f-5567d7c55cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.820842 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-386df43c-0c8e-438a-8d0f-5567d7c55cab None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:09.822342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-386df43c-0c8e-438a-8d0f-5567d7c55cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:09.839797 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 325/651] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:09 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:09.865780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51538f-0f48-4c79-8d15-2033b5526741 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:09.878730 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51538f-0f48-4c79-8d15-2033b5526741 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:09.883472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95124d26-7e91-481d-9582-5e4e28961ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:09.884516 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95124d26-7e91-481d-9582-5e4e28961ded admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.885015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95124d26-7e91-481d-9582-5e4e28961ded admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.885500 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95124d26-7e91-481d-9582-5e4e28961ded admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.896717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95124d26-7e91-481d-9582-5e4e28961ded admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:09.903680 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-95124d26-7e91-481d-9582-5e4e28961ded admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:20:09.905366 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 327/652] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:20:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:09.912658 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386df43c-0c8e-438a-8d0f-5567d7c55cab None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:09.922081 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386df43c-0c8e-438a-8d0f-5567d7c55cab None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:09.935384 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f67ed-27eb-4b28-8fe1-be47e22339bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:09.936075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f67ed-27eb-4b28-8fe1-be47e22339bb admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.936364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f67ed-27eb-4b28-8fe1-be47e22339bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.936644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f67ed-27eb-4b28-8fe1-be47e22339bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.937405 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f67ed-27eb-4b28-8fe1-be47e22339bb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:09.937718 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f67ed-27eb-4b28-8fe1-be47e22339bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:09.939486 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f67ed-27eb-4b28-8fe1-be47e22339bb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:09.951406 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 326/653] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:20:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:09.958011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95124d26-7e91-481d-9582-5e4e28961ded admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:09.970397 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95124d26-7e91-481d-9582-5e4e28961ded admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:09.977439 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00128f-9c96-48fe-bce6-2ec001eb91ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:09.978546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00128f-9c96-48fe-bce6-2ec001eb91ff admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:09.979085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00128f-9c96-48fe-bce6-2ec001eb91ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:09.979632 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00128f-9c96-48fe-bce6-2ec001eb91ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:09.991534 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00128f-9c96-48fe-bce6-2ec001eb91ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:09.993714 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00128f-9c96-48fe-bce6-2ec001eb91ff admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:10.010683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-1f00128f-9c96-48fe-bce6-2ec001eb91ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:10.012458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 328/654] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:10.019057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f67ed-27eb-4b28-8fe1-be47e22339bb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:10.029142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f67ed-27eb-4b28-8fe1-be47e22339bb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:10.034451 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cd7c3-e592-4bb8-9b41-4a4e87c143a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:10.035559 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cd7c3-e592-4bb8-9b41-4a4e87c143a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:10.036076 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cd7c3-e592-4bb8-9b41-4a4e87c143a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:10.036590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cd7c3-e592-4bb8-9b41-4a4e87c143a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:10.037535 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cd7c3-e592-4bb8-9b41-4a4e87c143a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:10.038055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cd7c3-e592-4bb8-9b41-4a4e87c143a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:10.039897 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cd7c3-e592-4bb8-9b41-4a4e87c143a4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:10.053282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 327/655] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:10.059599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00128f-9c96-48fe-bce6-2ec001eb91ff admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:10.069914 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00128f-9c96-48fe-bce6-2ec001eb91ff admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:10.074674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7bc92-20ad-497b-88c0-b8f1747b0cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:10.075751 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7bc92-20ad-497b-88c0-b8f1747b0cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:10.076283 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7bc92-20ad-497b-88c0-b8f1747b0cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:10.076773 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7bc92-20ad-497b-88c0-b8f1747b0cb2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:10.085200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7bc92-20ad-497b-88c0-b8f1747b0cb2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:10.087526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7bc92-20ad-497b-88c0-b8f1747b0cb2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:10.102067 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-46b7bc92-20ad-497b-88c0-b8f1747b0cb2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 16 00:20:10.103819 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 329/656] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:20:10 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:10.110271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cd7c3-e592-4bb8-9b41-4a4e87c143a4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:10.121146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cd7c3-e592-4bb8-9b41-4a4e87c143a4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:10.125928 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf403090-cda4-4f91-a8aa-07a29e122146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:10.127021 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf403090-cda4-4f91-a8aa-07a29e122146 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:10.127556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf403090-cda4-4f91-a8aa-07a29e122146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:10.128056 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf403090-cda4-4f91-a8aa-07a29e122146 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:10.129101 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf403090-cda4-4f91-a8aa-07a29e122146 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:10.129623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf403090-cda4-4f91-a8aa-07a29e122146 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:10.131750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf403090-cda4-4f91-a8aa-07a29e122146 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:10.149984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 328/657] 10.222.0.50 () {56 vars in 1156 bytes} [Tue Nov 16 00:20:10 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:10.156489 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7bc92-20ad-497b-88c0-b8f1747b0cb2 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:10.167491 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7bc92-20ad-497b-88c0-b8f1747b0cb2 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:10.172437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ba28-22c7-4fa4-bf41-cff3c8a68512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:10.173363 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ba28-22c7-4fa4-bf41-cff3c8a68512 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:10.173861 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ba28-22c7-4fa4-bf41-cff3c8a68512 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:10.174347 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ba28-22c7-4fa4-bf41-cff3c8a68512 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:10.183852 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85ba28-22c7-4fa4-bf41-cff3c8a68512 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:10.186274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85ba28-22c7-4fa4-bf41-cff3c8a68512 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:10.196407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 330/658] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:10 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:20:10.202937 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf403090-cda4-4f91-a8aa-07a29e122146 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:10.213859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf403090-cda4-4f91-a8aa-07a29e122146 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:10.219211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2164c4-8562-4c50-9af2-b55c4e879346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:10.220243 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2164c4-8562-4c50-9af2-b55c4e879346 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:10.220768 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2164c4-8562-4c50-9af2-b55c4e879346 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:10.221263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2164c4-8562-4c50-9af2-b55c4e879346 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:10.233074 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2164c4-8562-4c50-9af2-b55c4e879346 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:10.235233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2164c4-8562-4c50-9af2-b55c4e879346 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:10.252471 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-6e2164c4-8562-4c50-9af2-b55c4e879346 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:10.254331 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 329/659] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:10.260805 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ba28-22c7-4fa4-bf41-cff3c8a68512 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:10.270669 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ba28-22c7-4fa4-bf41-cff3c8a68512 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:10.275515 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d64e12-e4df-421c-a130-7aff8d316230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:10.276402 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d64e12-e4df-421c-a130-7aff8d316230 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:10.276917 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d64e12-e4df-421c-a130-7aff8d316230 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:10.277402 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d64e12-e4df-421c-a130-7aff8d316230 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:10.278326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d64e12-e4df-421c-a130-7aff8d316230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:10.278864 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d64e12-e4df-421c-a130-7aff8d316230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:10.280658 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d64e12-e4df-421c-a130-7aff8d316230 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:10.295761 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 331/660] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:10.302481 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2164c4-8562-4c50-9af2-b55c4e879346 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:10.312921 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2164c4-8562-4c50-9af2-b55c4e879346 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:10.317938 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85084d0a-27e7-479e-aac3-08c34017f2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:10.319002 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85084d0a-27e7-479e-aac3-08c34017f2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:10.319521 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85084d0a-27e7-479e-aac3-08c34017f2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:10.320007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85084d0a-27e7-479e-aac3-08c34017f2c8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:10.327525 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85084d0a-27e7-479e-aac3-08c34017f2c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:10.329751 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85084d0a-27e7-479e-aac3-08c34017f2c8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:10.347972 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-85084d0a-27e7-479e-aac3-08c34017f2c8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:10.349831 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 330/661] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:10.356647 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d64e12-e4df-421c-a130-7aff8d316230 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:10.367616 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d64e12-e4df-421c-a130-7aff8d316230 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:10.372601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82130c-c19f-4f41-ac58-29c9820a22d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:10.373846 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82130c-c19f-4f41-ac58-29c9820a22d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:10.374643 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82130c-c19f-4f41-ac58-29c9820a22d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:10.375248 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82130c-c19f-4f41-ac58-29c9820a22d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:10.376279 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82130c-c19f-4f41-ac58-29c9820a22d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:10.376806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82130c-c19f-4f41-ac58-29c9820a22d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:10.378931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82130c-c19f-4f41-ac58-29c9820a22d0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:10.391740 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 332/662] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:10.399164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85084d0a-27e7-479e-aac3-08c34017f2c8 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:10.410668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85084d0a-27e7-479e-aac3-08c34017f2c8 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:10.415531 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c0843-b299-475b-9c4c-605ac45924e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:10.416416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0843-b299-475b-9c4c-605ac45924e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:10.416937 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0843-b299-475b-9c4c-605ac45924e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:10.417449 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0843-b299-475b-9c4c-605ac45924e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:10.418485 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c0843-b299-475b-9c4c-605ac45924e8 admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=0ac32c6730654a889472a3bad95374bc) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:10.419036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c0843-b299-475b-9c4c-605ac45924e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:10.421114 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c0843-b299-475b-9c4c-605ac45924e8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:10.427828 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 331/663] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:10 2021] GET /identity/v3/role_assignments?user.id=0ac32c6730654a889472a3bad95374bc&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=2813231cc8954b998440e4bf5ede2945 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:11.812796 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ba566-a5d7-4623-a200-c6cf35ecd497 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:11.813311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ba566-a5d7-4623-a200-c6cf35ecd497 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:11.813387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ba566-a5d7-4623-a200-c6cf35ecd497 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:11.816077 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 333/664] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:11.830489 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925b3ce-0a8f-468e-82f2-1a2f95132f57 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:11.831159 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925b3ce-0a8f-468e-82f2-1a2f95132f57 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:11.831395 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925b3ce-0a8f-468e-82f2-1a2f95132f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:11.855879 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7925b3ce-0a8f-468e-82f2-1a2f95132f57 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:11.857105 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7925b3ce-0a8f-468e-82f2-1a2f95132f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:11.866014 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 332/665] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:11 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:11.910304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ba566-a5d7-4623-a200-c6cf35ecd497 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:11.932630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ba566-a5d7-4623-a200-c6cf35ecd497 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:11.941729 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883f4a9-a4e5-47bd-942d-547611f9281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:11.942944 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883f4a9-a4e5-47bd-942d-547611f9281f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:11.943434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883f4a9-a4e5-47bd-942d-547611f9281f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:11.943923 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883f4a9-a4e5-47bd-942d-547611f9281f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:11.963922 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883f4a9-a4e5-47bd-942d-547611f9281f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:11.971020 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-a883f4a9-a4e5-47bd-942d-547611f9281f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:20:11.973188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 334/666] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:20:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:11.979528 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925b3ce-0a8f-468e-82f2-1a2f95132f57 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:11.992586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925b3ce-0a8f-468e-82f2-1a2f95132f57 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.008126 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8504c-f897-4cbe-9959-2d0312ae9ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.008814 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8504c-f897-4cbe-9959-2d0312ae9ceb admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.009104 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8504c-f897-4cbe-9959-2d0312ae9ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.009388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8504c-f897-4cbe-9959-2d0312ae9ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.010150 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8504c-f897-4cbe-9959-2d0312ae9ceb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:12.010461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8504c-f897-4cbe-9959-2d0312ae9ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.012118 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8504c-f897-4cbe-9959-2d0312ae9ceb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.029406 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 333/667] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:20:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:12.035871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883f4a9-a4e5-47bd-942d-547611f9281f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.052525 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883f4a9-a4e5-47bd-942d-547611f9281f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.062593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdd136-3fa9-4832-9fda-375c093f83b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.063783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd136-3fa9-4832-9fda-375c093f83b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.064270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd136-3fa9-4832-9fda-375c093f83b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.064763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd136-3fa9-4832-9fda-375c093f83b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.087979 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdd136-3fa9-4832-9fda-375c093f83b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.090144 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdd136-3fa9-4832-9fda-375c093f83b6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.116194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-02fdd136-3fa9-4832-9fda-375c093f83b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:12.117755 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 335/668] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:12.124021 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8504c-f897-4cbe-9959-2d0312ae9ceb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.141262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8504c-f897-4cbe-9959-2d0312ae9ceb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.152248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577e138-5367-4f4a-a6ee-4fffe87f33ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.152939 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577e138-5367-4f4a-a6ee-4fffe87f33ef admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.153231 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577e138-5367-4f4a-a6ee-4fffe87f33ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.153512 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577e138-5367-4f4a-a6ee-4fffe87f33ef admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.154257 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577e138-5367-4f4a-a6ee-4fffe87f33ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:12.154578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577e138-5367-4f4a-a6ee-4fffe87f33ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.156253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577e138-5367-4f4a-a6ee-4fffe87f33ef admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.179363 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 334/669] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:12.185620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdd136-3fa9-4832-9fda-375c093f83b6 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.195845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdd136-3fa9-4832-9fda-375c093f83b6 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.200499 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5446c-0f89-4959-89e5-52081b09da94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.201301 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5446c-0f89-4959-89e5-52081b09da94 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.201589 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5446c-0f89-4959-89e5-52081b09da94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.201870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5446c-0f89-4959-89e5-52081b09da94 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.209935 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5446c-0f89-4959-89e5-52081b09da94 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.212006 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5446c-0f89-4959-89e5-52081b09da94 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.226688 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-51d5446c-0f89-4959-89e5-52081b09da94 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 00:20:12.228190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 336/670] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:12.234398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577e138-5367-4f4a-a6ee-4fffe87f33ef admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.245058 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577e138-5367-4f4a-a6ee-4fffe87f33ef admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.254038 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e66e1-c4c4-4d0d-8686-69fad847fcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.254714 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e66e1-c4c4-4d0d-8686-69fad847fcfe admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.255036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e66e1-c4c4-4d0d-8686-69fad847fcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.255319 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e66e1-c4c4-4d0d-8686-69fad847fcfe admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.256165 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e66e1-c4c4-4d0d-8686-69fad847fcfe admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:12.256479 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e66e1-c4c4-4d0d-8686-69fad847fcfe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.258347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e66e1-c4c4-4d0d-8686-69fad847fcfe admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.283137 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 335/671] 10.222.0.50 () {56 vars in 1154 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:12.289757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5446c-0f89-4959-89e5-52081b09da94 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.300285 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5446c-0f89-4959-89e5-52081b09da94 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.304965 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3c8be-2f34-4286-85f1-fb575fa634a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.305626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3c8be-2f34-4286-85f1-fb575fa634a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.305914 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3c8be-2f34-4286-85f1-fb575fa634a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.306197 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3c8be-2f34-4286-85f1-fb575fa634a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.314602 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3c8be-2f34-4286-85f1-fb575fa634a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.316299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3c8be-2f34-4286-85f1-fb575fa634a0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.325599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 337/672] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:20:12.331906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e66e1-c4c4-4d0d-8686-69fad847fcfe admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.341889 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e66e1-c4c4-4d0d-8686-69fad847fcfe admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.344048 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5c81c-8606-4574-a7d6-01bedb96c678 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.344340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5c81c-8606-4574-a7d6-01bedb96c678 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.344622 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5c81c-8606-4574-a7d6-01bedb96c678 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.347261 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 338/673] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:12.351463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dca9f9-4b91-4a26-94db-ea5d5144504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.352258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dca9f9-4b91-4a26-94db-ea5d5144504b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.352546 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dca9f9-4b91-4a26-94db-ea5d5144504b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.352830 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dca9f9-4b91-4a26-94db-ea5d5144504b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.356306 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6611a52-5815-45d0-a344-070ef8a7dd23 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.356595 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6611a52-5815-45d0-a344-070ef8a7dd23 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.356874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6611a52-5815-45d0-a344-070ef8a7dd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.381049 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dca9f9-4b91-4a26-94db-ea5d5144504b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.382944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dca9f9-4b91-4a26-94db-ea5d5144504b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.396200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-d6611a52-5815-45d0-a344-070ef8a7dd23 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:12.397423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d6611a52-5815-45d0-a344-070ef8a7dd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:12.411263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-22dca9f9-4b91-4a26-94db-ea5d5144504b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:12.412851 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 336/674] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:12.418786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dca9f9-4b91-4a26-94db-ea5d5144504b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.425491 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 339/675] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:12 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:12.429538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dca9f9-4b91-4a26-94db-ea5d5144504b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.434144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b2f12-6c51-4701-8765-efa608c2d1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.434794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b2f12-6c51-4701-8765-efa608c2d1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.435108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b2f12-6c51-4701-8765-efa608c2d1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.435390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b2f12-6c51-4701-8765-efa608c2d1f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.436115 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b2f12-6c51-4701-8765-efa608c2d1f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:12.436422 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b2f12-6c51-4701-8765-efa608c2d1f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.438024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b2f12-6c51-4701-8765-efa608c2d1f5 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.450542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 337/676] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:12.456416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6611a52-5815-45d0-a344-070ef8a7dd23 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.457309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b2f12-6c51-4701-8765-efa608c2d1f5 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.468835 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b2f12-6c51-4701-8765-efa608c2d1f5 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.475001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7928cf3-8281-465f-9464-9a91800ff0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.476043 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928cf3-8281-465f-9464-9a91800ff0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.476330 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928cf3-8281-465f-9464-9a91800ff0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.476609 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928cf3-8281-465f-9464-9a91800ff0f2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.477507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6611a52-5815-45d0-a344-070ef8a7dd23 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.485142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7928cf3-8281-465f-9464-9a91800ff0f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.487785 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7928cf3-8281-465f-9464-9a91800ff0f2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.494782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f9d59-b07f-4e70-b81f-c5b489000f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.495635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9d59-b07f-4e70-b81f-c5b489000f96 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.495918 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9d59-b07f-4e70-b81f-c5b489000f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.496193 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9d59-b07f-4e70-b81f-c5b489000f96 admin admin] PATH_INFO: `/v3/services/network` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.496861 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f9d59-b07f-4e70-b81f-c5b489000f96 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.498488 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f9d59-b07f-4e70-b81f-c5b489000f96 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.503473 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-e7928cf3-8281-465f-9464-9a91800ff0f2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:12.505281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 338/677] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:12.512342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7928cf3-8281-465f-9464-9a91800ff0f2 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.523020 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7928cf3-8281-465f-9464-9a91800ff0f2 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.527821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd1a6a-3922-4a7f-be3b-4ff4a3406a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.528492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd1a6a-3922-4a7f-be3b-4ff4a3406a45 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.528780 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd1a6a-3922-4a7f-be3b-4ff4a3406a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.529064 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd1a6a-3922-4a7f-be3b-4ff4a3406a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.529858 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd1a6a-3922-4a7f-be3b-4ff4a3406a45 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:12.530174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd1a6a-3922-4a7f-be3b-4ff4a3406a45 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.531275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-cd7f9d59-b07f-4e70-b81f-c5b489000f96 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 16 00:20:12.532079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd1a6a-3922-4a7f-be3b-4ff4a3406a45 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.532923 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 340/678] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/services/network => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:12.539945 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f9d59-b07f-4e70-b81f-c5b489000f96 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.545691 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 339/679] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:12.552806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd1a6a-3922-4a7f-be3b-4ff4a3406a45 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.558243 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f9d59-b07f-4e70-b81f-c5b489000f96 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.562752 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd1a6a-3922-4a7f-be3b-4ff4a3406a45 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.567984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53ff97-4c44-49d8-82bc-ae93a5caf8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.568585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53ff97-4c44-49d8-82bc-ae93a5caf8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.568876 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53ff97-4c44-49d8-82bc-ae93a5caf8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.569160 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53ff97-4c44-49d8-82bc-ae93a5caf8c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.569997 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53ff97-4c44-49d8-82bc-ae93a5caf8c8 admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=442cc0e13dcb49f0a4a870c06e0edf1d) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:12.570316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53ff97-4c44-49d8-82bc-ae93a5caf8c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.572212 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53ff97-4c44-49d8-82bc-ae93a5caf8c8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.573909 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5362d64-902a-45cf-9cfe-3d6128b9a394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.574586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5362d64-902a-45cf-9cfe-3d6128b9a394 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.574922 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5362d64-902a-45cf-9cfe-3d6128b9a394 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.575211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5362d64-902a-45cf-9cfe-3d6128b9a394 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.575931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5362d64-902a-45cf-9cfe-3d6128b9a394 admin admin] RBAC: Adding query filter params (name=network) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:12.576240 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5362d64-902a-45cf-9cfe-3d6128b9a394 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.577820 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5362d64-902a-45cf-9cfe-3d6128b9a394 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.579020 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 340/680] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/role_assignments?user.id=442cc0e13dcb49f0a4a870c06e0edf1d&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=2813231cc8954b998440e4bf5ede2945 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:12.581185 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fed35-0aa9-4162-8c64-88eedd7e33ee None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.581485 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fed35-0aa9-4162-8c64-88eedd7e33ee None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.581779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fed35-0aa9-4162-8c64-88eedd7e33ee None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.583505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 341/681] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:12.589263 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 341/682] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/services?name=network => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:12.592307 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d05a9-3c11-45f9-b94f-dfb31134672c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.592605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d05a9-3c11-45f9-b94f-dfb31134672c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.592894 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d05a9-3c11-45f9-b94f-dfb31134672c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.595475 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5362d64-902a-45cf-9cfe-3d6128b9a394 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.615794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7e8d05a9-3c11-45f9-b94f-dfb31134672c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:12.617051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7e8d05a9-3c11-45f9-b94f-dfb31134672c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:12.617492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5362d64-902a-45cf-9cfe-3d6128b9a394 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.626080 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 342/683] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:12 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:12.632431 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e847a76-b804-4275-b3fc-062839decb67 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.632715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e847a76-b804-4275-b3fc-062839decb67 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.632993 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e847a76-b804-4275-b3fc-062839decb67 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.634821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8bd2-d123-4ab0-a722-51a61499eb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.635101 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 343/684] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:12.635656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8bd2-d123-4ab0-a722-51a61499eb4c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.635941 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8bd2-d123-4ab0-a722-51a61499eb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.636217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8bd2-d123-4ab0-a722-51a61499eb4c admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.636939 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f8bd2-d123-4ab0-a722-51a61499eb4c admin admin] RBAC: Adding query filter params (type=network) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:12.637251 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f8bd2-d123-4ab0-a722-51a61499eb4c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.638938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f8bd2-d123-4ab0-a722-51a61499eb4c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.649895 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e74428-3cf6-41e0-b43f-722aaabdd7f4 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.650520 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e74428-3cf6-41e0-b43f-722aaabdd7f4 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.651065 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e74428-3cf6-41e0-b43f-722aaabdd7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.654992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 342/685] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/services?type=network => generated 350 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:12.661775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8bd2-d123-4ab0-a722-51a61499eb4c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.673464 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-23e74428-3cf6-41e0-b43f-722aaabdd7f4 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:12.675612 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-23e74428-3cf6-41e0-b43f-722aaabdd7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:12.676808 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8bd2-d123-4ab0-a722-51a61499eb4c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.681695 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c9e7a-8a33-4733-a5f9-2f44fe8ff101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.682563 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c9e7a-8a33-4733-a5f9-2f44fe8ff101 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.683111 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c9e7a-8a33-4733-a5f9-2f44fe8ff101 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.683472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c9e7a-8a33-4733-a5f9-2f44fe8ff101 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.684366 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c9e7a-8a33-4733-a5f9-2f44fe8ff101 admin admin] RBAC: Adding query filter params (interface=public, service_id=ca15629005dc45bdb572a88593c759b1, region_id=RegionOne) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:12.684760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c9e7a-8a33-4733-a5f9-2f44fe8ff101 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.685874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-a30c9e7a-8a33-4733-a5f9-2f44fe8ff101 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:20:12.685874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:20:12.685874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:20:12.686331 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 344/686] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:12 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:12.687313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c9e7a-8a33-4733-a5f9-2f44fe8ff101 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.687663 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e74428-3cf6-41e0-b43f-722aaabdd7f4 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.696485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 343/687] 10.222.0.50 () {56 vars in 1272 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/endpoints?service_id=ca15629005dc45bdb572a88593c759b1&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:12.698616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e74428-3cf6-41e0-b43f-722aaabdd7f4 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.706954 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c9e7a-8a33-4733-a5f9-2f44fe8ff101 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.712469 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0e86f-937f-4369-9752-6705bfdf87bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.713525 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0e86f-937f-4369-9752-6705bfdf87bf admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.713687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0e86f-937f-4369-9752-6705bfdf87bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.713975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0e86f-937f-4369-9752-6705bfdf87bf admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.714667 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0e86f-937f-4369-9752-6705bfdf87bf admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.716416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0e86f-937f-4369-9752-6705bfdf87bf admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.720021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c9e7a-8a33-4733-a5f9-2f44fe8ff101 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.725386 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067e4f3-d63d-442b-b295-590d39c3740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.726334 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067e4f3-d63d-442b-b295-590d39c3740a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.726801 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067e4f3-d63d-442b-b295-590d39c3740a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.727300 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067e4f3-d63d-442b-b295-590d39c3740a admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.728177 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067e4f3-d63d-442b-b295-590d39c3740a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.729820 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-73e0e86f-937f-4369-9752-6705bfdf87bf admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 16 00:20:12.730214 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067e4f3-d63d-442b-b295-590d39c3740a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.736709 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 345/688] 10.222.0.50 () {56 vars in 1150 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:12.736709 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0e86f-937f-4369-9752-6705bfdf87bf admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.744054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 344/689] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/services => generated 772 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:12.745218 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067e4f3-d63d-442b-b295-590d39c3740a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.750022 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0e86f-937f-4369-9752-6705bfdf87bf admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.757161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00067b2d-5afd-4d26-bbac-f345f19405d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.757964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067e4f3-d63d-442b-b295-590d39c3740a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.758579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00067b2d-5afd-4d26-bbac-f345f19405d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.759114 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00067b2d-5afd-4d26-bbac-f345f19405d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.759643 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00067b2d-5afd-4d26-bbac-f345f19405d4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.769767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e5251-8d4e-4648-91f6-6b0458741a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.769767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e5251-8d4e-4648-91f6-6b0458741a8f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.769767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e5251-8d4e-4648-91f6-6b0458741a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.769767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e5251-8d4e-4648-91f6-6b0458741a8f admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.770206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e5251-8d4e-4648-91f6-6b0458741a8f admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:12.770206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e5251-8d4e-4648-91f6-6b0458741a8f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.770206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e5251-8d4e-4648-91f6-6b0458741a8f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.775265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 345/690] 10.222.0.50 () {56 vars in 1145 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:12.786325 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e5251-8d4e-4648-91f6-6b0458741a8f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.794588 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00067b2d-5afd-4d26-bbac-f345f19405d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:12.801191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e5251-8d4e-4648-91f6-6b0458741a8f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.805848 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-00067b2d-5afd-4d26-bbac-f345f19405d4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:20:12.806566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd27b3-273b-4db6-8454-6e3926ae94c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.807448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 346/691] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:12.812014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd27b3-273b-4db6-8454-6e3926ae94c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.812014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd27b3-273b-4db6-8454-6e3926ae94c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.812014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd27b3-273b-4db6-8454-6e3926ae94c1 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.814458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd27b3-273b-4db6-8454-6e3926ae94c1 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:12.814458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd27b3-273b-4db6-8454-6e3926ae94c1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.816012 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd27b3-273b-4db6-8454-6e3926ae94c1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.818727 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00067b2d-5afd-4d26-bbac-f345f19405d4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.826910 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 346/692] 10.222.0.50 () {56 vars in 1145 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:12.833341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd27b3-273b-4db6-8454-6e3926ae94c1 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.838196 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00067b2d-5afd-4d26-bbac-f345f19405d4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.844684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c33e8-8d61-44e5-ac2a-adbdf9bbbdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.845428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c33e8-8d61-44e5-ac2a-adbdf9bbbdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.845720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c33e8-8d61-44e5-ac2a-adbdf9bbbdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.846001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c33e8-8d61-44e5-ac2a-adbdf9bbbdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.847756 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c33e8-8d61-44e5-ac2a-adbdf9bbbdf0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:12.848068 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c33e8-8d61-44e5-ac2a-adbdf9bbbdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.852116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd27b3-273b-4db6-8454-6e3926ae94c1 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.852576 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c33e8-8d61-44e5-ac2a-adbdf9bbbdf0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.863084 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e032e41-afc0-4448-a524-9bbbad837dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.864261 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e032e41-afc0-4448-a524-9bbbad837dfa admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.864782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e032e41-afc0-4448-a524-9bbbad837dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.865244 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e032e41-afc0-4448-a524-9bbbad837dfa admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.866087 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e032e41-afc0-4448-a524-9bbbad837dfa admin admin] RBAC: Adding query filter params (interface=public, service_id=5488d054547e4268bf8565bd5aa59e4a, region_id=RegionOne) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:12.866415 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e032e41-afc0-4448-a524-9bbbad837dfa admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.868138 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e032e41-afc0-4448-a524-9bbbad837dfa admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.871090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 347/693] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:12.879990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c33e8-8d61-44e5-ac2a-adbdf9bbbdf0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.885597 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 347/694] 10.222.0.50 () {56 vars in 1272 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/endpoints?service_id=5488d054547e4268bf8565bd5aa59e4a&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:12.889845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e032e41-afc0-4448-a524-9bbbad837dfa admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.895749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c33e8-8d61-44e5-ac2a-adbdf9bbbdf0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.901976 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e032e41-afc0-4448-a524-9bbbad837dfa admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.903005 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e21dc5-8854-4363-a825-02a2c43d8abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.903962 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e21dc5-8854-4363-a825-02a2c43d8abc admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.904242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e21dc5-8854-4363-a825-02a2c43d8abc admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.904530 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e21dc5-8854-4363-a825-02a2c43d8abc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.909612 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09511e-3340-445c-bd38-2c81e32827f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.910647 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09511e-3340-445c-bd38-2c81e32827f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.911181 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09511e-3340-445c-bd38-2c81e32827f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.911665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09511e-3340-445c-bd38-2c81e32827f5 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.912587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09511e-3340-445c-bd38-2c81e32827f5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.916694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09511e-3340-445c-bd38-2c81e32827f5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.923099 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e21dc5-8854-4363-a825-02a2c43d8abc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.929337 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e21dc5-8854-4363-a825-02a2c43d8abc admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:12.932398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 348/695] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/services => generated 772 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:12.952805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-07e21dc5-8854-4363-a825-02a2c43d8abc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:12.954401 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 348/696] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:12.961756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09511e-3340-445c-bd38-2c81e32827f5 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:12.974414 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09511e-3340-445c-bd38-2c81e32827f5 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:12.980072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fdff4-c109-45b8-bdb3-1708e5c746ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:12.980072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fdff4-c109-45b8-bdb3-1708e5c746ad admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:12.980341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fdff4-c109-45b8-bdb3-1708e5c746ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:12.980648 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fdff4-c109-45b8-bdb3-1708e5c746ad admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:12.982157 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fdff4-c109-45b8-bdb3-1708e5c746ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:12.982157 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fdff4-c109-45b8-bdb3-1708e5c746ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:12.983643 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fdff4-c109-45b8-bdb3-1708e5c746ad admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.000492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 349/697] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:13.008010 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e21dc5-8854-4363-a825-02a2c43d8abc admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.019749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e21dc5-8854-4363-a825-02a2c43d8abc admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.024403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc5747-e967-4727-82f4-601d05f5fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.025311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc5747-e967-4727-82f4-601d05f5fe6b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.025602 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc5747-e967-4727-82f4-601d05f5fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.025926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc5747-e967-4727-82f4-601d05f5fe6b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.035625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc5747-e967-4727-82f4-601d05f5fe6b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.037686 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc5747-e967-4727-82f4-601d05f5fe6b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.053910 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-aacc5747-e967-4727-82f4-601d05f5fe6b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 16 00:20:13.055586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 349/698] 10.222.0.50 () {56 vars in 1138 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:13.062399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fdff4-c109-45b8-bdb3-1708e5c746ad admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.073182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fdff4-c109-45b8-bdb3-1708e5c746ad admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.077968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc5413-0264-47b3-b470-ebbe4d27de97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.078684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc5413-0264-47b3-b470-ebbe4d27de97 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.079044 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc5413-0264-47b3-b470-ebbe4d27de97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.079327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc5413-0264-47b3-b470-ebbe4d27de97 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.080341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc5413-0264-47b3-b470-ebbe4d27de97 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:13.080693 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc5413-0264-47b3-b470-ebbe4d27de97 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.082737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc5413-0264-47b3-b470-ebbe4d27de97 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.104516 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 350/699] 10.222.0.50 () {56 vars in 1170 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:13.110638 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc5747-e967-4727-82f4-601d05f5fe6b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.122246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc5747-e967-4727-82f4-601d05f5fe6b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.128186 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1695d-8b89-4936-85c4-8c399019921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.129241 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1695d-8b89-4936-85c4-8c399019921c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.129678 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1695d-8b89-4936-85c4-8c399019921c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.130105 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1695d-8b89-4936-85c4-8c399019921c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.142385 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1695d-8b89-4936-85c4-8c399019921c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.145388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1695d-8b89-4936-85c4-8c399019921c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.162482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354157d-ccb4-4826-8c04-03ac650e8ee0 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.162784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354157d-ccb4-4826-8c04-03ac650e8ee0 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.163076 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354157d-ccb4-4826-8c04-03ac650e8ee0 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.165085 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-30e1695d-8b89-4936-85c4-8c399019921c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:13.165696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 351/700] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:20:13.166547 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 350/701] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:13.172521 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354157d-ccb4-4826-8c04-03ac650e8ee0 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.174172 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eefe81-a0be-44d6-ae9a-b5412ed282d7 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.175115 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eefe81-a0be-44d6-ae9a-b5412ed282d7 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.175409 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eefe81-a0be-44d6-ae9a-b5412ed282d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.188185 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354157d-ccb4-4826-8c04-03ac650e8ee0 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.193418 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacb06e-b33b-4a86-a6a6-76b6471879e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.194455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacb06e-b33b-4a86-a6a6-76b6471879e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.194648 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-71eefe81-a0be-44d6-ae9a-b5412ed282d7 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:13.195220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacb06e-b33b-4a86-a6a6-76b6471879e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.195782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacb06e-b33b-4a86-a6a6-76b6471879e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.195897 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-71eefe81-a0be-44d6-ae9a-b5412ed282d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:13.196944 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacb06e-b33b-4a86-a6a6-76b6471879e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:13.197577 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacb06e-b33b-4a86-a6a6-76b6471879e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.199720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacb06e-b33b-4a86-a6a6-76b6471879e7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.204805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 351/702] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:13 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:13.216385 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 352/703] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:13.223760 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eefe81-a0be-44d6-ae9a-b5412ed282d7 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.233668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eefe81-a0be-44d6-ae9a-b5412ed282d7 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.238979 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4cb28-6196-49b3-8dbc-1564b897c606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.239881 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4cb28-6196-49b3-8dbc-1564b897c606 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.240168 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4cb28-6196-49b3-8dbc-1564b897c606 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.240445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4cb28-6196-49b3-8dbc-1564b897c606 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.248294 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacb06e-b33b-4a86-a6a6-76b6471879e7 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.249399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4cb28-6196-49b3-8dbc-1564b897c606 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.251642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4cb28-6196-49b3-8dbc-1564b897c606 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.261179 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacb06e-b33b-4a86-a6a6-76b6471879e7 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.266620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fe0a4-c9fb-4f08-917c-72bcdf7108ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.267545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe0a4-c9fb-4f08-917c-72bcdf7108ac admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.267832 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe0a4-c9fb-4f08-917c-72bcdf7108ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.268956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe0a4-c9fb-4f08-917c-72bcdf7108ac admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.269826 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-76c4cb28-6196-49b3-8dbc-1564b897c606 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:13.271815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 352/704] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:13.278526 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4cb28-6196-49b3-8dbc-1564b897c606 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.282077 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fe0a4-c9fb-4f08-917c-72bcdf7108ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:13.290943 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-9a6fe0a4-c9fb-4f08-917c-72bcdf7108ac admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:20:13.291077 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 353/705] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:13.295102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4cb28-6196-49b3-8dbc-1564b897c606 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.298258 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fe0a4-c9fb-4f08-917c-72bcdf7108ac admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.306608 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a1599-664b-4df7-8266-44b0805c59fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.307517 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a1599-664b-4df7-8266-44b0805c59fc admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.307975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a1599-664b-4df7-8266-44b0805c59fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.308403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a1599-664b-4df7-8266-44b0805c59fc admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.309364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a1599-664b-4df7-8266-44b0805c59fc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:13.309492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fe0a4-c9fb-4f08-917c-72bcdf7108ac admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.309934 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a1599-664b-4df7-8266-44b0805c59fc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.312173 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a1599-664b-4df7-8266-44b0805c59fc admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.318859 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7971bb-70b3-4f44-88c9-f0bfb127743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.318859 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7971bb-70b3-4f44-88c9-f0bfb127743f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.318859 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7971bb-70b3-4f44-88c9-f0bfb127743f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.318859 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7971bb-70b3-4f44-88c9-f0bfb127743f admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.319217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7971bb-70b3-4f44-88c9-f0bfb127743f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:13.319217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7971bb-70b3-4f44-88c9-f0bfb127743f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.319995 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7971bb-70b3-4f44-88c9-f0bfb127743f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.335567 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 354/706] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:13.338372 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7971bb-70b3-4f44-88c9-f0bfb127743f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.339809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 353/707] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:13.346122 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a1599-664b-4df7-8266-44b0805c59fc admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.349807 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7971bb-70b3-4f44-88c9-f0bfb127743f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.358870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1acfe0-d162-43f9-b25d-b1451c54d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.358870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1acfe0-d162-43f9-b25d-b1451c54d338 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.358870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1acfe0-d162-43f9-b25d-b1451c54d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.358870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1acfe0-d162-43f9-b25d-b1451c54d338 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.368719 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1acfe0-d162-43f9-b25d-b1451c54d338 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.369354 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a1599-664b-4df7-8266-44b0805c59fc admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.370986 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1acfe0-d162-43f9-b25d-b1451c54d338 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.384391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd2cc3-7458-4221-b73a-dd2a02352b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.385448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd2cc3-7458-4221-b73a-dd2a02352b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.385882 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd2cc3-7458-4221-b73a-dd2a02352b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.386329 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd2cc3-7458-4221-b73a-dd2a02352b33 admin admin] PATH_INFO: `/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/f6af4c462c6347ff8abbcc8770874b44/roles/de4c885bb354403b98a2f1aefb43754e` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.394892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-ab1acfe0-d162-43f9-b25d-b1451c54d338 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:13.395032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 355/708] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:13.398790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1acfe0-d162-43f9-b25d-b1451c54d338 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.410311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1acfe0-d162-43f9-b25d-b1451c54d338 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.416319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42546863-250d-4866-a46a-106461121424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.417132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42546863-250d-4866-a46a-106461121424 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.417726 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42546863-250d-4866-a46a-106461121424 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.418241 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42546863-250d-4866-a46a-106461121424 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.419278 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42546863-250d-4866-a46a-106461121424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:13.419747 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42546863-250d-4866-a46a-106461121424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.420636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd2cc3-7458-4221-b73a-dd2a02352b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce43bc1cdb744a2b2c65dd4c50d6599, user_id=f6af4c462c6347ff8abbcc8770874b44, role_id=de4c885bb354403b98a2f1aefb43754e)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.421628 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42546863-250d-4866-a46a-106461121424 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.423680 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd2cc3-7458-4221-b73a-dd2a02352b33 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.442907 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 356/709] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:13.446397 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42546863-250d-4866-a46a-106461121424 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.459303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42546863-250d-4866-a46a-106461121424 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.465379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719d4e1-97b6-40e2-be8d-53d27269395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.466361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719d4e1-97b6-40e2-be8d-53d27269395c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.466952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719d4e1-97b6-40e2-be8d-53d27269395c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.467469 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719d4e1-97b6-40e2-be8d-53d27269395c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.470342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 354/710] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:20:13 2021] PUT /identity/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/f6af4c462c6347ff8abbcc8770874b44/roles/de4c885bb354403b98a2f1aefb43754e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:20:13.476785 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719d4e1-97b6-40e2-be8d-53d27269395c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.479038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719d4e1-97b6-40e2-be8d-53d27269395c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.496934 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-6719d4e1-97b6-40e2-be8d-53d27269395c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 16 00:20:13.502962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 357/711] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:13.505333 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd2cc3-7458-4221-b73a-dd2a02352b33 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.569986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd2cc3-7458-4221-b73a-dd2a02352b33 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.574865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59070eb-6bee-4322-bc86-5dcfa8f331f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.575566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59070eb-6bee-4322-bc86-5dcfa8f331f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.575852 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59070eb-6bee-4322-bc86-5dcfa8f331f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.576129 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59070eb-6bee-4322-bc86-5dcfa8f331f7 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.576983 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59070eb-6bee-4322-bc86-5dcfa8f331f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:13.577296 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59070eb-6bee-4322-bc86-5dcfa8f331f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.579256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59070eb-6bee-4322-bc86-5dcfa8f331f7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.598973 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 355/712] 10.222.0.50 () {56 vars in 1156 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:13.605454 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719d4e1-97b6-40e2-be8d-53d27269395c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.615478 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719d4e1-97b6-40e2-be8d-53d27269395c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.620349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c045d-c8e4-49e9-8005-0b8f89886034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.621158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c045d-c8e4-49e9-8005-0b8f89886034 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.621441 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c045d-c8e4-49e9-8005-0b8f89886034 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.621715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c045d-c8e4-49e9-8005-0b8f89886034 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.634299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c045d-c8e4-49e9-8005-0b8f89886034 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.636188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c045d-c8e4-49e9-8005-0b8f89886034 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.654622 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-782c045d-c8e4-49e9-8005-0b8f89886034 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:13.662059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 358/713] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:13.663529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59070eb-6bee-4322-bc86-5dcfa8f331f7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.673864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59070eb-6bee-4322-bc86-5dcfa8f331f7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.679666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef0e9e-7bb3-4518-a097-c70dfeab656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.680341 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef0e9e-7bb3-4518-a097-c70dfeab656f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.680625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef0e9e-7bb3-4518-a097-c70dfeab656f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.680904 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef0e9e-7bb3-4518-a097-c70dfeab656f admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.681629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef0e9e-7bb3-4518-a097-c70dfeab656f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:13.681937 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef0e9e-7bb3-4518-a097-c70dfeab656f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.683721 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef0e9e-7bb3-4518-a097-c70dfeab656f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.696421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 356/714] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:13.702814 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c045d-c8e4-49e9-8005-0b8f89886034 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.713338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c045d-c8e4-49e9-8005-0b8f89886034 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.718149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657479d0-54ac-4a88-ae83-de4525ed70b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.718980 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657479d0-54ac-4a88-ae83-de4525ed70b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.719264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657479d0-54ac-4a88-ae83-de4525ed70b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.719541 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657479d0-54ac-4a88-ae83-de4525ed70b5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.728238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657479d0-54ac-4a88-ae83-de4525ed70b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.730368 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657479d0-54ac-4a88-ae83-de4525ed70b5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.745493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-657479d0-54ac-4a88-ae83-de4525ed70b5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:13.751198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 359/715] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:13.754363 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef0e9e-7bb3-4518-a097-c70dfeab656f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.769448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef0e9e-7bb3-4518-a097-c70dfeab656f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.780815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb96eb2-a516-4009-9718-30cfba2bf283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.781596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb96eb2-a516-4009-9718-30cfba2bf283 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.781950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb96eb2-a516-4009-9718-30cfba2bf283 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.782318 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb96eb2-a516-4009-9718-30cfba2bf283 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.783227 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb96eb2-a516-4009-9718-30cfba2bf283 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:13.783605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb96eb2-a516-4009-9718-30cfba2bf283 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.786825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb96eb2-a516-4009-9718-30cfba2bf283 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.807975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 357/716] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:13.814670 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657479d0-54ac-4a88-ae83-de4525ed70b5 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:13.825919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657479d0-54ac-4a88-ae83-de4525ed70b5 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:13.830607 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d2523-b858-4c6c-81e0-efad9aeba9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:13.832307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2523-b858-4c6c-81e0-efad9aeba9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:13.832621 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2523-b858-4c6c-81e0-efad9aeba9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:13.832873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2523-b858-4c6c-81e0-efad9aeba9a9 admin admin] PATH_INFO: `/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/0ac32c6730654a889472a3bad95374bc/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:13.835011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d2523-b858-4c6c-81e0-efad9aeba9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce43bc1cdb744a2b2c65dd4c50d6599, user_id=0ac32c6730654a889472a3bad95374bc, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:13.837650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d2523-b858-4c6c-81e0-efad9aeba9a9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:13.853366 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 360/717] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:20:13 2021] PUT /identity/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/0ac32c6730654a889472a3bad95374bc/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:20:15.446488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00b49b-f99c-48c2-9ac9-92ff03e6f914 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:15.447543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00b49b-f99c-48c2-9ac9-92ff03e6f914 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:15.448060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00b49b-f99c-48c2-9ac9-92ff03e6f914 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:15.450317 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 358/718] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:15.458406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe9291-394e-46b7-907b-a1797f719e17 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:15.459377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe9291-394e-46b7-907b-a1797f719e17 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:15.459883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe9291-394e-46b7-907b-a1797f719e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:15.492071 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-fefe9291-394e-46b7-907b-a1797f719e17 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:15.493722 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-fefe9291-394e-46b7-907b-a1797f719e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:15.565567 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 361/719] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:15 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:15.608844 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c79fc-a39f-4bc4-b404-f52ab0d6f0c2 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:15.609650 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c79fc-a39f-4bc4-b404-f52ab0d6f0c2 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:15.610161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c79fc-a39f-4bc4-b404-f52ab0d6f0c2 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:15.612474 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 359/720] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:15.613667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe9291-394e-46b7-907b-a1797f719e17 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:15.623031 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe9291-394e-46b7-907b-a1797f719e17 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:15.625862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f5b92-ac2e-47bd-8145-55d4514ba7c8 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:15.626164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f5b92-ac2e-47bd-8145-55d4514ba7c8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:15.626453 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f5b92-ac2e-47bd-8145-55d4514ba7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:15.628791 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e34797-f96c-492d-83e2-82d52ac3d957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:15.629987 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e34797-f96c-492d-83e2-82d52ac3d957 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:15.630489 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e34797-f96c-492d-83e2-82d52ac3d957 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:15.631021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e34797-f96c-492d-83e2-82d52ac3d957 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:15.631877 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e34797-f96c-492d-83e2-82d52ac3d957 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:15.633679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e34797-f96c-492d-83e2-82d52ac3d957 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:15.646151 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-21e34797-f96c-492d-83e2-82d52ac3d957 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 16 00:20:15.648013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 362/721] 10.222.0.50 () {56 vars in 1153 bytes} [Tue Nov 16 00:20:15 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:15.654942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e34797-f96c-492d-83e2-82d52ac3d957 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:15.660402 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-1b0f5b92-ac2e-47bd-8145-55d4514ba7c8 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:15.662014 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1b0f5b92-ac2e-47bd-8145-55d4514ba7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:15.665969 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e34797-f96c-492d-83e2-82d52ac3d957 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:15.674312 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9d17e-693d-450e-ba84-92a0720c8392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:15.675199 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9d17e-693d-450e-ba84-92a0720c8392 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:15.676180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9d17e-693d-450e-ba84-92a0720c8392 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:15.677604 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 360/722] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:15 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:15.678291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9d17e-693d-450e-ba84-92a0720c8392 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:15.679250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9d17e-693d-450e-ba84-92a0720c8392 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:15.679728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9d17e-693d-450e-ba84-92a0720c8392 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:15.681466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9d17e-693d-450e-ba84-92a0720c8392 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:15.686738 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 363/723] 10.222.0.50 () {56 vars in 1147 bytes} [Tue Nov 16 00:20:15 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:15.693180 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f5b92-ac2e-47bd-8145-55d4514ba7c8 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:15.703762 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9d17e-693d-450e-ba84-92a0720c8392 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:15.708703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f5b92-ac2e-47bd-8145-55d4514ba7c8 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:15.714533 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9d17e-693d-450e-ba84-92a0720c8392 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:15.719657 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650bd44-12c4-4ebb-b146-ec3a282061c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:15.719798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725eee5b-217a-4dc5-abfa-02618105a298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:15.720367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eee5b-217a-4dc5-abfa-02618105a298 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:15.720656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eee5b-217a-4dc5-abfa-02618105a298 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:15.720939 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eee5b-217a-4dc5-abfa-02618105a298 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:15.721839 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650bd44-12c4-4ebb-b146-ec3a282061c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:15.722552 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725eee5b-217a-4dc5-abfa-02618105a298 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:15.722739 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650bd44-12c4-4ebb-b146-ec3a282061c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:15.722878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725eee5b-217a-4dc5-abfa-02618105a298 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:15.723292 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650bd44-12c4-4ebb-b146-ec3a282061c9 admin admin] PATH_INFO: `/v3/services/network` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:15.724107 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650bd44-12c4-4ebb-b146-ec3a282061c9 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:15.724529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725eee5b-217a-4dc5-abfa-02618105a298 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:15.726056 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650bd44-12c4-4ebb-b146-ec3a282061c9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:15.737643 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 361/724] 10.222.0.50 () {56 vars in 1147 bytes} [Tue Nov 16 00:20:15 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:15.743423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-5650bd44-12c4-4ebb-b146-ec3a282061c9 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 16 00:20:15.745324 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 364/725] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:15 2021] GET /identity/v3/services/network => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:15.761761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725eee5b-217a-4dc5-abfa-02618105a298 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:15.777364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725eee5b-217a-4dc5-abfa-02618105a298 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:15.787596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357c464-7cdd-46f1-8615-55db30057175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:15.788285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357c464-7cdd-46f1-8615-55db30057175 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:15.788578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357c464-7cdd-46f1-8615-55db30057175 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:15.788862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357c464-7cdd-46f1-8615-55db30057175 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:15.789592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357c464-7cdd-46f1-8615-55db30057175 admin admin] RBAC: Adding query filter params (name=network) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:15.789909 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357c464-7cdd-46f1-8615-55db30057175 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:15.791594 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357c464-7cdd-46f1-8615-55db30057175 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:15.801177 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 362/726] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Nov 16 00:20:15 2021] GET /identity/v3/services?name=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:15.803556 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650bd44-12c4-4ebb-b146-ec3a282061c9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:15.813756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650bd44-12c4-4ebb-b146-ec3a282061c9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:15.819427 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df7ac5-3eea-4d57-8e5d-5eb7067a304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:15.820374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df7ac5-3eea-4d57-8e5d-5eb7067a304a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:15.820845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df7ac5-3eea-4d57-8e5d-5eb7067a304a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:15.821333 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df7ac5-3eea-4d57-8e5d-5eb7067a304a admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:15.822252 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df7ac5-3eea-4d57-8e5d-5eb7067a304a admin admin] RBAC: Adding query filter params (type=network) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:15.822771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df7ac5-3eea-4d57-8e5d-5eb7067a304a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:15.824671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df7ac5-3eea-4d57-8e5d-5eb7067a304a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:15.832355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 365/727] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Nov 16 00:20:15 2021] GET /identity/v3/services?type=network => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:15.837823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b522d-d320-42f7-bfc6-d0ee490b4020 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:15.837823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b522d-d320-42f7-bfc6-d0ee490b4020 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:15.837823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b522d-d320-42f7-bfc6-d0ee490b4020 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:15.837823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 363/728] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:15.839341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df7ac5-3eea-4d57-8e5d-5eb7067a304a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:15.844691 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8edbba-079e-4c72-b22b-df46df03059b None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:15.844987 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8edbba-079e-4c72-b22b-df46df03059b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:15.845270 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8edbba-079e-4c72-b22b-df46df03059b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:15.851555 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df7ac5-3eea-4d57-8e5d-5eb7067a304a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:15.856995 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aab01-0339-4aeb-ae1f-167e079b06d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:15.857967 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aab01-0339-4aeb-ae1f-167e079b06d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:15.858440 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aab01-0339-4aeb-ae1f-167e079b06d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:15.858979 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aab01-0339-4aeb-ae1f-167e079b06d1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:15.859945 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2aab01-0339-4aeb-ae1f-167e079b06d1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:15.861164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-ac2aab01-0339-4aeb-ae1f-167e079b06d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:20:15.861164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:20:15.861164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:20:15.863273 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2aab01-0339-4aeb-ae1f-167e079b06d1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:15.883570 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0c8edbba-079e-4c72-b22b-df46df03059b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:15.886719 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0c8edbba-079e-4c72-b22b-df46df03059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:15.899060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 364/729] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:15 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:15.914009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 366/730] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Nov 16 00:20:15 2021] POST /identity/v3/endpoints => generated 327 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:20:15.928149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8edbba-079e-4c72-b22b-df46df03059b None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:15.940879 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8edbba-079e-4c72-b22b-df46df03059b None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:15.973129 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ccb21-8d05-4827-be26-8e11b560a11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:15.974372 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ccb21-8d05-4827-be26-8e11b560a11f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:15.974942 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ccb21-8d05-4827-be26-8e11b560a11f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:15.975423 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ccb21-8d05-4827-be26-8e11b560a11f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:15.976308 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ccb21-8d05-4827-be26-8e11b560a11f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:15.978134 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ccb21-8d05-4827-be26-8e11b560a11f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:15.993772 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-3c9ccb21-8d05-4827-be26-8e11b560a11f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 16 00:20:15.995850 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 365/731] 10.222.0.50 () {56 vars in 1150 bytes} [Tue Nov 16 00:20:15 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:16.002989 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aab01-0339-4aeb-ae1f-167e079b06d1 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.020156 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aab01-0339-4aeb-ae1f-167e079b06d1 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.028173 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93ee6e-7c21-4ccd-8242-a0935af5756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.028858 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93ee6e-7c21-4ccd-8242-a0935af5756b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.029139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93ee6e-7c21-4ccd-8242-a0935af5756b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.029412 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93ee6e-7c21-4ccd-8242-a0935af5756b admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.030136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93ee6e-7c21-4ccd-8242-a0935af5756b admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:16.030447 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93ee6e-7c21-4ccd-8242-a0935af5756b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.032185 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93ee6e-7c21-4ccd-8242-a0935af5756b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.041066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 367/732] 10.222.0.50 () {56 vars in 1145 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:16.047783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ccb21-8d05-4827-be26-8e11b560a11f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.059861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ccb21-8d05-4827-be26-8e11b560a11f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.067561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dd1c1-0b31-4b6a-a083-c52bbeda32ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.068247 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dd1c1-0b31-4b6a-a083-c52bbeda32ad admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.068539 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dd1c1-0b31-4b6a-a083-c52bbeda32ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.068821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dd1c1-0b31-4b6a-a083-c52bbeda32ad admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.069556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836dd1c1-0b31-4b6a-a083-c52bbeda32ad admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:16.069870 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836dd1c1-0b31-4b6a-a083-c52bbeda32ad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.071678 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836dd1c1-0b31-4b6a-a083-c52bbeda32ad admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.083988 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 366/733] 10.222.0.50 () {56 vars in 1145 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:16.090472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93ee6e-7c21-4ccd-8242-a0935af5756b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.111400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93ee6e-7c21-4ccd-8242-a0935af5756b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.132092 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129f936-71a6-485f-ab05-add6620ffd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.132767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129f936-71a6-485f-ab05-add6620ffd5c admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.133040 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129f936-71a6-485f-ab05-add6620ffd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.133316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129f936-71a6-485f-ab05-add6620ffd5c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.134077 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129f936-71a6-485f-ab05-add6620ffd5c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.135710 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129f936-71a6-485f-ab05-add6620ffd5c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.182232 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 368/734] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Nov 16 00:20:16 2021] POST /identity/v3/endpoints => generated 346 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:20:16.456283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337636-00d8-4f0e-b8e8-658412950c40 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.456810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337636-00d8-4f0e-b8e8-658412950c40 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.456884 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337636-00d8-4f0e-b8e8-658412950c40 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.458877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 367/735] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:16.466357 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9414c-8ffd-40e7-a0a3-414c4828de1d None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.466781 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9414c-8ffd-40e7-a0a3-414c4828de1d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.467087 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9414c-8ffd-40e7-a0a3-414c4828de1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.485996 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-8ed9414c-8ffd-40e7-a0a3-414c4828de1d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:16.487420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8ed9414c-8ffd-40e7-a0a3-414c4828de1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:16.503997 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 369/736] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:16 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:16.532309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337636-00d8-4f0e-b8e8-658412950c40 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.550355 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337636-00d8-4f0e-b8e8-658412950c40 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.554803 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81d5f-15d4-4482-a1d2-86fbbcc8491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.555623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81d5f-15d4-4482-a1d2-86fbbcc8491c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.555914 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81d5f-15d4-4482-a1d2-86fbbcc8491c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.556194 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81d5f-15d4-4482-a1d2-86fbbcc8491c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.568351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f81d5f-15d4-4482-a1d2-86fbbcc8491c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:16.575444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-d9f81d5f-15d4-4482-a1d2-86fbbcc8491c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:20:16.577067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 368/737] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:16.584845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9414c-8ffd-40e7-a0a3-414c4828de1d None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.594752 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9414c-8ffd-40e7-a0a3-414c4828de1d None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.599969 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca9129-9fbd-4578-9a86-2229a2dc5913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.600686 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9129-9fbd-4578-9a86-2229a2dc5913 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.600953 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9129-9fbd-4578-9a86-2229a2dc5913 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.601235 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9129-9fbd-4578-9a86-2229a2dc5913 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.602021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca9129-9fbd-4578-9a86-2229a2dc5913 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:16.602335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca9129-9fbd-4578-9a86-2229a2dc5913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.604051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca9129-9fbd-4578-9a86-2229a2dc5913 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.613631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 370/738] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:16.619871 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81d5f-15d4-4482-a1d2-86fbbcc8491c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.630775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81d5f-15d4-4482-a1d2-86fbbcc8491c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.635511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2628ec-2f49-42b7-9aa0-5e7cd7974ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.636298 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2628ec-2f49-42b7-9aa0-5e7cd7974ede admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.636587 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2628ec-2f49-42b7-9aa0-5e7cd7974ede admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.636871 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2628ec-2f49-42b7-9aa0-5e7cd7974ede admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.648211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2628ec-2f49-42b7-9aa0-5e7cd7974ede admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.650078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2628ec-2f49-42b7-9aa0-5e7cd7974ede admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.667795 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-9b2628ec-2f49-42b7-9aa0-5e7cd7974ede admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:16.668989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 369/739] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:16.676196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca9129-9fbd-4578-9a86-2229a2dc5913 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.677675 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d5ebc-a508-42aa-8843-f2a6d723252d None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.677973 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d5ebc-a508-42aa-8843-f2a6d723252d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.678260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d5ebc-a508-42aa-8843-f2a6d723252d None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.680228 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 370/740] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:20:16.686141 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca9129-9fbd-4578-9a86-2229a2dc5913 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.688784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea7457-1340-4ea2-b4d0-9c8bccc6070f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.689083 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea7457-1340-4ea2-b4d0-9c8bccc6070f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.689370 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea7457-1340-4ea2-b4d0-9c8bccc6070f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.691457 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731901b1-49c6-4f1d-88de-ff1aa02569ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.692266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731901b1-49c6-4f1d-88de-ff1aa02569ff admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.692559 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731901b1-49c6-4f1d-88de-ff1aa02569ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.692978 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731901b1-49c6-4f1d-88de-ff1aa02569ff admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.693756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731901b1-49c6-4f1d-88de-ff1aa02569ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:16.694177 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731901b1-49c6-4f1d-88de-ff1aa02569ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.696147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731901b1-49c6-4f1d-88de-ff1aa02569ff admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.709393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-42ea7457-1340-4ea2-b4d0-9c8bccc6070f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:16.710550 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 371/741] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:16.714995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-42ea7457-1340-4ea2-b4d0-9c8bccc6070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:16.716803 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731901b1-49c6-4f1d-88de-ff1aa02569ff admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.728298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731901b1-49c6-4f1d-88de-ff1aa02569ff admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.731034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 371/742] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:16 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:16.737696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875af6e-0e1a-4c6b-b970-755ccd331650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.737696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875af6e-0e1a-4c6b-b970-755ccd331650 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.737696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875af6e-0e1a-4c6b-b970-755ccd331650 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.737696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875af6e-0e1a-4c6b-b970-755ccd331650 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.743880 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875af6e-0e1a-4c6b-b970-755ccd331650 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.745920 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875af6e-0e1a-4c6b-b970-755ccd331650 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.756766 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea7457-1340-4ea2-b4d0-9c8bccc6070f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.760349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-5875af6e-0e1a-4c6b-b970-755ccd331650 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 16 00:20:16.761925 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 372/743] 10.222.0.50 () {56 vars in 1138 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:16.766679 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea7457-1340-4ea2-b4d0-9c8bccc6070f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.767943 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875af6e-0e1a-4c6b-b970-755ccd331650 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.771853 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ef3df-5b1d-4c4b-a492-2d0f3da4e4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.772770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ef3df-5b1d-4c4b-a492-2d0f3da4e4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.773116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ef3df-5b1d-4c4b-a492-2d0f3da4e4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.773499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ef3df-5b1d-4c4b-a492-2d0f3da4e4f5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.777619 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875af6e-0e1a-4c6b-b970-755ccd331650 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.782327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fd69a-ef41-4255-84d6-921b07162adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.783022 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fd69a-ef41-4255-84d6-921b07162adb admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.783311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fd69a-ef41-4255-84d6-921b07162adb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.784145 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fd69a-ef41-4255-84d6-921b07162adb admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.784997 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fd69a-ef41-4255-84d6-921b07162adb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:16.785307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fd69a-ef41-4255-84d6-921b07162adb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.786305 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ef3df-5b1d-4c4b-a492-2d0f3da4e4f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:16.787201 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fd69a-ef41-4255-84d6-921b07162adb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.793024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-1e8ef3df-5b1d-4c4b-a492-2d0f3da4e4f5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:20:16.794538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 372/744] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:16.801439 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ef3df-5b1d-4c4b-a492-2d0f3da4e4f5 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.811380 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ef3df-5b1d-4c4b-a492-2d0f3da4e4f5 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.812105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 373/745] 10.222.0.50 () {56 vars in 1170 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:16.813066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fd69a-ef41-4255-84d6-921b07162adb admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.816261 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19461fc6-5159-4bfb-a7f2-002ad3dbcea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.816913 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19461fc6-5159-4bfb-a7f2-002ad3dbcea2 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.817236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19461fc6-5159-4bfb-a7f2-002ad3dbcea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.817510 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19461fc6-5159-4bfb-a7f2-002ad3dbcea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.818350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19461fc6-5159-4bfb-a7f2-002ad3dbcea2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:16.818666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19461fc6-5159-4bfb-a7f2-002ad3dbcea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.820361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19461fc6-5159-4bfb-a7f2-002ad3dbcea2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.822609 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fd69a-ef41-4255-84d6-921b07162adb admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.827254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe846eba-f9c4-446a-98e6-ba7445140749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.827888 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe846eba-f9c4-446a-98e6-ba7445140749 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.828175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe846eba-f9c4-446a-98e6-ba7445140749 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.828452 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe846eba-f9c4-446a-98e6-ba7445140749 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.830580 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 373/746] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:16.836778 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19461fc6-5159-4bfb-a7f2-002ad3dbcea2 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.837340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe846eba-f9c4-446a-98e6-ba7445140749 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.839141 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe846eba-f9c4-446a-98e6-ba7445140749 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.847446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19461fc6-5159-4bfb-a7f2-002ad3dbcea2 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.849265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 374/747] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:20:16.852195 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab472f46-7e80-48fd-8404-21fce00abe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.853033 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab472f46-7e80-48fd-8404-21fce00abe1e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.853319 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab472f46-7e80-48fd-8404-21fce00abe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.853594 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab472f46-7e80-48fd-8404-21fce00abe1e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.855328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe846eba-f9c4-446a-98e6-ba7445140749 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.864612 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe846eba-f9c4-446a-98e6-ba7445140749 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.865167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab472f46-7e80-48fd-8404-21fce00abe1e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.867667 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab472f46-7e80-48fd-8404-21fce00abe1e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.869476 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22131520-3e70-40f0-ab9d-0ec64a426a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.870433 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22131520-3e70-40f0-ab9d-0ec64a426a34 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.870797 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22131520-3e70-40f0-ab9d-0ec64a426a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.871247 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22131520-3e70-40f0-ab9d-0ec64a426a34 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.881952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22131520-3e70-40f0-ab9d-0ec64a426a34 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.883936 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22131520-3e70-40f0-ab9d-0ec64a426a34 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.885916 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-ab472f46-7e80-48fd-8404-21fce00abe1e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:16.887204 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 374/748] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:16.893822 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab472f46-7e80-48fd-8404-21fce00abe1e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.906691 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab472f46-7e80-48fd-8404-21fce00abe1e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.906932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-22131520-3e70-40f0-ab9d-0ec64a426a34 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:16.912168 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f64f8d-7b5c-4c7d-a0e9-44e15eef3ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.912874 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f64f8d-7b5c-4c7d-a0e9-44e15eef3ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.913201 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f64f8d-7b5c-4c7d-a0e9-44e15eef3ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.913480 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f64f8d-7b5c-4c7d-a0e9-44e15eef3ec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.913790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 375/749] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:16.914316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f64f8d-7b5c-4c7d-a0e9-44e15eef3ec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:16.914636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f64f8d-7b5c-4c7d-a0e9-44e15eef3ec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.914904 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22131520-3e70-40f0-ab9d-0ec64a426a34 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.916436 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f64f8d-7b5c-4c7d-a0e9-44e15eef3ec3 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.925743 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22131520-3e70-40f0-ab9d-0ec64a426a34 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.931487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e929919-c544-4b72-aab9-fd3bb4f70a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.932259 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e929919-c544-4b72-aab9-fd3bb4f70a7b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.932611 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e929919-c544-4b72-aab9-fd3bb4f70a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.932963 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e929919-c544-4b72-aab9-fd3bb4f70a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.933775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e929919-c544-4b72-aab9-fd3bb4f70a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:16.934154 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e929919-c544-4b72-aab9-fd3bb4f70a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.935870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e929919-c544-4b72-aab9-fd3bb4f70a7b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.937190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 375/750] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:16.938209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f64f8d-7b5c-4c7d-a0e9-44e15eef3ec3 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.950004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f64f8d-7b5c-4c7d-a0e9-44e15eef3ec3 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.953677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 376/751] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:16.954678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e929919-c544-4b72-aab9-fd3bb4f70a7b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:16.954885 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e82700-da33-4cef-b212-4a891362396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.956383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e82700-da33-4cef-b212-4a891362396b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.956893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e82700-da33-4cef-b212-4a891362396b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.957229 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e82700-da33-4cef-b212-4a891362396b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.967111 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e82700-da33-4cef-b212-4a891362396b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.967361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e929919-c544-4b72-aab9-fd3bb4f70a7b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:16.969530 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e82700-da33-4cef-b212-4a891362396b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.972803 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c4e67-14a9-4503-a38e-42336fd9199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:16.973603 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c4e67-14a9-4503-a38e-42336fd9199c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:16.973891 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c4e67-14a9-4503-a38e-42336fd9199c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:16.974170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c4e67-14a9-4503-a38e-42336fd9199c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:16.981363 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c4e67-14a9-4503-a38e-42336fd9199c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:16.983376 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c4e67-14a9-4503-a38e-42336fd9199c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:16.986640 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-55e82700-da33-4cef-b212-4a891362396b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 16 00:20:16.988510 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 376/752] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:16.994785 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e82700-da33-4cef-b212-4a891362396b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:17.001266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-1f1c4e67-14a9-4503-a38e-42336fd9199c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:17.003517 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 377/753] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:17.005725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e82700-da33-4cef-b212-4a891362396b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:17.009646 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c4e67-14a9-4503-a38e-42336fd9199c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:17.010453 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14512f99-0933-4bcc-8ddd-1930f623b0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:17.011218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14512f99-0933-4bcc-8ddd-1930f623b0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:17.011499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14512f99-0933-4bcc-8ddd-1930f623b0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:17.011777 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14512f99-0933-4bcc-8ddd-1930f623b0b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:17.012660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14512f99-0933-4bcc-8ddd-1930f623b0b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:17.012968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14512f99-0933-4bcc-8ddd-1930f623b0b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:17.014997 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14512f99-0933-4bcc-8ddd-1930f623b0b6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:17.020668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c4e67-14a9-4503-a38e-42336fd9199c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:17.025555 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942f891-9a09-4a79-8b22-39682f53caa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:17.026380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942f891-9a09-4a79-8b22-39682f53caa4 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:17.026874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942f891-9a09-4a79-8b22-39682f53caa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:17.027323 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942f891-9a09-4a79-8b22-39682f53caa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:17.028256 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942f891-9a09-4a79-8b22-39682f53caa4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:17.028728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942f891-9a09-4a79-8b22-39682f53caa4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:17.030728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942f891-9a09-4a79-8b22-39682f53caa4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:17.037796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 377/754] 10.222.0.50 () {56 vars in 1156 bytes} [Tue Nov 16 00:20:16 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:17.043956 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14512f99-0933-4bcc-8ddd-1930f623b0b6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:17.044763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 378/755] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:17.051824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942f891-9a09-4a79-8b22-39682f53caa4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:17.055168 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14512f99-0933-4bcc-8ddd-1930f623b0b6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:17.059888 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf2c46-f33a-4407-85e2-872df01d2b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:17.060759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2c46-f33a-4407-85e2-872df01d2b99 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:17.061188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2c46-f33a-4407-85e2-872df01d2b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:17.061435 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942f891-9a09-4a79-8b22-39682f53caa4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:17.061831 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2c46-f33a-4407-85e2-872df01d2b99 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:17.066926 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05859a4-c0d8-4879-b02e-9d7601303c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:17.067587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05859a4-c0d8-4879-b02e-9d7601303c39 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:17.067875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05859a4-c0d8-4879-b02e-9d7601303c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:17.068155 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05859a4-c0d8-4879-b02e-9d7601303c39 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:17.068990 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05859a4-c0d8-4879-b02e-9d7601303c39 admin admin] RBAC: Adding query filter params (role.id=de4c885bb354403b98a2f1aefb43754e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=f6af4c462c6347ff8abbcc8770874b44) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:17.069411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05859a4-c0d8-4879-b02e-9d7601303c39 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:17.071191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05859a4-c0d8-4879-b02e-9d7601303c39 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:17.073253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf2c46-f33a-4407-85e2-872df01d2b99 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:17.075244 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf2c46-f33a-4407-85e2-872df01d2b99 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:17.083017 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 379/756] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:17 2021] GET /identity/v3/role_assignments?user.id=f6af4c462c6347ff8abbcc8770874b44&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=de4c885bb354403b98a2f1aefb43754e => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:17.085512 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 378/757] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:17 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:20:17.092228 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05859a4-c0d8-4879-b02e-9d7601303c39 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:17.103892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05859a4-c0d8-4879-b02e-9d7601303c39 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:17.109248 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b3107-3eb2-4d4c-baf2-4642a55747c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:17.110367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b3107-3eb2-4d4c-baf2-4642a55747c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:17.110817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b3107-3eb2-4d4c-baf2-4642a55747c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:17.111309 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b3107-3eb2-4d4c-baf2-4642a55747c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:17.125862 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b3107-3eb2-4d4c-baf2-4642a55747c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:17.128681 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b3107-3eb2-4d4c-baf2-4642a55747c1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:17.147426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-5c1b3107-3eb2-4d4c-baf2-4642a55747c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:17.149355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 380/758] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:17.155868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf2c46-f33a-4407-85e2-872df01d2b99 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:17.165894 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf2c46-f33a-4407-85e2-872df01d2b99 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:17.171093 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf540c7-7077-4d7d-907a-d36653240d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:17.172027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf540c7-7077-4d7d-907a-d36653240d90 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:17.172459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf540c7-7077-4d7d-907a-d36653240d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:17.172933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf540c7-7077-4d7d-907a-d36653240d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:17.173834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf540c7-7077-4d7d-907a-d36653240d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:17.174935 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf540c7-7077-4d7d-907a-d36653240d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:17.176761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf540c7-7077-4d7d-907a-d36653240d90 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:17.190664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 379/759] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:17.197282 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b3107-3eb2-4d4c-baf2-4642a55747c1 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:17.208934 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b3107-3eb2-4d4c-baf2-4642a55747c1 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:17.213906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3760b-4d0a-4e1c-a1be-27e021a1683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:17.214960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3760b-4d0a-4e1c-a1be-27e021a1683f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:17.215394 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3760b-4d0a-4e1c-a1be-27e021a1683f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:17.215861 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3760b-4d0a-4e1c-a1be-27e021a1683f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:17.225150 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3760b-4d0a-4e1c-a1be-27e021a1683f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:17.227458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3760b-4d0a-4e1c-a1be-27e021a1683f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:17.242112 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-a6f3760b-4d0a-4e1c-a1be-27e021a1683f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:17.243960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 381/760] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:17.250599 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf540c7-7077-4d7d-907a-d36653240d90 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:17.260991 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf540c7-7077-4d7d-907a-d36653240d90 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:17.265806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f521e82-be72-4f5f-ab83-b3c87871f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:17.266665 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f521e82-be72-4f5f-ab83-b3c87871f377 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:17.267115 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f521e82-be72-4f5f-ab83-b3c87871f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:17.267558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f521e82-be72-4f5f-ab83-b3c87871f377 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:17.269293 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f521e82-be72-4f5f-ab83-b3c87871f377 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:17.269754 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f521e82-be72-4f5f-ab83-b3c87871f377 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:17.271790 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f521e82-be72-4f5f-ab83-b3c87871f377 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:17.286003 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 380/761] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:17.292408 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3760b-4d0a-4e1c-a1be-27e021a1683f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:17.302649 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3760b-4d0a-4e1c-a1be-27e021a1683f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:17.307547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725c2f3-d42f-4a06-abcc-2b89b7a6c457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:17.308473 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725c2f3-d42f-4a06-abcc-2b89b7a6c457 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:17.308954 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725c2f3-d42f-4a06-abcc-2b89b7a6c457 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:17.309371 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725c2f3-d42f-4a06-abcc-2b89b7a6c457 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:17.310404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725c2f3-d42f-4a06-abcc-2b89b7a6c457 admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=0ac32c6730654a889472a3bad95374bc) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:17.310882 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725c2f3-d42f-4a06-abcc-2b89b7a6c457 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:17.312917 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725c2f3-d42f-4a06-abcc-2b89b7a6c457 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:17.320238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 382/762] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:17 2021] GET /identity/v3/role_assignments?user.id=0ac32c6730654a889472a3bad95374bc&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=2813231cc8954b998440e4bf5ede2945 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:18.165841 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad4b8c-ac8f-47ee-860e-22891c77d8d2 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:18.166372 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad4b8c-ac8f-47ee-860e-22891c77d8d2 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:18.166372 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad4b8c-ac8f-47ee-860e-22891c77d8d2 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:18.168517 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 381/763] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:18.176600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a5fd-83f6-4cf0-b835-dc2e24bfdba3 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:18.177049 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a5fd-83f6-4cf0-b835-dc2e24bfdba3 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:18.177241 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a5fd-83f6-4cf0-b835-dc2e24bfdba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:18.195149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-a266a5fd-83f6-4cf0-b835-dc2e24bfdba3 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:18.196335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a266a5fd-83f6-4cf0-b835-dc2e24bfdba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:18.205495 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 383/764] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:18 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:18.230488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad4b8c-ac8f-47ee-860e-22891c77d8d2 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:18.244239 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad4b8c-ac8f-47ee-860e-22891c77d8d2 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:18.248749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17499c-5442-4197-9a3e-bf098dc0d8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:18.249415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17499c-5442-4197-9a3e-bf098dc0d8ca admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:18.249701 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17499c-5442-4197-9a3e-bf098dc0d8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:18.249981 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17499c-5442-4197-9a3e-bf098dc0d8ca admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:18.250724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17499c-5442-4197-9a3e-bf098dc0d8ca admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:18.252413 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17499c-5442-4197-9a3e-bf098dc0d8ca admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:18.266779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 382/765] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Nov 16 00:20:18 2021] POST /identity/v3/services => generated 269 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:20:18.495598 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eded833-8da2-4df0-9ea5-a8d49884dd34 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:18.495866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eded833-8da2-4df0-9ea5-a8d49884dd34 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:18.496071 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eded833-8da2-4df0-9ea5-a8d49884dd34 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:18.498102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 384/766] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:18.505822 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0911e31-298b-4e5d-a793-ac10e92cbc31 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:18.506115 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0911e31-298b-4e5d-a793-ac10e92cbc31 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:18.506401 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0911e31-298b-4e5d-a793-ac10e92cbc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:18.524562 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-e0911e31-298b-4e5d-a793-ac10e92cbc31 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:18.525768 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e0911e31-298b-4e5d-a793-ac10e92cbc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:18.543644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 383/767] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:18 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:18.567030 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eded833-8da2-4df0-9ea5-a8d49884dd34 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:18.579391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eded833-8da2-4df0-9ea5-a8d49884dd34 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:18.584570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7de72-19b8-40c5-aafe-5b92b669db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:18.585368 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7de72-19b8-40c5-aafe-5b92b669db18 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:18.585652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7de72-19b8-40c5-aafe-5b92b669db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:18.585926 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7de72-19b8-40c5-aafe-5b92b669db18 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:18.586596 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7de72-19b8-40c5-aafe-5b92b669db18 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:18.588297 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7de72-19b8-40c5-aafe-5b92b669db18 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:18.600994 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-d0b7de72-19b8-40c5-aafe-5b92b669db18 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 16 00:20:18.602560 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 385/768] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:20:18 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:18.609118 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0911e31-298b-4e5d-a793-ac10e92cbc31 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:18.618283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0911e31-298b-4e5d-a793-ac10e92cbc31 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:18.622905 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45045aef-a2fc-4487-80ba-83d6a21b0aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:18.623633 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45045aef-a2fc-4487-80ba-83d6a21b0aef admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:18.623919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45045aef-a2fc-4487-80ba-83d6a21b0aef admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:18.624250 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45045aef-a2fc-4487-80ba-83d6a21b0aef admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:18.624975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45045aef-a2fc-4487-80ba-83d6a21b0aef admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:18.625289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45045aef-a2fc-4487-80ba-83d6a21b0aef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:18.626918 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45045aef-a2fc-4487-80ba-83d6a21b0aef admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:18.632181 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 384/769] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:20:18 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:18.638405 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7de72-19b8-40c5-aafe-5b92b669db18 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:18.650345 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7de72-19b8-40c5-aafe-5b92b669db18 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:18.655650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b6602-ca38-49b0-ba39-8ea23137b0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:18.656434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b6602-ca38-49b0-ba39-8ea23137b0db admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:18.656783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b6602-ca38-49b0-ba39-8ea23137b0db admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:18.657177 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b6602-ca38-49b0-ba39-8ea23137b0db admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:18.657893 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b6602-ca38-49b0-ba39-8ea23137b0db admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:18.658203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b6602-ca38-49b0-ba39-8ea23137b0db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:18.660544 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b6602-ca38-49b0-ba39-8ea23137b0db admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:18.665656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 386/770] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:20:18 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:19.449614 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f51a6-ab98-4ebf-96fa-5ec635f86e56 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.450327 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f51a6-ab98-4ebf-96fa-5ec635f86e56 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.450327 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f51a6-ab98-4ebf-96fa-5ec635f86e56 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.452240 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 385/771] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:19.460293 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704d674-0702-47f4-8181-88d65b1b0b53 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.460786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704d674-0702-47f4-8181-88d65b1b0b53 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.460889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704d674-0702-47f4-8181-88d65b1b0b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.480667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-d704d674-0702-47f4-8181-88d65b1b0b53 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:19.482264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d704d674-0702-47f4-8181-88d65b1b0b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:19.491806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 387/772] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:19 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:19.517224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f51a6-ab98-4ebf-96fa-5ec635f86e56 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:19.530698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f51a6-ab98-4ebf-96fa-5ec635f86e56 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:19.536230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50db379-7b44-49b8-8d4e-5905a811676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:19.537283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50db379-7b44-49b8-8d4e-5905a811676b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.537800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50db379-7b44-49b8-8d4e-5905a811676b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.538286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50db379-7b44-49b8-8d4e-5905a811676b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.551203 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50db379-7b44-49b8-8d4e-5905a811676b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:19.559146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-b50db379-7b44-49b8-8d4e-5905a811676b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 16 00:20:19.561115 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 386/773] 10.222.0.50 () {56 vars in 1141 bytes} [Tue Nov 16 00:20:19 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:19.569507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704d674-0702-47f4-8181-88d65b1b0b53 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:19.579606 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704d674-0702-47f4-8181-88d65b1b0b53 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:19.585493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7140f-a828-4223-bda4-b8a82ba358ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:19.586511 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7140f-a828-4223-bda4-b8a82ba358ea admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.587033 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7140f-a828-4223-bda4-b8a82ba358ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.587540 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7140f-a828-4223-bda4-b8a82ba358ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.588511 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7140f-a828-4223-bda4-b8a82ba358ea admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:19.589021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7140f-a828-4223-bda4-b8a82ba358ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:19.590894 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7140f-a828-4223-bda4-b8a82ba358ea admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:19.601369 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 388/774] 10.222.0.50 () {56 vars in 1136 bytes} [Tue Nov 16 00:20:19 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:19.607777 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50db379-7b44-49b8-8d4e-5905a811676b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:19.619461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50db379-7b44-49b8-8d4e-5905a811676b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:19.624364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727e3ea-3ee6-4038-afe8-4198afad7f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:19.625360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727e3ea-3ee6-4038-afe8-4198afad7f13 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.625846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727e3ea-3ee6-4038-afe8-4198afad7f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.626336 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727e3ea-3ee6-4038-afe8-4198afad7f13 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.636872 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727e3ea-3ee6-4038-afe8-4198afad7f13 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:19.638955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727e3ea-3ee6-4038-afe8-4198afad7f13 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:19.655739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-b727e3ea-3ee6-4038-afe8-4198afad7f13 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:19.658125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da0202-06e9-4d5c-8184-4a706087f8f5 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.659416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da0202-06e9-4d5c-8184-4a706087f8f5 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.659905 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da0202-06e9-4d5c-8184-4a706087f8f5 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.660538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 387/775] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:19.667126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 389/776] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:19 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:19.668537 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727e3ea-3ee6-4038-afe8-4198afad7f13 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:19.675487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98347c20-59a8-4353-ab3b-0d25191a2a0d None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.675784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98347c20-59a8-4353-ab3b-0d25191a2a0d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.676066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98347c20-59a8-4353-ab3b-0d25191a2a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.680774 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727e3ea-3ee6-4038-afe8-4198afad7f13 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:19.686018 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52905b1d-9fa0-448c-bb52-39c079c20c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:19.686743 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52905b1d-9fa0-448c-bb52-39c079c20c41 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.687079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52905b1d-9fa0-448c-bb52-39c079c20c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.687361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52905b1d-9fa0-448c-bb52-39c079c20c41 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.688093 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52905b1d-9fa0-448c-bb52-39c079c20c41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:19.688406 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52905b1d-9fa0-448c-bb52-39c079c20c41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:19.690558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52905b1d-9fa0-448c-bb52-39c079c20c41 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:19.697892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-98347c20-59a8-4353-ab3b-0d25191a2a0d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:19.699918 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-98347c20-59a8-4353-ab3b-0d25191a2a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:19.704425 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 388/777] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:19.711730 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52905b1d-9fa0-448c-bb52-39c079c20c41 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:19.719141 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 390/778] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:19 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:19.726986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52905b1d-9fa0-448c-bb52-39c079c20c41 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:19.732072 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac2210-3374-452a-9321-bf67bfc4d19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:19.733175 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac2210-3374-452a-9321-bf67bfc4d19f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.733699 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac2210-3374-452a-9321-bf67bfc4d19f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.734182 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac2210-3374-452a-9321-bf67bfc4d19f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.742704 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac2210-3374-452a-9321-bf67bfc4d19f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:19.745235 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98347c20-59a8-4353-ab3b-0d25191a2a0d None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:19.745439 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac2210-3374-452a-9321-bf67bfc4d19f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:19.756586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98347c20-59a8-4353-ab3b-0d25191a2a0d None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:19.763043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0ea5f-c724-45cb-8f50-109469b5c480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:19.763681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-e8ac2210-3374-452a-9321-bf67bfc4d19f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 16 00:20:19.763899 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0ea5f-c724-45cb-8f50-109469b5c480 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.764186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0ea5f-c724-45cb-8f50-109469b5c480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.764514 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0ea5f-c724-45cb-8f50-109469b5c480 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.765177 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0ea5f-c724-45cb-8f50-109469b5c480 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:19.766224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 389/779] 10.222.0.50 () {56 vars in 1138 bytes} [Tue Nov 16 00:20:19 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:19.770937 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0ea5f-c724-45cb-8f50-109469b5c480 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:19.774000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac2210-3374-452a-9321-bf67bfc4d19f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:19.782978 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-a8b0ea5f-c724-45cb-8f50-109469b5c480 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 16 00:20:19.790073 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac2210-3374-452a-9321-bf67bfc4d19f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:19.790211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 391/780] 10.222.0.50 () {56 vars in 1147 bytes} [Tue Nov 16 00:20:19 2021] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:19.791684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0ea5f-c724-45cb-8f50-109469b5c480 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:19.795466 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262a3aa-bd46-4e75-99de-4179b168b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:19.796303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a3aa-bd46-4e75-99de-4179b168b98d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.796660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a3aa-bd46-4e75-99de-4179b168b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.797063 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a3aa-bd46-4e75-99de-4179b168b98d admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.798209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262a3aa-bd46-4e75-99de-4179b168b98d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:19.798633 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262a3aa-bd46-4e75-99de-4179b168b98d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:19.801745 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262a3aa-bd46-4e75-99de-4179b168b98d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:19.803399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0ea5f-c724-45cb-8f50-109469b5c480 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:19.809134 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad20db9-3e60-484c-928d-1b973fc534ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:19.810086 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20db9-3e60-484c-928d-1b973fc534ec admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.810623 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20db9-3e60-484c-928d-1b973fc534ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.811133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad20db9-3e60-484c-928d-1b973fc534ec admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.812189 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad20db9-3e60-484c-928d-1b973fc534ec admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:19.812715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad20db9-3e60-484c-928d-1b973fc534ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:19.814557 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad20db9-3e60-484c-928d-1b973fc534ec admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:19.825558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 390/782] 10.222.0.50 () {56 vars in 1170 bytes} [Tue Nov 16 00:20:19 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:19.825873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 392/782] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Nov 16 00:20:19 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:19.828047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad20db9-3e60-484c-928d-1b973fc534ec admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:19.828158 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262a3aa-bd46-4e75-99de-4179b168b98d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:19.838595 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad20db9-3e60-484c-928d-1b973fc534ec admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:19.839387 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262a3aa-bd46-4e75-99de-4179b168b98d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:19.844092 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b44cfa-f99d-4ccb-82a0-1e1a0d637118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:19.844301 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6006b-9e33-46ae-991a-f8790c75c3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:19.844943 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6006b-9e33-46ae-991a-f8790c75c3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.845240 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6006b-9e33-46ae-991a-f8790c75c3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.845524 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6006b-9e33-46ae-991a-f8790c75c3e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.845900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44cfa-f99d-4ccb-82a0-1e1a0d637118 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.846526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44cfa-f99d-4ccb-82a0-1e1a0d637118 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.847380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44cfa-f99d-4ccb-82a0-1e1a0d637118 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.848302 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b44cfa-f99d-4ccb-82a0-1e1a0d637118 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:19.848877 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b44cfa-f99d-4ccb-82a0-1e1a0d637118 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:19.850742 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b44cfa-f99d-4ccb-82a0-1e1a0d637118 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:19.855934 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 393/783] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Nov 16 00:20:19 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:19.859022 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6006b-9e33-46ae-991a-f8790c75c3e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:19.859022 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6006b-9e33-46ae-991a-f8790c75c3e0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:19.870706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 391/784] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:19 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:20:19.878004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b44cfa-f99d-4ccb-82a0-1e1a0d637118 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:19.892445 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b44cfa-f99d-4ccb-82a0-1e1a0d637118 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:19.898376 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f89d69-b508-4036-a922-72843638e71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:19.899592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f89d69-b508-4036-a922-72843638e71e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.900106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f89d69-b508-4036-a922-72843638e71e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.900581 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f89d69-b508-4036-a922-72843638e71e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.913149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f89d69-b508-4036-a922-72843638e71e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:19.915580 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f89d69-b508-4036-a922-72843638e71e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:19.935757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-23f89d69-b508-4036-a922-72843638e71e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:19.937600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 394/785] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:19.945029 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6006b-9e33-46ae-991a-f8790c75c3e0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:19.955714 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6006b-9e33-46ae-991a-f8790c75c3e0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:19.961775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8fe27-19f4-4fca-9e9e-253a11043bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:19.963133 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fe27-19f4-4fca-9e9e-253a11043bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:19.963605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fe27-19f4-4fca-9e9e-253a11043bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:19.964063 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fe27-19f4-4fca-9e9e-253a11043bb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:19.965046 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8fe27-19f4-4fca-9e9e-253a11043bb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:19.965581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8fe27-19f4-4fca-9e9e-253a11043bb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:19.967428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8fe27-19f4-4fca-9e9e-253a11043bb4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:19.981322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 392/786] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:19.988730 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f89d69-b508-4036-a922-72843638e71e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:19.999644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f89d69-b508-4036-a922-72843638e71e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:20.005630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bc458-3215-483b-b834-cfd1e5447018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:20.006780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bc458-3215-483b-b834-cfd1e5447018 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:20.007286 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bc458-3215-483b-b834-cfd1e5447018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:20.007808 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bc458-3215-483b-b834-cfd1e5447018 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:20.016036 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bc458-3215-483b-b834-cfd1e5447018 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:20.019168 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bc458-3215-483b-b834-cfd1e5447018 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:20.035070 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-947bc458-3215-483b-b834-cfd1e5447018 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:20.036922 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 395/787] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:20.043405 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8fe27-19f4-4fca-9e9e-253a11043bb4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:20.053679 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8fe27-19f4-4fca-9e9e-253a11043bb4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:20.058510 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36602d-9931-4f1b-807a-26e9b683ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:20.059396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36602d-9931-4f1b-807a-26e9b683ff20 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:20.059860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36602d-9931-4f1b-807a-26e9b683ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:20.060312 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36602d-9931-4f1b-807a-26e9b683ff20 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:20.061294 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36602d-9931-4f1b-807a-26e9b683ff20 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:20.061791 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36602d-9931-4f1b-807a-26e9b683ff20 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:20.063868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36602d-9931-4f1b-807a-26e9b683ff20 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:20.077136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 393/788] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:20.084636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bc458-3215-483b-b834-cfd1e5447018 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:20.094907 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bc458-3215-483b-b834-cfd1e5447018 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:20.101225 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ef129-a86f-4db9-93da-c26f596437c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:20.102087 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ef129-a86f-4db9-93da-c26f596437c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:20.102558 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ef129-a86f-4db9-93da-c26f596437c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:20.103049 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ef129-a86f-4db9-93da-c26f596437c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:20.104089 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ef129-a86f-4db9-93da-c26f596437c5 admin admin] RBAC: Adding query filter params (role.id=fdd83e9cf60a40aabeb6a3a298f41e7e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=f6af4c462c6347ff8abbcc8770874b44) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:20.104581 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ef129-a86f-4db9-93da-c26f596437c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:20.106596 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ef129-a86f-4db9-93da-c26f596437c5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:20.113053 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 396/789] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:20 2021] GET /identity/v3/role_assignments?user.id=f6af4c462c6347ff8abbcc8770874b44&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=fdd83e9cf60a40aabeb6a3a298f41e7e => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:20.495648 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf377a3-4f87-4892-afc8-647e3e93cd57 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:20.496365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf377a3-4f87-4892-afc8-647e3e93cd57 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:20.496365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf377a3-4f87-4892-afc8-647e3e93cd57 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:20.498234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 394/790] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:20.506121 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4130f5a-7ee3-487a-a224-926a1b4f03c6 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:20.506966 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4130f5a-7ee3-487a-a224-926a1b4f03c6 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:20.507463 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4130f5a-7ee3-487a-a224-926a1b4f03c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:20.526560 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-f4130f5a-7ee3-487a-a224-926a1b4f03c6 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:20.528054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-f4130f5a-7ee3-487a-a224-926a1b4f03c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:20.536643 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 397/791] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:20 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:20.560093 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf377a3-4f87-4892-afc8-647e3e93cd57 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:20.573794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf377a3-4f87-4892-afc8-647e3e93cd57 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:20.578590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe5237-04a6-47de-9c41-e2fae2353389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:20.579659 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe5237-04a6-47de-9c41-e2fae2353389 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:20.580142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe5237-04a6-47de-9c41-e2fae2353389 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:20.581169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe5237-04a6-47de-9c41-e2fae2353389 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:20.582029 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe5237-04a6-47de-9c41-e2fae2353389 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:20.583862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe5237-04a6-47de-9c41-e2fae2353389 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:20.595499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-0afe5237-04a6-47de-9c41-e2fae2353389 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 16 00:20:20.597701 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 395/792] 10.222.0.50 () {56 vars in 1153 bytes} [Tue Nov 16 00:20:20 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:20.604422 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4130f5a-7ee3-487a-a224-926a1b4f03c6 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:20.613730 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4130f5a-7ee3-487a-a224-926a1b4f03c6 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:20.618434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ae689-4223-4a66-a49f-b8c146dfce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:20.619407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ae689-4223-4a66-a49f-b8c146dfce6a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:20.619889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ae689-4223-4a66-a49f-b8c146dfce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:20.620400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ae689-4223-4a66-a49f-b8c146dfce6a admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:20.621335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ae689-4223-4a66-a49f-b8c146dfce6a admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:20.621846 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ae689-4223-4a66-a49f-b8c146dfce6a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:20.623748 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ae689-4223-4a66-a49f-b8c146dfce6a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:20.629655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 398/793] 10.222.0.50 () {56 vars in 1147 bytes} [Tue Nov 16 00:20:20 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:20.635990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe5237-04a6-47de-9c41-e2fae2353389 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:20.646555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe5237-04a6-47de-9c41-e2fae2353389 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:20.651383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938be88-5caa-4a25-bc12-800c14e07f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:20.652280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938be88-5caa-4a25-bc12-800c14e07f1a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:20.652780 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938be88-5caa-4a25-bc12-800c14e07f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:20.653263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938be88-5caa-4a25-bc12-800c14e07f1a admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:20.654163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938be88-5caa-4a25-bc12-800c14e07f1a admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:20.654711 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938be88-5caa-4a25-bc12-800c14e07f1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:20.656561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938be88-5caa-4a25-bc12-800c14e07f1a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:20.662246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 396/794] 10.222.0.50 () {56 vars in 1147 bytes} [Tue Nov 16 00:20:20 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:20.668760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ae689-4223-4a66-a49f-b8c146dfce6a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:20.679606 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ae689-4223-4a66-a49f-b8c146dfce6a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:20.684473 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ecf02-440f-48f1-a194-e2345480fa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:20.685413 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ecf02-440f-48f1-a194-e2345480fa2e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:20.685948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ecf02-440f-48f1-a194-e2345480fa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:20.686435 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ecf02-440f-48f1-a194-e2345480fa2e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:20.687550 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ecf02-440f-48f1-a194-e2345480fa2e admin admin] RBAC: Adding query filter params (interface=public, service_id=b50b4ab3068f4c1eb1965711bf2049c9, region_id=RegionOne) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:20.688059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ecf02-440f-48f1-a194-e2345480fa2e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:20.690426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ecf02-440f-48f1-a194-e2345480fa2e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:20.696398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 399/795] 10.222.0.50 () {56 vars in 1272 bytes} [Tue Nov 16 00:20:20 2021] GET /identity/v3/endpoints?service_id=b50b4ab3068f4c1eb1965711bf2049c9&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:20.702657 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938be88-5caa-4a25-bc12-800c14e07f1a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:20.713400 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938be88-5caa-4a25-bc12-800c14e07f1a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:20.718345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14322d34-8bcd-44eb-a516-2fa61ccd2421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:20.719268 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322d34-8bcd-44eb-a516-2fa61ccd2421 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:20.719749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322d34-8bcd-44eb-a516-2fa61ccd2421 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:20.720232 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322d34-8bcd-44eb-a516-2fa61ccd2421 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:20.721779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14322d34-8bcd-44eb-a516-2fa61ccd2421 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:20.723925 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14322d34-8bcd-44eb-a516-2fa61ccd2421 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:20.730102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 397/796] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Nov 16 00:20:20 2021] GET /identity/v3/services => generated 1029 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:20:20.907715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0805e3-16b6-49d1-88b6-b3a1a070eedb None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:20.908088 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0805e3-16b6-49d1-88b6-b3a1a070eedb None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:20.908274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0805e3-16b6-49d1-88b6-b3a1a070eedb None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:20.910399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 400/797] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:20.917892 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380cbe-5138-4aa9-a1ad-a7e5127a9cbc None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:20.918190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380cbe-5138-4aa9-a1ad-a7e5127a9cbc None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:20.918567 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380cbe-5138-4aa9-a1ad-a7e5127a9cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:20.943693 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f9380cbe-5138-4aa9-a1ad-a7e5127a9cbc None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:20.945213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f9380cbe-5138-4aa9-a1ad-a7e5127a9cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:20.956881 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 398/798] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:20 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:20.980458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0805e3-16b6-49d1-88b6-b3a1a070eedb None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:20.993159 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0805e3-16b6-49d1-88b6-b3a1a070eedb None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:20.997551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de791558-ef2e-44af-ad30-c905f8dac538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:20.998205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791558-ef2e-44af-ad30-c905f8dac538 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:20.998484 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791558-ef2e-44af-ad30-c905f8dac538 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:20.998756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791558-ef2e-44af-ad30-c905f8dac538 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:20.999514 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de791558-ef2e-44af-ad30-c905f8dac538 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:21.000526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-de791558-ef2e-44af-ad30-c905f8dac538 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:20:21.000526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:20:21.000526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:20:21.001395 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de791558-ef2e-44af-ad30-c905f8dac538 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:21.019398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 401/799] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Nov 16 00:20:20 2021] POST /identity/v3/services => generated 251 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:20:22.104671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd254-9ffe-4d7f-9b22-8938605bf145 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.105183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd254-9ffe-4d7f-9b22-8938605bf145 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.105259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd254-9ffe-4d7f-9b22-8938605bf145 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.107299 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 399/800] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:22.115959 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993e819-5896-49c9-a8a6-d6cca7744d92 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.116437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993e819-5896-49c9-a8a6-d6cca7744d92 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.116513 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993e819-5896-49c9-a8a6-d6cca7744d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.134247 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-2993e819-5896-49c9-a8a6-d6cca7744d92 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:22.135501 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-2993e819-5896-49c9-a8a6-d6cca7744d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:22.152190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 402/801] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:22 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:22.176856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbd254-9ffe-4d7f-9b22-8938605bf145 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:22.189379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbd254-9ffe-4d7f-9b22-8938605bf145 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:22.193893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fa893-4338-4645-b9ce-7e7f3e0ea96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:22.194549 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa893-4338-4645-b9ce-7e7f3e0ea96e admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.194861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa893-4338-4645-b9ce-7e7f3e0ea96e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.195154 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa893-4338-4645-b9ce-7e7f3e0ea96e admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.195887 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fa893-4338-4645-b9ce-7e7f3e0ea96e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:22.197487 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fa893-4338-4645-b9ce-7e7f3e0ea96e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:22.219028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 400/802] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Nov 16 00:20:22 2021] POST /identity/v3/services => generated 241 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:20:22.361014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501602b-7e8a-42ec-9b4a-a5a3cafe2a58 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.361347 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501602b-7e8a-42ec-9b4a-a5a3cafe2a58 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.362133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501602b-7e8a-42ec-9b4a-a5a3cafe2a58 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.364397 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 403/803] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:22.372700 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1567f44-e8aa-46d6-9fad-6c33449fba2c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.373070 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1567f44-e8aa-46d6-9fad-6c33449fba2c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.373358 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1567f44-e8aa-46d6-9fad-6c33449fba2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.393730 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-a1567f44-e8aa-46d6-9fad-6c33449fba2c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:22.394981 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a1567f44-e8aa-46d6-9fad-6c33449fba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:22.412412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 401/804] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:22 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:22.437140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501602b-7e8a-42ec-9b4a-a5a3cafe2a58 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:22.450564 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501602b-7e8a-42ec-9b4a-a5a3cafe2a58 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:22.455621 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132684c-f4ce-4c1f-bc55-43ac98e38830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:22.456684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132684c-f4ce-4c1f-bc55-43ac98e38830 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.457205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132684c-f4ce-4c1f-bc55-43ac98e38830 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.457686 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132684c-f4ce-4c1f-bc55-43ac98e38830 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.469018 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132684c-f4ce-4c1f-bc55-43ac98e38830 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:22.477176 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-4132684c-f4ce-4c1f-bc55-43ac98e38830 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 16 00:20:22.482970 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 404/805] 10.222.0.50 () {56 vars in 1141 bytes} [Tue Nov 16 00:20:22 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:22.485672 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1567f44-e8aa-46d6-9fad-6c33449fba2c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:22.495881 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1567f44-e8aa-46d6-9fad-6c33449fba2c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:22.500992 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ad799-6b54-4cd9-9cec-a91fad6200a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:22.501865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ad799-6b54-4cd9-9cec-a91fad6200a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.502919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ad799-6b54-4cd9-9cec-a91fad6200a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.503433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ad799-6b54-4cd9-9cec-a91fad6200a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.504441 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ad799-6b54-4cd9-9cec-a91fad6200a1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:22.504933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ad799-6b54-4cd9-9cec-a91fad6200a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:22.506876 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ad799-6b54-4cd9-9cec-a91fad6200a1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:22.521518 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 402/806] 10.222.0.50 () {56 vars in 1136 bytes} [Tue Nov 16 00:20:22 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:22.523094 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132684c-f4ce-4c1f-bc55-43ac98e38830 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:22.534348 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132684c-f4ce-4c1f-bc55-43ac98e38830 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:22.539308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f3c90-3dcb-480a-857d-dbd552b5cde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:22.540297 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f3c90-3dcb-480a-857d-dbd552b5cde0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.540823 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f3c90-3dcb-480a-857d-dbd552b5cde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.541287 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f3c90-3dcb-480a-857d-dbd552b5cde0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.552643 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f3c90-3dcb-480a-857d-dbd552b5cde0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:22.554881 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f3c90-3dcb-480a-857d-dbd552b5cde0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:22.572980 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-008f3c90-3dcb-480a-857d-dbd552b5cde0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:22.578023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 405/807] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:22.582058 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ad799-6b54-4cd9-9cec-a91fad6200a1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:22.592321 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ad799-6b54-4cd9-9cec-a91fad6200a1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:22.597642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c272ee-1862-4bf8-8acc-6caabb614042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:22.598515 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c272ee-1862-4bf8-8acc-6caabb614042 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.599071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c272ee-1862-4bf8-8acc-6caabb614042 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.599536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c272ee-1862-4bf8-8acc-6caabb614042 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.600519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c272ee-1862-4bf8-8acc-6caabb614042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:22.601013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c272ee-1862-4bf8-8acc-6caabb614042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:22.602802 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c272ee-1862-4bf8-8acc-6caabb614042 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:22.620648 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 403/808] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:22.622186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f3c90-3dcb-480a-857d-dbd552b5cde0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:22.632978 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f3c90-3dcb-480a-857d-dbd552b5cde0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:22.638050 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a457b-0d30-4489-9f76-e67d72b85733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:22.639135 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a457b-0d30-4489-9f76-e67d72b85733 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.639635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a457b-0d30-4489-9f76-e67d72b85733 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.640092 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a457b-0d30-4489-9f76-e67d72b85733 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.648702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a457b-0d30-4489-9f76-e67d72b85733 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:22.651102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a457b-0d30-4489-9f76-e67d72b85733 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:22.666409 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-742a457b-0d30-4489-9f76-e67d72b85733 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 16 00:20:22.667866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 406/809] 10.222.0.50 () {56 vars in 1138 bytes} [Tue Nov 16 00:20:22 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:22.675164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c272ee-1862-4bf8-8acc-6caabb614042 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:22.685251 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c272ee-1862-4bf8-8acc-6caabb614042 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:22.690480 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072c8c7-2ab8-4bfb-a9ea-48d534adac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:22.691379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072c8c7-2ab8-4bfb-a9ea-48d534adac03 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.691847 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072c8c7-2ab8-4bfb-a9ea-48d534adac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.692388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072c8c7-2ab8-4bfb-a9ea-48d534adac03 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.693432 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072c8c7-2ab8-4bfb-a9ea-48d534adac03 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:22.693987 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072c8c7-2ab8-4bfb-a9ea-48d534adac03 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:22.696144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072c8c7-2ab8-4bfb-a9ea-48d534adac03 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:22.719007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 404/810] 10.222.0.50 () {56 vars in 1170 bytes} [Tue Nov 16 00:20:22 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:22.722647 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a457b-0d30-4489-9f76-e67d72b85733 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:22.732858 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a457b-0d30-4489-9f76-e67d72b85733 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:22.739016 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7444d0-6360-4b8b-a773-5dc285772fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:22.739873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7444d0-6360-4b8b-a773-5dc285772fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.740229 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7444d0-6360-4b8b-a773-5dc285772fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.740575 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7444d0-6360-4b8b-a773-5dc285772fc5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.751539 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7444d0-6360-4b8b-a773-5dc285772fc5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:22.753559 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7444d0-6360-4b8b-a773-5dc285772fc5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:22.772450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-8b7444d0-6360-4b8b-a773-5dc285772fc5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:22.773943 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 407/811] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:22.780293 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072c8c7-2ab8-4bfb-a9ea-48d534adac03 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:22.791113 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072c8c7-2ab8-4bfb-a9ea-48d534adac03 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:22.796054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09230d3d-bf82-424b-8bba-0c59196aea0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:22.796938 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09230d3d-bf82-424b-8bba-0c59196aea0e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.797428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09230d3d-bf82-424b-8bba-0c59196aea0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.797908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09230d3d-bf82-424b-8bba-0c59196aea0e admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.798870 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09230d3d-bf82-424b-8bba-0c59196aea0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:22.799998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09230d3d-bf82-424b-8bba-0c59196aea0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:22.801809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09230d3d-bf82-424b-8bba-0c59196aea0e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:22.817362 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 405/812] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:22.820563 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7444d0-6360-4b8b-a773-5dc285772fc5 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:22.831255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7444d0-6360-4b8b-a773-5dc285772fc5 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:22.836434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6493b-1735-43fe-a3b0-a049eb9337da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:22.837458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6493b-1735-43fe-a3b0-a049eb9337da admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.837987 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6493b-1735-43fe-a3b0-a049eb9337da admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.838490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6493b-1735-43fe-a3b0-a049eb9337da admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.846699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6493b-1735-43fe-a3b0-a049eb9337da admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:22.849258 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6493b-1735-43fe-a3b0-a049eb9337da admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:22.863427 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-67f6493b-1735-43fe-a3b0-a049eb9337da admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:22.870229 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 408/813] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:22.871795 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09230d3d-bf82-424b-8bba-0c59196aea0e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:22.882174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09230d3d-bf82-424b-8bba-0c59196aea0e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:22.887248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d091f2f-87d6-43ab-aff9-bad2eb655524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:22.888139 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d091f2f-87d6-43ab-aff9-bad2eb655524 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.888631 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d091f2f-87d6-43ab-aff9-bad2eb655524 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.889145 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d091f2f-87d6-43ab-aff9-bad2eb655524 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.890193 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d091f2f-87d6-43ab-aff9-bad2eb655524 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:22.890792 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d091f2f-87d6-43ab-aff9-bad2eb655524 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:22.892924 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d091f2f-87d6-43ab-aff9-bad2eb655524 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:22.907266 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 406/814] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:22.915275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6493b-1735-43fe-a3b0-a049eb9337da admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:22.931000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6493b-1735-43fe-a3b0-a049eb9337da admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:22.939045 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8128959-8df4-4b53-8224-5959dce785ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:22.940350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8128959-8df4-4b53-8224-5959dce785ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:22.940933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8128959-8df4-4b53-8224-5959dce785ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:22.941411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8128959-8df4-4b53-8224-5959dce785ee admin admin] PATH_INFO: `/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/f6af4c462c6347ff8abbcc8770874b44/roles/fdd83e9cf60a40aabeb6a3a298f41e7e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:22.944141 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8128959-8df4-4b53-8224-5959dce785ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce43bc1cdb744a2b2c65dd4c50d6599, user_id=f6af4c462c6347ff8abbcc8770874b44, role_id=fdd83e9cf60a40aabeb6a3a298f41e7e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:22.947186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8128959-8df4-4b53-8224-5959dce785ee admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:22.971715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 409/815] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:20:22 2021] PUT /identity/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/f6af4c462c6347ff8abbcc8770874b44/roles/fdd83e9cf60a40aabeb6a3a298f41e7e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:20:23.011618 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32211dd-454d-466a-90cd-6fe201d317fe None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:23.011953 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32211dd-454d-466a-90cd-6fe201d317fe None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:23.012185 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32211dd-454d-466a-90cd-6fe201d317fe None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:23.014257 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 407/816] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:23.022901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2de935-5608-4e82-8b9d-d1e0b886fc38 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:23.023538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2de935-5608-4e82-8b9d-d1e0b886fc38 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:23.024045 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2de935-5608-4e82-8b9d-d1e0b886fc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:23.045244 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-2e2de935-5608-4e82-8b9d-d1e0b886fc38 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:23.046977 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-2e2de935-5608-4e82-8b9d-d1e0b886fc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:23.115367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 410/817] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:23 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:23.138590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32211dd-454d-466a-90cd-6fe201d317fe None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:23.152041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32211dd-454d-466a-90cd-6fe201d317fe None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:23.156734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb033a26-976c-4c8c-b670-22d9c6e31a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:23.157779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb033a26-976c-4c8c-b670-22d9c6e31a74 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:23.158316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb033a26-976c-4c8c-b670-22d9c6e31a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:23.159561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb033a26-976c-4c8c-b670-22d9c6e31a74 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:23.160503 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb033a26-976c-4c8c-b670-22d9c6e31a74 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:23.162324 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb033a26-976c-4c8c-b670-22d9c6e31a74 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:23.174752 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-fb033a26-976c-4c8c-b670-22d9c6e31a74 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 16 00:20:23.176816 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 408/818] 10.222.0.50 () {56 vars in 1153 bytes} [Tue Nov 16 00:20:23 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:23.183322 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2de935-5608-4e82-8b9d-d1e0b886fc38 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:23.194051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2de935-5608-4e82-8b9d-d1e0b886fc38 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:23.199364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8cb47-4d5a-41e3-b009-b9ced7f96adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:23.200321 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8cb47-4d5a-41e3-b009-b9ced7f96adf admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:23.200866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8cb47-4d5a-41e3-b009-b9ced7f96adf admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:23.201364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8cb47-4d5a-41e3-b009-b9ced7f96adf admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:23.202379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8cb47-4d5a-41e3-b009-b9ced7f96adf admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:23.202959 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8cb47-4d5a-41e3-b009-b9ced7f96adf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:23.204848 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8cb47-4d5a-41e3-b009-b9ced7f96adf admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:23.211880 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 411/819] 10.222.0.50 () {56 vars in 1147 bytes} [Tue Nov 16 00:20:23 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:23.217975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb033a26-976c-4c8c-b670-22d9c6e31a74 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:23.229162 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb033a26-976c-4c8c-b670-22d9c6e31a74 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:23.233948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4e188-f4c9-4cdb-8cbd-9674f7db40c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:23.234631 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e188-f4c9-4cdb-8cbd-9674f7db40c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:23.234956 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e188-f4c9-4cdb-8cbd-9674f7db40c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:23.235236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e188-f4c9-4cdb-8cbd-9674f7db40c7 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:23.235970 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4e188-f4c9-4cdb-8cbd-9674f7db40c7 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:23.236285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4e188-f4c9-4cdb-8cbd-9674f7db40c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:23.238603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4e188-f4c9-4cdb-8cbd-9674f7db40c7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:23.244752 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 409/820] 10.222.0.50 () {56 vars in 1147 bytes} [Tue Nov 16 00:20:23 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:23.251116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8cb47-4d5a-41e3-b009-b9ced7f96adf admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:23.262009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8cb47-4d5a-41e3-b009-b9ced7f96adf admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:23.266715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46892b93-4c83-4f7f-a929-1b5fd9e083ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:23.267408 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46892b93-4c83-4f7f-a929-1b5fd9e083ff admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:23.267816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46892b93-4c83-4f7f-a929-1b5fd9e083ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:23.268105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46892b93-4c83-4f7f-a929-1b5fd9e083ff admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:23.268919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46892b93-4c83-4f7f-a929-1b5fd9e083ff admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:23.270559 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46892b93-4c83-4f7f-a929-1b5fd9e083ff admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:23.298992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 412/821] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Nov 16 00:20:23 2021] POST /identity/v3/endpoints => generated 347 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:20:23.318472 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f3185-782f-4eb2-8c76-01f061273e60 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:23.318777 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f3185-782f-4eb2-8c76-01f061273e60 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:23.319064 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f3185-782f-4eb2-8c76-01f061273e60 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:23.321248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 410/822] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:23.329204 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c64a-ae35-4312-a506-3133b83df6b7 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:23.329499 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c64a-ae35-4312-a506-3133b83df6b7 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:23.329784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c64a-ae35-4312-a506-3133b83df6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:23.351253 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-9193c64a-ae35-4312-a506-3133b83df6b7 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:23.352521 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9193c64a-ae35-4312-a506-3133b83df6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:23.373359 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 413/823] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:23 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:23.396706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f3185-782f-4eb2-8c76-01f061273e60 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:23.410455 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f3185-782f-4eb2-8c76-01f061273e60 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:23.415481 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8812b8-b65a-4c0b-bb8c-f74f621bc2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:23.416576 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8812b8-b65a-4c0b-bb8c-f74f621bc2fb admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:23.417061 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8812b8-b65a-4c0b-bb8c-f74f621bc2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:23.417528 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8812b8-b65a-4c0b-bb8c-f74f621bc2fb admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:23.418406 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8812b8-b65a-4c0b-bb8c-f74f621bc2fb admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:23.420279 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8812b8-b65a-4c0b-bb8c-f74f621bc2fb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:23.432680 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-6a8812b8-b65a-4c0b-bb8c-f74f621bc2fb admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 16 00:20:23.434595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 411/824] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:20:23 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:23.441747 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193c64a-ae35-4312-a506-3133b83df6b7 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:23.451257 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193c64a-ae35-4312-a506-3133b83df6b7 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:23.456043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb44535-a008-4f79-b4ca-1ea7f018e543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:23.456827 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb44535-a008-4f79-b4ca-1ea7f018e543 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:23.457120 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb44535-a008-4f79-b4ca-1ea7f018e543 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:23.457404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb44535-a008-4f79-b4ca-1ea7f018e543 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:23.458129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb44535-a008-4f79-b4ca-1ea7f018e543 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:23.458441 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb44535-a008-4f79-b4ca-1ea7f018e543 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:23.460093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb44535-a008-4f79-b4ca-1ea7f018e543 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:23.466072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 414/825] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:20:23 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:23.473741 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8812b8-b65a-4c0b-bb8c-f74f621bc2fb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:23.485435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8812b8-b65a-4c0b-bb8c-f74f621bc2fb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:23.491089 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ca896-dfa9-4fb3-9290-8dd0e540039a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:23.491926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ca896-dfa9-4fb3-9290-8dd0e540039a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:23.492356 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ca896-dfa9-4fb3-9290-8dd0e540039a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:23.492775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ca896-dfa9-4fb3-9290-8dd0e540039a admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:23.493637 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ca896-dfa9-4fb3-9290-8dd0e540039a admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:23.494085 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ca896-dfa9-4fb3-9290-8dd0e540039a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:23.495846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ca896-dfa9-4fb3-9290-8dd0e540039a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:23.501781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 412/826] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:20:23 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:23.509242 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb44535-a008-4f79-b4ca-1ea7f018e543 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:23.520895 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb44535-a008-4f79-b4ca-1ea7f018e543 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:23.525539 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e46342-ced5-421f-a68d-e064290afa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:23.526196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e46342-ced5-421f-a68d-e064290afa02 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:23.526483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e46342-ced5-421f-a68d-e064290afa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:23.526782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e46342-ced5-421f-a68d-e064290afa02 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:23.527581 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e46342-ced5-421f-a68d-e064290afa02 admin admin] RBAC: Adding query filter params (interface=public, service_id=4b26025b04124f43b16b0e18a3e58ccf, region_id=RegionOne) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:23.527899 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e46342-ced5-421f-a68d-e064290afa02 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:23.529494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e46342-ced5-421f-a68d-e064290afa02 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:23.535235 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 415/827] 10.222.0.50 () {56 vars in 1272 bytes} [Tue Nov 16 00:20:23 2021] GET /identity/v3/endpoints?service_id=4b26025b04124f43b16b0e18a3e58ccf&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:23.541952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ca896-dfa9-4fb3-9290-8dd0e540039a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:23.556193 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ca896-dfa9-4fb3-9290-8dd0e540039a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:23.561155 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94731b58-4ade-4b07-a8ac-84ed89792b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:23.562040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94731b58-4ade-4b07-a8ac-84ed89792b6c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:23.562333 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94731b58-4ade-4b07-a8ac-84ed89792b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:23.562620 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94731b58-4ade-4b07-a8ac-84ed89792b6c admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:23.563396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94731b58-4ade-4b07-a8ac-84ed89792b6c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:23.565572 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94731b58-4ade-4b07-a8ac-84ed89792b6c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:23.572317 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 413/828] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Nov 16 00:20:23 2021] GET /identity/v3/services => generated 1497 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:20:24.548584 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75e21b-fec5-4caf-8fee-c3961c67cccd None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:24.549299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75e21b-fec5-4caf-8fee-c3961c67cccd None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:24.549299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75e21b-fec5-4caf-8fee-c3961c67cccd None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:24.550968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 416/829] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:24.558671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c6e9-5eb7-4f71-ac58-ec1ce766fe8c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:24.559223 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c6e9-5eb7-4f71-ac58-ec1ce766fe8c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:24.559317 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c6e9-5eb7-4f71-ac58-ec1ce766fe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:24.577957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7ef7c6e9-5eb7-4f71-ac58-ec1ce766fe8c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:24.579211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7ef7c6e9-5eb7-4f71-ac58-ec1ce766fe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:24.588115 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 414/830] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:24 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:24.612351 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75e21b-fec5-4caf-8fee-c3961c67cccd None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:24.624619 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75e21b-fec5-4caf-8fee-c3961c67cccd None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:24.629232 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281022c-e63f-4ca8-bbb2-1fa51ba0807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:24.630030 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281022c-e63f-4ca8-bbb2-1fa51ba0807e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:24.630319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281022c-e63f-4ca8-bbb2-1fa51ba0807e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:24.630597 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281022c-e63f-4ca8-bbb2-1fa51ba0807e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:24.631283 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281022c-e63f-4ca8-bbb2-1fa51ba0807e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:24.632873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281022c-e63f-4ca8-bbb2-1fa51ba0807e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:24.645042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-6281022c-e63f-4ca8-bbb2-1fa51ba0807e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 16 00:20:24.646419 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 417/831] 10.222.0.50 () {56 vars in 1147 bytes} [Tue Nov 16 00:20:24 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:24.653171 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7c6e9-5eb7-4f71-ac58-ec1ce766fe8c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:24.663108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7c6e9-5eb7-4f71-ac58-ec1ce766fe8c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:24.667741 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2303e-3257-48a7-93fb-99c8c00edd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:24.668464 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2303e-3257-48a7-93fb-99c8c00edd01 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:24.668755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2303e-3257-48a7-93fb-99c8c00edd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:24.669038 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2303e-3257-48a7-93fb-99c8c00edd01 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:24.669801 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2303e-3257-48a7-93fb-99c8c00edd01 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:24.670119 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2303e-3257-48a7-93fb-99c8c00edd01 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:24.671747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2303e-3257-48a7-93fb-99c8c00edd01 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:24.677218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 415/832] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Nov 16 00:20:24 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:24.683816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281022c-e63f-4ca8-bbb2-1fa51ba0807e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:24.694038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281022c-e63f-4ca8-bbb2-1fa51ba0807e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:24.699018 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26b91-ed31-4392-aded-f5ea0e137ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:24.699677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26b91-ed31-4392-aded-f5ea0e137ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:24.699967 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26b91-ed31-4392-aded-f5ea0e137ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:24.700230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26b91-ed31-4392-aded-f5ea0e137ba5 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:24.700947 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be26b91-ed31-4392-aded-f5ea0e137ba5 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:24.701250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be26b91-ed31-4392-aded-f5ea0e137ba5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:24.702951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be26b91-ed31-4392-aded-f5ea0e137ba5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:24.708900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 418/833] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Nov 16 00:20:24 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:24.715433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2303e-3257-48a7-93fb-99c8c00edd01 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:24.726144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2303e-3257-48a7-93fb-99c8c00edd01 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:24.730678 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6b835-06cf-4d0f-a9b2-cf4b48a7097b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:24.731359 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6b835-06cf-4d0f-a9b2-cf4b48a7097b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:24.731645 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6b835-06cf-4d0f-a9b2-cf4b48a7097b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:24.731926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6b835-06cf-4d0f-a9b2-cf4b48a7097b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:24.732715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6b835-06cf-4d0f-a9b2-cf4b48a7097b admin admin] RBAC: Adding query filter params (interface=public, service_id=9e09b33e00064c529e4f12b5af27f714, region_id=RegionOne) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:24.733034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6b835-06cf-4d0f-a9b2-cf4b48a7097b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:24.734054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-24a6b835-06cf-4d0f-a9b2-cf4b48a7097b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:20:24.734054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:20:24.734054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:20:24.734957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6b835-06cf-4d0f-a9b2-cf4b48a7097b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:24.742551 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 416/834] 10.222.0.50 () {56 vars in 1272 bytes} [Tue Nov 16 00:20:24 2021] GET /identity/v3/endpoints?service_id=9e09b33e00064c529e4f12b5af27f714&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:24.748770 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26b91-ed31-4392-aded-f5ea0e137ba5 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:24.759896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26b91-ed31-4392-aded-f5ea0e137ba5 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:24.764852 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe07ab-bf47-4ada-ae36-bac7f3484b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:24.765791 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe07ab-bf47-4ada-ae36-bac7f3484b11 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:24.766277 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe07ab-bf47-4ada-ae36-bac7f3484b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:24.766770 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe07ab-bf47-4ada-ae36-bac7f3484b11 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:24.768225 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe07ab-bf47-4ada-ae36-bac7f3484b11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:24.770104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe07ab-bf47-4ada-ae36-bac7f3484b11 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:24.777333 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 419/835] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Nov 16 00:20:24 2021] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:20:25.286886 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7797304-4ec3-4b81-a07d-c7e0b1148a70 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.287274 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7797304-4ec3-4b81-a07d-c7e0b1148a70 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.287463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7797304-4ec3-4b81-a07d-c7e0b1148a70 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.289471 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 417/836] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:25.297054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268a8a-204b-407d-a3c5-873d0533c1d3 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.297885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268a8a-204b-407d-a3c5-873d0533c1d3 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.298469 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268a8a-204b-407d-a3c5-873d0533c1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.317526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-3e268a8a-204b-407d-a3c5-873d0533c1d3 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:25.318702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3e268a8a-204b-407d-a3c5-873d0533c1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:25.326708 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 420/837] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:25 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:25.351838 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7797304-4ec3-4b81-a07d-c7e0b1148a70 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.367031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7797304-4ec3-4b81-a07d-c7e0b1148a70 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.372547 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57f129-d123-4927-baa0-93879bac90a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.373622 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57f129-d123-4927-baa0-93879bac90a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.374134 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57f129-d123-4927-baa0-93879bac90a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.374621 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57f129-d123-4927-baa0-93879bac90a8 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.386757 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57f129-d123-4927-baa0-93879bac90a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:25.394579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-af57f129-d123-4927-baa0-93879bac90a8 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 16 00:20:25.401492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 418/838] 10.222.0.50 () {56 vars in 1141 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:25.403078 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e268a8a-204b-407d-a3c5-873d0533c1d3 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.412516 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e268a8a-204b-407d-a3c5-873d0533c1d3 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.417484 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90dba7-e14f-42e5-85e7-422d8a9737cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.418409 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90dba7-e14f-42e5-85e7-422d8a9737cb admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.418941 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90dba7-e14f-42e5-85e7-422d8a9737cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.419441 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90dba7-e14f-42e5-85e7-422d8a9737cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.420404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90dba7-e14f-42e5-85e7-422d8a9737cb admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:25.420926 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90dba7-e14f-42e5-85e7-422d8a9737cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.422730 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90dba7-e14f-42e5-85e7-422d8a9737cb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.437454 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 421/839] 10.222.0.50 () {56 vars in 1136 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:25.439076 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57f129-d123-4927-baa0-93879bac90a8 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.449765 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57f129-d123-4927-baa0-93879bac90a8 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.454960 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fda7c-b239-42a8-a807-ab7bf8d1a6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.456018 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fda7c-b239-42a8-a807-ab7bf8d1a6bb admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.456639 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fda7c-b239-42a8-a807-ab7bf8d1a6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.457137 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fda7c-b239-42a8-a807-ab7bf8d1a6bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.468151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fda7c-b239-42a8-a807-ab7bf8d1a6bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.470301 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fda7c-b239-42a8-a807-ab7bf8d1a6bb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.488744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-b74fda7c-b239-42a8-a807-ab7bf8d1a6bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:25.494952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 419/840] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:25.497944 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90dba7-e14f-42e5-85e7-422d8a9737cb admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.509363 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90dba7-e14f-42e5-85e7-422d8a9737cb admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.514800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98554723-3c84-4643-99d3-a4e6d8739ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.515930 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98554723-3c84-4643-99d3-a4e6d8739ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.516493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98554723-3c84-4643-99d3-a4e6d8739ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.517000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98554723-3c84-4643-99d3-a4e6d8739ab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.518542 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98554723-3c84-4643-99d3-a4e6d8739ab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:25.519114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98554723-3c84-4643-99d3-a4e6d8739ab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.521057 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98554723-3c84-4643-99d3-a4e6d8739ab3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.539031 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 422/841] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:25.542053 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fda7c-b239-42a8-a807-ab7bf8d1a6bb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.552543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fda7c-b239-42a8-a807-ab7bf8d1a6bb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.557663 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929de92-2b0c-42f2-b735-01aae18c0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.558769 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929de92-2b0c-42f2-b735-01aae18c0f07 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.559793 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929de92-2b0c-42f2-b735-01aae18c0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.560321 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929de92-2b0c-42f2-b735-01aae18c0f07 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.569287 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929de92-2b0c-42f2-b735-01aae18c0f07 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.571729 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929de92-2b0c-42f2-b735-01aae18c0f07 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.589113 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-f929de92-2b0c-42f2-b735-01aae18c0f07 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 16 00:20:25.590674 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 420/842] 10.222.0.50 () {56 vars in 1138 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:25.594739 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ae8ed-96b9-4c31-b633-b68513364c27 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.595627 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ae8ed-96b9-4c31-b633-b68513364c27 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.596166 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ae8ed-96b9-4c31-b633-b68513364c27 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.598911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 423/843] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:25.599157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929de92-2b0c-42f2-b735-01aae18c0f07 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.608958 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929de92-2b0c-42f2-b735-01aae18c0f07 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.610941 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ed410-b5cc-4b69-b890-f76075d5a6fb None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.611843 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ed410-b5cc-4b69-b890-f76075d5a6fb None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.612534 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ed410-b5cc-4b69-b890-f76075d5a6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.613849 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24631987-183e-4d67-b6f6-3e589fdca73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.614505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631987-183e-4d67-b6f6-3e589fdca73d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.614793 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631987-183e-4d67-b6f6-3e589fdca73d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.615109 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631987-183e-4d67-b6f6-3e589fdca73d admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.615945 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24631987-183e-4d67-b6f6-3e589fdca73d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:25.616254 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24631987-183e-4d67-b6f6-3e589fdca73d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.618110 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24631987-183e-4d67-b6f6-3e589fdca73d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.635488 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-7f8ed410-b5cc-4b69-b890-f76075d5a6fb None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:25.636989 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7f8ed410-b5cc-4b69-b890-f76075d5a6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:25.637894 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 421/844] 10.222.0.50 () {56 vars in 1170 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:25.644863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24631987-183e-4d67-b6f6-3e589fdca73d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.646200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 424/845] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:25 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:25.655868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24631987-183e-4d67-b6f6-3e589fdca73d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.660720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94c3a5-dfae-4f25-b715-e18209aa6806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.661418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94c3a5-dfae-4f25-b715-e18209aa6806 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.661709 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94c3a5-dfae-4f25-b715-e18209aa6806 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.661989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94c3a5-dfae-4f25-b715-e18209aa6806 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.670574 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94c3a5-dfae-4f25-b715-e18209aa6806 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.671575 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ed410-b5cc-4b69-b890-f76075d5a6fb None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.672298 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94c3a5-dfae-4f25-b715-e18209aa6806 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.681243 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ed410-b5cc-4b69-b890-f76075d5a6fb None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.682399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 422/846] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:20:25.686069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a33d8e-492e-4a4d-8c0e-895aa3fb7c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.686869 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a33d8e-492e-4a4d-8c0e-895aa3fb7c93 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.687151 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a33d8e-492e-4a4d-8c0e-895aa3fb7c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.687427 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a33d8e-492e-4a4d-8c0e-895aa3fb7c93 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.688090 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a33d8e-492e-4a4d-8c0e-895aa3fb7c93 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.688500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94c3a5-dfae-4f25-b715-e18209aa6806 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.690403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a33d8e-492e-4a4d-8c0e-895aa3fb7c93 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.697809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94c3a5-dfae-4f25-b715-e18209aa6806 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.701707 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-a1a33d8e-492e-4a4d-8c0e-895aa3fb7c93 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 16 00:20:25.702670 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ada1b-5b94-4fd1-aad1-8f419f7ad3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.703203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 425/847] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:25.703532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ada1b-5b94-4fd1-aad1-8f419f7ad3ce admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.703821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ada1b-5b94-4fd1-aad1-8f419f7ad3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.704102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ada1b-5b94-4fd1-aad1-8f419f7ad3ce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.711200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a33d8e-492e-4a4d-8c0e-895aa3fb7c93 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.718900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ada1b-5b94-4fd1-aad1-8f419f7ad3ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.721041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ada1b-5b94-4fd1-aad1-8f419f7ad3ce admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.722730 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a33d8e-492e-4a4d-8c0e-895aa3fb7c93 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.727960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220907c-44bc-42ef-b7ca-0ae18b0c05ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.728608 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220907c-44bc-42ef-b7ca-0ae18b0c05ad admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.728892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220907c-44bc-42ef-b7ca-0ae18b0c05ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.729169 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220907c-44bc-42ef-b7ca-0ae18b0c05ad admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.730364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220907c-44bc-42ef-b7ca-0ae18b0c05ad admin admin] RBAC: Adding query filter params (name=compute) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:25.730685 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220907c-44bc-42ef-b7ca-0ae18b0c05ad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.732781 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220907c-44bc-42ef-b7ca-0ae18b0c05ad admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.740732 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 426/848] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:25.745440 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-3a6ada1b-5b94-4fd1-aad1-8f419f7ad3ce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:25.747079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220907c-44bc-42ef-b7ca-0ae18b0c05ad admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.747747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 423/849] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:25.754412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ada1b-5b94-4fd1-aad1-8f419f7ad3ce admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.760640 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220907c-44bc-42ef-b7ca-0ae18b0c05ad admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.765934 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ada1b-5b94-4fd1-aad1-8f419f7ad3ce admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.766353 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c78e7-3898-48cf-b2b7-aa630064736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.767537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c78e7-3898-48cf-b2b7-aa630064736a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.768678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c78e7-3898-48cf-b2b7-aa630064736a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.769187 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c78e7-3898-48cf-b2b7-aa630064736a admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.770390 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c78e7-3898-48cf-b2b7-aa630064736a admin admin] RBAC: Adding query filter params (type=compute) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:25.771026 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c78e7-3898-48cf-b2b7-aa630064736a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.771443 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dafa2-275d-4a08-a0e6-cdb06105adbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.772124 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dafa2-275d-4a08-a0e6-cdb06105adbd admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.772409 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dafa2-275d-4a08-a0e6-cdb06105adbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.772691 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dafa2-275d-4a08-a0e6-cdb06105adbd admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.773422 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7dafa2-275d-4a08-a0e6-cdb06105adbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:25.773735 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7dafa2-275d-4a08-a0e6-cdb06105adbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.774377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c78e7-3898-48cf-b2b7-aa630064736a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.775499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7dafa2-275d-4a08-a0e6-cdb06105adbd admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.787034 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 427/850] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:25.789344 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 424/851] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:25.795707 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c78e7-3898-48cf-b2b7-aa630064736a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.811752 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c78e7-3898-48cf-b2b7-aa630064736a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.817399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faef72-641c-4b5a-8ddf-0aad5954a684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.818307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faef72-641c-4b5a-8ddf-0aad5954a684 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.818667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faef72-641c-4b5a-8ddf-0aad5954a684 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.819052 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faef72-641c-4b5a-8ddf-0aad5954a684 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.826993 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28faef72-641c-4b5a-8ddf-0aad5954a684 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.829148 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28faef72-641c-4b5a-8ddf-0aad5954a684 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.844712 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-28faef72-641c-4b5a-8ddf-0aad5954a684 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:25.846471 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c20ed-cbc1-43a0-9513-c7f308251117 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.846768 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c20ed-cbc1-43a0-9513-c7f308251117 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.847269 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 428/852] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:25.847375 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c20ed-cbc1-43a0-9513-c7f308251117 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.849108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 425/853] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:25.854287 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faef72-641c-4b5a-8ddf-0aad5954a684 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.856751 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832b682-8b58-45d4-9b17-cb6d2c723b1b None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.857170 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832b682-8b58-45d4-9b17-cb6d2c723b1b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.857556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832b682-8b58-45d4-9b17-cb6d2c723b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.866776 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faef72-641c-4b5a-8ddf-0aad5954a684 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.871929 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7824320-eb33-4977-8d39-56290fb946a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.872878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7824320-eb33-4977-8d39-56290fb946a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.873313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7824320-eb33-4977-8d39-56290fb946a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.873737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7824320-eb33-4977-8d39-56290fb946a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.874699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7824320-eb33-4977-8d39-56290fb946a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:25.875198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7824320-eb33-4977-8d39-56290fb946a3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.877425 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7824320-eb33-4977-8d39-56290fb946a3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.878989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-1832b682-8b58-45d4-9b17-cb6d2c723b1b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:25.880372 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1832b682-8b58-45d4-9b17-cb6d2c723b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:25.889662 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 426/854] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:25 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:25.892889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 429/855] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:25.899935 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832b682-8b58-45d4-9b17-cb6d2c723b1b None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.911478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832b682-8b58-45d4-9b17-cb6d2c723b1b None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.914093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7824320-eb33-4977-8d39-56290fb946a3 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.918040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192941a-3f27-40aa-9db4-80591fe5a3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.919139 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192941a-3f27-40aa-9db4-80591fe5a3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.920144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192941a-3f27-40aa-9db4-80591fe5a3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.920144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192941a-3f27-40aa-9db4-80591fe5a3a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.921097 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192941a-3f27-40aa-9db4-80591fe5a3a1 admin admin] RBAC: Adding query filter params (role.id=fdd83e9cf60a40aabeb6a3a298f41e7e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=f6af4c462c6347ff8abbcc8770874b44) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:25.921436 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192941a-3f27-40aa-9db4-80591fe5a3a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.926632 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192941a-3f27-40aa-9db4-80591fe5a3a1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.931600 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 427/856] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/role_assignments?user.id=f6af4c462c6347ff8abbcc8770874b44&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=fdd83e9cf60a40aabeb6a3a298f41e7e => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:25.931972 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7824320-eb33-4977-8d39-56290fb946a3 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.937159 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc984d5-af0a-4200-ba97-21cde8f18ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.938303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc984d5-af0a-4200-ba97-21cde8f18ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.938806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc984d5-af0a-4200-ba97-21cde8f18ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.939310 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc984d5-af0a-4200-ba97-21cde8f18ca4 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.940532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc984d5-af0a-4200-ba97-21cde8f18ca4 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.942512 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc984d5-af0a-4200-ba97-21cde8f18ca4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.958410 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-8cc984d5-af0a-4200-ba97-21cde8f18ca4 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 16 00:20:25.960417 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 430/857] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:25.967606 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192941a-3f27-40aa-9db4-80591fe5a3a1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:25.979681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192941a-3f27-40aa-9db4-80591fe5a3a1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:25.984635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e211d66-c6cd-4af7-8119-d24cbd3c0454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:25.985556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e211d66-c6cd-4af7-8119-d24cbd3c0454 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:25.985846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e211d66-c6cd-4af7-8119-d24cbd3c0454 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:25.986126 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e211d66-c6cd-4af7-8119-d24cbd3c0454 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:25.987469 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e211d66-c6cd-4af7-8119-d24cbd3c0454 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:25.987786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e211d66-c6cd-4af7-8119-d24cbd3c0454 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:25.989738 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e211d66-c6cd-4af7-8119-d24cbd3c0454 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:25.996007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 428/858] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:20:25 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:26.004230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc984d5-af0a-4200-ba97-21cde8f18ca4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:26.018983 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc984d5-af0a-4200-ba97-21cde8f18ca4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:26.023862 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398c67f-de51-4d6a-9545-43b98b98bc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:26.024551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398c67f-de51-4d6a-9545-43b98b98bc76 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:26.024835 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398c67f-de51-4d6a-9545-43b98b98bc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:26.025110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398c67f-de51-4d6a-9545-43b98b98bc76 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:26.025836 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398c67f-de51-4d6a-9545-43b98b98bc76 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:26.026147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398c67f-de51-4d6a-9545-43b98b98bc76 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:26.027849 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398c67f-de51-4d6a-9545-43b98b98bc76 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:26.033936 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 431/859] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Nov 16 00:20:26 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:26.040648 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e211d66-c6cd-4af7-8119-d24cbd3c0454 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:26.053736 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e211d66-c6cd-4af7-8119-d24cbd3c0454 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:26.059378 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab303972-96a9-47e5-9f17-6e821d405486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:26.060509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab303972-96a9-47e5-9f17-6e821d405486 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:26.061029 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab303972-96a9-47e5-9f17-6e821d405486 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:26.061517 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab303972-96a9-47e5-9f17-6e821d405486 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:26.062578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab303972-96a9-47e5-9f17-6e821d405486 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:26.063946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-ab303972-96a9-47e5-9f17-6e821d405486 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:20:26.063946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:20:26.063946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:20:26.065835 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab303972-96a9-47e5-9f17-6e821d405486 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:26.095050 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 429/860] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Nov 16 00:20:26 2021] POST /identity/v3/endpoints => generated 346 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:20:27.050663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408392d-f511-4379-883b-bcda0408f542 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:27.051762 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408392d-f511-4379-883b-bcda0408f542 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:27.052273 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408392d-f511-4379-883b-bcda0408f542 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:27.054552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 432/861] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:27.062908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47447e10-84be-42f4-b9bb-cd34d8d00cf2 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:27.063804 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47447e10-84be-42f4-b9bb-cd34d8d00cf2 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:27.064315 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47447e10-84be-42f4-b9bb-cd34d8d00cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:27.083259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-47447e10-84be-42f4-b9bb-cd34d8d00cf2 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:27.084781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-47447e10-84be-42f4-b9bb-cd34d8d00cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:27.111007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 430/862] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:27 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:27.128837 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408392d-f511-4379-883b-bcda0408f542 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:27.141409 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408392d-f511-4379-883b-bcda0408f542 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:27.146355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbf21c-1c8e-475c-8fd6-a4c4cc71960e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:27.147476 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf21c-1c8e-475c-8fd6-a4c4cc71960e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:27.147973 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf21c-1c8e-475c-8fd6-a4c4cc71960e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:27.148493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf21c-1c8e-475c-8fd6-a4c4cc71960e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:27.149357 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbf21c-1c8e-475c-8fd6-a4c4cc71960e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:27.151195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbf21c-1c8e-475c-8fd6-a4c4cc71960e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:27.163431 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-0cdbf21c-1c8e-475c-8fd6-a4c4cc71960e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 16 00:20:27.170716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 433/863] 10.222.0.50 () {56 vars in 1147 bytes} [Tue Nov 16 00:20:27 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:27.172319 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47447e10-84be-42f4-b9bb-cd34d8d00cf2 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:27.182823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47447e10-84be-42f4-b9bb-cd34d8d00cf2 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:27.187917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a50d76-6a74-4ca7-8e1a-fc5f32b773a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:27.188898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a50d76-6a74-4ca7-8e1a-fc5f32b773a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:27.189482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a50d76-6a74-4ca7-8e1a-fc5f32b773a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:27.189982 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a50d76-6a74-4ca7-8e1a-fc5f32b773a4 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:27.191138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a50d76-6a74-4ca7-8e1a-fc5f32b773a4 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:27.191690 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a50d76-6a74-4ca7-8e1a-fc5f32b773a4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:27.193581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a50d76-6a74-4ca7-8e1a-fc5f32b773a4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:27.205179 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 431/864] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Nov 16 00:20:27 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:27.207082 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbf21c-1c8e-475c-8fd6-a4c4cc71960e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:27.217583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbf21c-1c8e-475c-8fd6-a4c4cc71960e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:27.223588 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b0d64-f87e-4450-a060-57e73495aba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:27.224513 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b0d64-f87e-4450-a060-57e73495aba0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:27.225025 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b0d64-f87e-4450-a060-57e73495aba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:27.225506 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b0d64-f87e-4450-a060-57e73495aba0 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:27.226411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b0d64-f87e-4450-a060-57e73495aba0 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:27.226990 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b0d64-f87e-4450-a060-57e73495aba0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:27.228792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b0d64-f87e-4450-a060-57e73495aba0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:27.238963 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 434/865] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Nov 16 00:20:27 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:27.242025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a50d76-6a74-4ca7-8e1a-fc5f32b773a4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:27.252412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a50d76-6a74-4ca7-8e1a-fc5f32b773a4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:27.257646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2f631-4e42-4ac3-a0a3-d8605e0c9967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:27.258529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2f631-4e42-4ac3-a0a3-d8605e0c9967 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:27.259057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2f631-4e42-4ac3-a0a3-d8605e0c9967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:27.259542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2f631-4e42-4ac3-a0a3-d8605e0c9967 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:27.260495 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2f631-4e42-4ac3-a0a3-d8605e0c9967 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:27.262314 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2f631-4e42-4ac3-a0a3-d8605e0c9967 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:27.286984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 432/866] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Nov 16 00:20:27 2021] POST /identity/v3/endpoints => generated 349 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:20:28.025782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eac351-78eb-4ea9-aef9-875dc1ce9483 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:28.026128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eac351-78eb-4ea9-aef9-875dc1ce9483 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:28.026346 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eac351-78eb-4ea9-aef9-875dc1ce9483 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:28.028388 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 435/867] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:28.036487 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2758-31c5-4a35-bf34-83f8c9e4181e None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:28.036786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2758-31c5-4a35-bf34-83f8c9e4181e None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:28.037070 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2758-31c5-4a35-bf34-83f8c9e4181e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:28.055389 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-46de2758-31c5-4a35-bf34-83f8c9e4181e None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:28.056581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-46de2758-31c5-4a35-bf34-83f8c9e4181e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:28.073394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 433/868] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:28 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:28.097650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eac351-78eb-4ea9-aef9-875dc1ce9483 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:28.110325 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eac351-78eb-4ea9-aef9-875dc1ce9483 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:28.115701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab36110-8936-440f-9130-a1d12597b2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:28.116391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab36110-8936-440f-9130-a1d12597b2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:28.116677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab36110-8936-440f-9130-a1d12597b2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:28.116957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab36110-8936-440f-9130-a1d12597b2c1 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:28.117684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab36110-8936-440f-9130-a1d12597b2c1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:28.119378 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab36110-8936-440f-9130-a1d12597b2c1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:28.138789 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 436/869] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Nov 16 00:20:28 2021] POST /identity/v3/services => generated 242 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:20:28.218079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6aea-89ec-4748-b76a-8b622d0c5b5c None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:28.218269 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6aea-89ec-4748-b76a-8b622d0c5b5c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:28.218555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6aea-89ec-4748-b76a-8b622d0c5b5c None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:28.221368 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 434/870] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:28.229714 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb16cd8-7579-4ddf-9aaa-f81f6de0416f None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:28.230098 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb16cd8-7579-4ddf-9aaa-f81f6de0416f None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:28.230335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb16cd8-7579-4ddf-9aaa-f81f6de0416f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:28.250261 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-cfb16cd8-7579-4ddf-9aaa-f81f6de0416f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:28.251566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-cfb16cd8-7579-4ddf-9aaa-f81f6de0416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:28.271715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 437/871] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:28 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:28.296351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd6aea-89ec-4748-b76a-8b622d0c5b5c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:28.310366 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd6aea-89ec-4748-b76a-8b622d0c5b5c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:28.315919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e6801-c855-4c61-af34-7ab874191356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:28.316705 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e6801-c855-4c61-af34-7ab874191356 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:28.316990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e6801-c855-4c61-af34-7ab874191356 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:28.317265 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e6801-c855-4c61-af34-7ab874191356 admin admin] PATH_INFO: `/v3/services/image` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:28.317917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e6801-c855-4c61-af34-7ab874191356 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:28.319568 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e6801-c855-4c61-af34-7ab874191356 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:28.330967 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-0a8e6801-c855-4c61-af34-7ab874191356 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 16 00:20:28.332456 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 435/872] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Nov 16 00:20:28 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:28.338777 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb16cd8-7579-4ddf-9aaa-f81f6de0416f None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:28.348600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb16cd8-7579-4ddf-9aaa-f81f6de0416f None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:28.353260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637761d-f95f-4747-b66d-2630ba96d11d None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:28.353462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec3c60-25a1-46fa-8c3a-d6df49a9953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:28.353663 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637761d-f95f-4747-b66d-2630ba96d11d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:28.353815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637761d-f95f-4747-b66d-2630ba96d11d None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:28.353960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3c60-25a1-46fa-8c3a-d6df49a9953b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:28.354220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3c60-25a1-46fa-8c3a-d6df49a9953b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:28.354499 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3c60-25a1-46fa-8c3a-d6df49a9953b admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:28.355319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec3c60-25a1-46fa-8c3a-d6df49a9953b admin admin] RBAC: Adding query filter params (name=image) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:28.355630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec3c60-25a1-46fa-8c3a-d6df49a9953b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:28.355890 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 436/873] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:20:28.357300 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec3c60-25a1-46fa-8c3a-d6df49a9953b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:28.363982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 438/874] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:28 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:28.364249 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a893f-9dad-445b-8b62-120423406582 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:28.364527 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a893f-9dad-445b-8b62-120423406582 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:28.364794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a893f-9dad-445b-8b62-120423406582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:28.369830 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec3c60-25a1-46fa-8c3a-d6df49a9953b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:28.385135 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec3c60-25a1-46fa-8c3a-d6df49a9953b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:28.385971 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-b09a893f-9dad-445b-8b62-120423406582 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:28.387419 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-b09a893f-9dad-445b-8b62-120423406582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:28.389821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7c534-f443-438a-8190-a73b08267de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:28.390479 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7c534-f443-438a-8190-a73b08267de3 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:28.390764 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7c534-f443-438a-8190-a73b08267de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:28.391080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7c534-f443-438a-8190-a73b08267de3 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:28.391779 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7c534-f443-438a-8190-a73b08267de3 admin admin] RBAC: Adding query filter params (type=image) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:28.392092 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7c534-f443-438a-8190-a73b08267de3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:28.393930 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7c534-f443-438a-8190-a73b08267de3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:28.397339 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 437/875] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:28 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:28.400482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 439/876] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:28 2021] GET /identity/v3/services?type=image => generated 122 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:28.425970 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a893f-9dad-445b-8b62-120423406582 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:28.436504 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a893f-9dad-445b-8b62-120423406582 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:28.442715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f7584-470a-42d6-bdd4-159fbe50ce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:28.443719 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f7584-470a-42d6-bdd4-159fbe50ce46 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:28.444233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f7584-470a-42d6-bdd4-159fbe50ce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:28.444656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f7584-470a-42d6-bdd4-159fbe50ce46 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:28.445574 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f7584-470a-42d6-bdd4-159fbe50ce46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:28.447725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f7584-470a-42d6-bdd4-159fbe50ce46 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:28.449338 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.common [None req-e38f7584-470a-42d6-bdd4-159fbe50ce46 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 16 00:20:28.473393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.sql.core [None req-e38f7584-470a-42d6-bdd4-159fbe50ce46 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 16 00:20:28.473393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 16 00:20:28.473393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [parameters: {'id': '33df5eb34b03423bbdf3b025cb69fd3f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 16 00:20:28.473393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86001) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 16 00:20:28.490509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-e38f7584-470a-42d6-bdd4-159fbe50ce46 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 33df5eb34b03423bbdf3b025cb69fd3f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 33df5eb34b03423bbdf3b025cb69fd3f. Nov 16 00:20:28.492664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 438/877] 10.222.0.50 () {60 vars in 1161 bytes} [Tue Nov 16 00:20:28 2021] POST /identity/v3/projects => generated 262 bytes in 67 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:28.499610 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7c534-f443-438a-8190-a73b08267de3 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:28.512032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7c534-f443-438a-8190-a73b08267de3 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:28.517346 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccbf2b-1d24-4a52-a6ec-1d984d15e040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:28.518689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccbf2b-1d24-4a52-a6ec-1d984d15e040 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:28.519317 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccbf2b-1d24-4a52-a6ec-1d984d15e040 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:28.519738 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccbf2b-1d24-4a52-a6ec-1d984d15e040 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:28.528136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccbf2b-1d24-4a52-a6ec-1d984d15e040 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:28.530562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccbf2b-1d24-4a52-a6ec-1d984d15e040 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:28.546961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-ffccbf2b-1d24-4a52-a6ec-1d984d15e040 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:28.549439 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 440/878] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:28.557505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f7584-470a-42d6-bdd4-159fbe50ce46 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:28.572193 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f7584-470a-42d6-bdd4-159fbe50ce46 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:28.577314 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295e330-934a-4df4-b892-819d0ffc5802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:28.578148 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295e330-934a-4df4-b892-819d0ffc5802 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:28.578625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295e330-934a-4df4-b892-819d0ffc5802 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:28.579072 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295e330-934a-4df4-b892-819d0ffc5802 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:28.580055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295e330-934a-4df4-b892-819d0ffc5802 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:28.581075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295e330-934a-4df4-b892-819d0ffc5802 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:28.583441 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295e330-934a-4df4-b892-819d0ffc5802 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:28.606014 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 439/879] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Nov 16 00:20:28 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:29.594492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656b7d2-92cd-4089-97fd-2ba7539680c0 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:29.595080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656b7d2-92cd-4089-97fd-2ba7539680c0 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:29.595387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656b7d2-92cd-4089-97fd-2ba7539680c0 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:29.598722 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 441/880] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:29.606463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282d92e-eb70-4977-9749-7e705a5a0f50 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:29.606903 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282d92e-eb70-4977-9749-7e705a5a0f50 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:29.607077 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282d92e-eb70-4977-9749-7e705a5a0f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:29.626581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-2282d92e-eb70-4977-9749-7e705a5a0f50 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:29.628264 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2282d92e-eb70-4977-9749-7e705a5a0f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:29.643233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 440/881] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:29 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:29.661473 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656b7d2-92cd-4089-97fd-2ba7539680c0 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:29.678203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656b7d2-92cd-4089-97fd-2ba7539680c0 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:29.682710 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b4ba7-3dc7-4083-b382-39ed0ba364a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:29.683562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b4ba7-3dc7-4083-b382-39ed0ba364a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:29.683848 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b4ba7-3dc7-4083-b382-39ed0ba364a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:29.684126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b4ba7-3dc7-4083-b382-39ed0ba364a7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:29.684782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b4ba7-3dc7-4083-b382-39ed0ba364a7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:29.686394 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b4ba7-3dc7-4083-b382-39ed0ba364a7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:29.697883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-453b4ba7-3dc7-4083-b382-39ed0ba364a7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 16 00:20:29.699398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 442/882] 10.222.0.50 () {56 vars in 1147 bytes} [Tue Nov 16 00:20:29 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:29.706523 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282d92e-eb70-4977-9749-7e705a5a0f50 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:29.715827 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282d92e-eb70-4977-9749-7e705a5a0f50 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:29.721339 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3b88a-49f6-44b8-8769-d85fc8893a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:29.722383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3b88a-49f6-44b8-8769-d85fc8893a02 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:29.722536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3b88a-49f6-44b8-8769-d85fc8893a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:29.722797 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3b88a-49f6-44b8-8769-d85fc8893a02 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:29.723583 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3b88a-49f6-44b8-8769-d85fc8893a02 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:29.723894 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3b88a-49f6-44b8-8769-d85fc8893a02 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:29.725519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3b88a-49f6-44b8-8769-d85fc8893a02 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:29.735174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 441/883] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Nov 16 00:20:29 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:29.737873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b4ba7-3dc7-4083-b382-39ed0ba364a7 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:29.748066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b4ba7-3dc7-4083-b382-39ed0ba364a7 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:29.753003 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d14905-1f43-4f43-b248-685bbeaea216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:29.753728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d14905-1f43-4f43-b248-685bbeaea216 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:29.754016 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d14905-1f43-4f43-b248-685bbeaea216 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:29.754354 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d14905-1f43-4f43-b248-685bbeaea216 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:29.755106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d14905-1f43-4f43-b248-685bbeaea216 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:29.755421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d14905-1f43-4f43-b248-685bbeaea216 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:29.757131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d14905-1f43-4f43-b248-685bbeaea216 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:29.766951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 443/884] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Nov 16 00:20:29 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:29.770217 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3b88a-49f6-44b8-8769-d85fc8893a02 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:29.781810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3b88a-49f6-44b8-8769-d85fc8893a02 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:29.787122 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd42c1-9cf5-4438-b00c-c17674b5a341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:29.787775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd42c1-9cf5-4438-b00c-c17674b5a341 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:29.788063 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd42c1-9cf5-4438-b00c-c17674b5a341 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:29.788345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd42c1-9cf5-4438-b00c-c17674b5a341 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:29.789143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd42c1-9cf5-4438-b00c-c17674b5a341 admin admin] RBAC: Adding query filter params (interface=admin, service_id=9e09b33e00064c529e4f12b5af27f714, region_id=RegionOne) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:29.789461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd42c1-9cf5-4438-b00c-c17674b5a341 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:29.791261 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd42c1-9cf5-4438-b00c-c17674b5a341 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:29.801192 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 442/885] 10.222.0.50 () {56 vars in 1270 bytes} [Tue Nov 16 00:20:29 2021] GET /identity/v3/endpoints?service_id=9e09b33e00064c529e4f12b5af27f714&interface=admin®ion_id=RegionOne => generated 193 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:29.803525 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d14905-1f43-4f43-b248-685bbeaea216 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:29.813428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d14905-1f43-4f43-b248-685bbeaea216 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:29.818291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1a260-2b12-4cef-8521-e234f10b4ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:29.819037 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1a260-2b12-4cef-8521-e234f10b4ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:29.819326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1a260-2b12-4cef-8521-e234f10b4ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:29.819608 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1a260-2b12-4cef-8521-e234f10b4ae6 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:29.820411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1a260-2b12-4cef-8521-e234f10b4ae6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:29.821997 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1a260-2b12-4cef-8521-e234f10b4ae6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:29.828870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 444/886] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Nov 16 00:20:29 2021] GET /identity/v3/services => generated 1727 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:20:30.473217 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c94df5-2b3b-4b3b-9cc7-2b56f6fc8844 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:30.473742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c94df5-2b3b-4b3b-9cc7-2b56f6fc8844 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:30.474172 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c94df5-2b3b-4b3b-9cc7-2b56f6fc8844 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:30.478144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 443/887] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:30.485992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139b8bd-0d76-4e54-b3c6-ed21d6a9d2be None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:30.486490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139b8bd-0d76-4e54-b3c6-ed21d6a9d2be None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:30.487817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139b8bd-0d76-4e54-b3c6-ed21d6a9d2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:30.506559 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-5139b8bd-0d76-4e54-b3c6-ed21d6a9d2be None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:30.507818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-5139b8bd-0d76-4e54-b3c6-ed21d6a9d2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:30.522966 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 445/888] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:30 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:30.541278 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c94df5-2b3b-4b3b-9cc7-2b56f6fc8844 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:30.554151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c94df5-2b3b-4b3b-9cc7-2b56f6fc8844 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:30.558968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc634f4-2443-49a1-b366-9bb1f438ccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:30.559757 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc634f4-2443-49a1-b366-9bb1f438ccd6 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:30.560041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc634f4-2443-49a1-b366-9bb1f438ccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:30.560318 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc634f4-2443-49a1-b366-9bb1f438ccd6 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:30.560966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc634f4-2443-49a1-b366-9bb1f438ccd6 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:30.562572 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc634f4-2443-49a1-b366-9bb1f438ccd6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:30.573613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-fcc634f4-2443-49a1-b366-9bb1f438ccd6 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 16 00:20:30.578943 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 444/889] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:30 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:30.582601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139b8bd-0d76-4e54-b3c6-ed21d6a9d2be None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:30.592409 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139b8bd-0d76-4e54-b3c6-ed21d6a9d2be None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:30.598374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f519a5-34f6-4ebe-8450-2b37467cf16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:30.599196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f519a5-34f6-4ebe-8450-2b37467cf16a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:30.599383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f519a5-34f6-4ebe-8450-2b37467cf16a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:30.599662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f519a5-34f6-4ebe-8450-2b37467cf16a admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:30.600397 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f519a5-34f6-4ebe-8450-2b37467cf16a admin admin] RBAC: Adding query filter params (name=compute) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:30.600708 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f519a5-34f6-4ebe-8450-2b37467cf16a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:30.602388 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f519a5-34f6-4ebe-8450-2b37467cf16a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:30.614057 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 446/890] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Nov 16 00:20:30 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:30.615602 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc634f4-2443-49a1-b366-9bb1f438ccd6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:30.626236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc634f4-2443-49a1-b366-9bb1f438ccd6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:30.631202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348b811-8e4b-47f9-882e-629ece35b487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:30.631880 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348b811-8e4b-47f9-882e-629ece35b487 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:30.632167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348b811-8e4b-47f9-882e-629ece35b487 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:30.632446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348b811-8e4b-47f9-882e-629ece35b487 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:30.633174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348b811-8e4b-47f9-882e-629ece35b487 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:30.633487 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348b811-8e4b-47f9-882e-629ece35b487 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:30.635132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348b811-8e4b-47f9-882e-629ece35b487 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:30.646799 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 445/891] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Nov 16 00:20:30 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:30.648163 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f519a5-34f6-4ebe-8450-2b37467cf16a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:30.659387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f519a5-34f6-4ebe-8450-2b37467cf16a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:30.663673 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26608e-0b00-4cd9-8d0f-c39022f3bd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:30.664335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26608e-0b00-4cd9-8d0f-c39022f3bd78 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:30.664677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26608e-0b00-4cd9-8d0f-c39022f3bd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:30.664961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26608e-0b00-4cd9-8d0f-c39022f3bd78 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:30.665806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26608e-0b00-4cd9-8d0f-c39022f3bd78 admin admin] RBAC: Adding query filter params (interface=public, service_id=1bb460448c9c4a1292b31d791ee1a0ca, region_id=RegionOne) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:30.666127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26608e-0b00-4cd9-8d0f-c39022f3bd78 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:30.667831 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26608e-0b00-4cd9-8d0f-c39022f3bd78 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:30.678861 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 447/892] 10.222.0.50 () {56 vars in 1272 bytes} [Tue Nov 16 00:20:30 2021] GET /identity/v3/endpoints?service_id=1bb460448c9c4a1292b31d791ee1a0ca&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:30.680230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348b811-8e4b-47f9-882e-629ece35b487 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:30.690635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348b811-8e4b-47f9-882e-629ece35b487 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:30.695781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0259d-9909-428f-b2a2-9cecf51e1382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:30.696364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216c744-9682-45eb-9abe-ba646259ea64 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:30.696537 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0259d-9909-428f-b2a2-9cecf51e1382 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:30.696683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216c744-9682-45eb-9abe-ba646259ea64 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:30.696823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0259d-9909-428f-b2a2-9cecf51e1382 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:30.696962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216c744-9682-45eb-9abe-ba646259ea64 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:30.697111 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0259d-9909-428f-b2a2-9cecf51e1382 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:30.697813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0259d-9909-428f-b2a2-9cecf51e1382 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:30.698952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 448/893] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:20:30.699564 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0259d-9909-428f-b2a2-9cecf51e1382 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:30.709446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 446/894] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Nov 16 00:20:30 2021] GET /identity/v3/services => generated 1727 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:20:30.711220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37d64b-fa13-4276-8c90-e5ca3ae99eb6 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:30.711673 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37d64b-fa13-4276-8c90-e5ca3ae99eb6 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:30.712116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37d64b-fa13-4276-8c90-e5ca3ae99eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:30.732990 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-2e37d64b-fa13-4276-8c90-e5ca3ae99eb6 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:30.734446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-2e37d64b-fa13-4276-8c90-e5ca3ae99eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:30.743836 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 449/895] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:30 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:30.769396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0259d-9909-428f-b2a2-9cecf51e1382 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:30.779792 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0259d-9909-428f-b2a2-9cecf51e1382 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:30.785269 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33847a2-2a58-44be-b191-5f918aff562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:30.785948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33847a2-2a58-44be-b191-5f918aff562d admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:30.786235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33847a2-2a58-44be-b191-5f918aff562d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:30.786517 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33847a2-2a58-44be-b191-5f918aff562d admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:30.787291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33847a2-2a58-44be-b191-5f918aff562d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:30.788910 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33847a2-2a58-44be-b191-5f918aff562d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:30.806075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 447/896] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Nov 16 00:20:30 2021] POST /identity/v3/services => generated 242 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:20:30.965329 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaa1eb-d1ce-4116-9be5-e8e431d98d76 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:30.965667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaa1eb-d1ce-4116-9be5-e8e431d98d76 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:30.965884 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaa1eb-d1ce-4116-9be5-e8e431d98d76 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:30.968059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 450/897] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:30.976816 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38afbe-1c23-4dfc-915a-84e3714a9231 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:30.977106 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38afbe-1c23-4dfc-915a-84e3714a9231 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:30.977364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38afbe-1c23-4dfc-915a-84e3714a9231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:30.996538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-cd38afbe-1c23-4dfc-915a-84e3714a9231 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:30.997651 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-cd38afbe-1c23-4dfc-915a-84e3714a9231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:31.016227 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 448/898] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:30 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:31.043133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaa1eb-d1ce-4116-9be5-e8e431d98d76 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:31.058730 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaa1eb-d1ce-4116-9be5-e8e431d98d76 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:31.063249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb056e-972b-45ef-819c-ff758908a0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:31.063916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb056e-972b-45ef-819c-ff758908a0ce admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:31.064194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb056e-972b-45ef-819c-ff758908a0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:31.065160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb056e-972b-45ef-819c-ff758908a0ce admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:31.066046 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb056e-972b-45ef-819c-ff758908a0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:31.067915 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb056e-972b-45ef-819c-ff758908a0ce admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:31.069205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.common [None req-cbfb056e-972b-45ef-819c-ff758908a0ce admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 16 00:20:31.084330 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.sql.core [None req-cbfb056e-972b-45ef-819c-ff758908a0ce admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 16 00:20:31.084330 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 16 00:20:31.084330 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [parameters: {'user_id': 'f3bb992ad510485aaa0e02fc0d55aaf3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 16 00:20:31.084330 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86000) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 16 00:20:31.090228 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-cbfb056e-972b-45ef-819c-ff758908a0ce admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 16 00:20:31.091921 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 451/899] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:20:31 2021] POST /identity/v3/users => generated 160 bytes in 49 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:31.099350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38afbe-1c23-4dfc-915a-84e3714a9231 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:31.108845 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38afbe-1c23-4dfc-915a-84e3714a9231 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:31.114542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394041d-d968-4b9d-82d4-e6fa05a952d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:31.115816 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394041d-d968-4b9d-82d4-e6fa05a952d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:31.116311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394041d-d968-4b9d-82d4-e6fa05a952d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:31.116810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394041d-d968-4b9d-82d4-e6fa05a952d3 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:31.125116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394041d-d968-4b9d-82d4-e6fa05a952d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:31.128335 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394041d-d968-4b9d-82d4-e6fa05a952d3 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:31.143867 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-c394041d-d968-4b9d-82d4-e6fa05a952d3 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 16 00:20:31.145729 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 449/900] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:20:31 2021] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:31.152338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb056e-972b-45ef-819c-ff758908a0ce admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:31.163318 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb056e-972b-45ef-819c-ff758908a0ce admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:31.168124 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7ee12-01f0-4c5b-b17b-524844e91bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:31.168786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7ee12-01f0-4c5b-b17b-524844e91bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:31.169069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7ee12-01f0-4c5b-b17b-524844e91bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:31.169369 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7ee12-01f0-4c5b-b17b-524844e91bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:31.170141 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7ee12-01f0-4c5b-b17b-524844e91bd1 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:31.170444 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7ee12-01f0-4c5b-b17b-524844e91bd1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:31.172572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7ee12-01f0-4c5b-b17b-524844e91bd1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:31.218474 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 452/901] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Nov 16 00:20:31 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:32.057219 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309080c8-3824-4e5d-951c-6afc383085ad None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:32.057724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309080c8-3824-4e5d-951c-6afc383085ad None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:32.057800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309080c8-3824-4e5d-951c-6afc383085ad None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:32.059750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 450/902] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:32.067710 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48cafa-3690-42c3-abef-71cc300452e9 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:32.068181 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48cafa-3690-42c3-abef-71cc300452e9 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:32.068257 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48cafa-3690-42c3-abef-71cc300452e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:32.086662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-bc48cafa-3690-42c3-abef-71cc300452e9 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:32.088285 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-bc48cafa-3690-42c3-abef-71cc300452e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:32.096812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 453/903] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:32 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:32.121045 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309080c8-3824-4e5d-951c-6afc383085ad None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:32.133674 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309080c8-3824-4e5d-951c-6afc383085ad None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:32.137997 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aea22-7234-4aa4-b9ad-a5f8e95e59cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:32.138787 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aea22-7234-4aa4-b9ad-a5f8e95e59cb admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:32.139128 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aea22-7234-4aa4-b9ad-a5f8e95e59cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:32.139406 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aea22-7234-4aa4-b9ad-a5f8e95e59cb admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:32.140054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aea22-7234-4aa4-b9ad-a5f8e95e59cb admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:32.141640 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aea22-7234-4aa4-b9ad-a5f8e95e59cb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:32.152648 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-432aea22-7234-4aa4-b9ad-a5f8e95e59cb admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 16 00:20:32.153942 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 451/904] 10.222.0.50 () {56 vars in 1147 bytes} [Tue Nov 16 00:20:32 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:32.160514 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48cafa-3690-42c3-abef-71cc300452e9 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:32.169415 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48cafa-3690-42c3-abef-71cc300452e9 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:32.174533 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc1ac7-c82e-4713-892c-5975e89df1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:32.175219 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc1ac7-c82e-4713-892c-5975e89df1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:32.175504 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc1ac7-c82e-4713-892c-5975e89df1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:32.175779 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc1ac7-c82e-4713-892c-5975e89df1c2 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:32.176488 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc1ac7-c82e-4713-892c-5975e89df1c2 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:32.176801 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc1ac7-c82e-4713-892c-5975e89df1c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:32.178383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc1ac7-c82e-4713-892c-5975e89df1c2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:32.183651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 454/905] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Nov 16 00:20:32 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:32.190285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aea22-7234-4aa4-b9ad-a5f8e95e59cb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:32.199931 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aea22-7234-4aa4-b9ad-a5f8e95e59cb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:32.204401 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f64493-4c03-42bb-abcb-faafbfca76aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:32.205090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f64493-4c03-42bb-abcb-faafbfca76aa admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:32.205361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f64493-4c03-42bb-abcb-faafbfca76aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:32.205644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f64493-4c03-42bb-abcb-faafbfca76aa admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:32.206345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f64493-4c03-42bb-abcb-faafbfca76aa admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:32.206653 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f64493-4c03-42bb-abcb-faafbfca76aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:32.208274 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f64493-4c03-42bb-abcb-faafbfca76aa admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:32.213267 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 452/906] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Nov 16 00:20:32 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:32.219731 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc1ac7-c82e-4713-892c-5975e89df1c2 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:32.229658 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc1ac7-c82e-4713-892c-5975e89df1c2 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:32.234221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49bfb5-0d31-48b0-a979-9d71c71ff3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:32.234978 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49bfb5-0d31-48b0-a979-9d71c71ff3fd admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:32.235341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49bfb5-0d31-48b0-a979-9d71c71ff3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:32.235693 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49bfb5-0d31-48b0-a979-9d71c71ff3fd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:32.237126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49bfb5-0d31-48b0-a979-9d71c71ff3fd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:32.238702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49bfb5-0d31-48b0-a979-9d71c71ff3fd admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:32.255140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 455/907] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Nov 16 00:20:32 2021] POST /identity/v3/endpoints => generated 325 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:20:32.971101 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7597a5-93cd-494b-a01c-9e2c6d118fd1 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:32.971417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7597a5-93cd-494b-a01c-9e2c6d118fd1 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:32.971672 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7597a5-93cd-494b-a01c-9e2c6d118fd1 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:32.973848 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 453/908] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:32.981013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb289-48ec-4364-9a27-3a2a56dbe804 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:32.981308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb289-48ec-4364-9a27-3a2a56dbe804 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:32.981590 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb289-48ec-4364-9a27-3a2a56dbe804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:33.000528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-1c7bb289-48ec-4364-9a27-3a2a56dbe804 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:33.002380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-1c7bb289-48ec-4364-9a27-3a2a56dbe804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:33.020889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 456/909] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:32 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:33.044700 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7597a5-93cd-494b-a01c-9e2c6d118fd1 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:33.057340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7597a5-93cd-494b-a01c-9e2c6d118fd1 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:33.061850 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f8ac3-07dd-485e-84e1-700fb3bbc257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:33.062702 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8ac3-07dd-485e-84e1-700fb3bbc257 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:33.063085 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8ac3-07dd-485e-84e1-700fb3bbc257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:33.063436 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8ac3-07dd-485e-84e1-700fb3bbc257 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:33.064181 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f8ac3-07dd-485e-84e1-700fb3bbc257 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:33.065936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f8ac3-07dd-485e-84e1-700fb3bbc257 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:33.076853 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-122f8ac3-07dd-485e-84e1-700fb3bbc257 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 16 00:20:33.078201 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 454/910] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:33 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:33.084719 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bb289-48ec-4364-9a27-3a2a56dbe804 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:33.090886 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b4713-1109-45b4-aa5d-ef9050e97f46 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:33.091183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b4713-1109-45b4-aa5d-ef9050e97f46 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:33.091465 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b4713-1109-45b4-aa5d-ef9050e97f46 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:33.093372 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 455/911] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:20:33.094039 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bb289-48ec-4364-9a27-3a2a56dbe804 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:33.100301 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337e0f9-9184-46f2-81d2-a799edd0e0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:33.101253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc97280-be78-48a5-b020-8c3eca721b57 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:33.101445 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337e0f9-9184-46f2-81d2-a799edd0e0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:33.101597 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc97280-be78-48a5-b020-8c3eca721b57 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:33.101812 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc97280-be78-48a5-b020-8c3eca721b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:33.101956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337e0f9-9184-46f2-81d2-a799edd0e0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:33.102443 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337e0f9-9184-46f2-81d2-a799edd0e0f8 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:33.103780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337e0f9-9184-46f2-81d2-a799edd0e0f8 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:33.104324 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337e0f9-9184-46f2-81d2-a799edd0e0f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:33.106260 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337e0f9-9184-46f2-81d2-a799edd0e0f8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:33.118058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 457/912] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Nov 16 00:20:33 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:33.119536 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337e0f9-9184-46f2-81d2-a799edd0e0f8 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:33.120600 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-4fc97280-be78-48a5-b020-8c3eca721b57 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:33.121937 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4fc97280-be78-48a5-b020-8c3eca721b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:33.129041 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337e0f9-9184-46f2-81d2-a799edd0e0f8 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:33.131032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 456/913] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:33 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:33.138126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233aaa2-2d67-4ae1-8643-1e8921840a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:33.138126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233aaa2-2d67-4ae1-8643-1e8921840a34 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:33.138126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233aaa2-2d67-4ae1-8643-1e8921840a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:33.138126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233aaa2-2d67-4ae1-8643-1e8921840a34 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:33.138667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233aaa2-2d67-4ae1-8643-1e8921840a34 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:33.138667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233aaa2-2d67-4ae1-8643-1e8921840a34 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:33.138667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233aaa2-2d67-4ae1-8643-1e8921840a34 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:33.143406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 458/914] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Nov 16 00:20:33 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:33.149465 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc97280-be78-48a5-b020-8c3eca721b57 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:33.153978 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233aaa2-2d67-4ae1-8643-1e8921840a34 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:33.159683 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc97280-be78-48a5-b020-8c3eca721b57 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:33.164108 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233aaa2-2d67-4ae1-8643-1e8921840a34 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:33.164645 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d225419-f762-4485-85fc-f13fc34ca333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:33.165365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d225419-f762-4485-85fc-f13fc34ca333 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:33.165657 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d225419-f762-4485-85fc-f13fc34ca333 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:33.165973 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d225419-f762-4485-85fc-f13fc34ca333 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:33.166791 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d225419-f762-4485-85fc-f13fc34ca333 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:33.168533 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d225419-f762-4485-85fc-f13fc34ca333 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:33.168919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002a4d-73aa-4e2a-b566-2b49e16230c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:33.169680 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002a4d-73aa-4e2a-b566-2b49e16230c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:33.169961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002a4d-73aa-4e2a-b566-2b49e16230c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:33.170233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002a4d-73aa-4e2a-b566-2b49e16230c1 admin admin] PATH_INFO: `/v3/services/image` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:33.170900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a002a4d-73aa-4e2a-b566-2b49e16230c1 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:33.172458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a002a4d-73aa-4e2a-b566-2b49e16230c1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:33.184586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-6a002a4d-73aa-4e2a-b566-2b49e16230c1 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 16 00:20:33.185912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 459/915] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Nov 16 00:20:33 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:33.192652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002a4d-73aa-4e2a-b566-2b49e16230c1 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:33.199545 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 457/916] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Nov 16 00:20:33 2021] POST /identity/v3/endpoints => generated 334 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:20:33.202893 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002a4d-73aa-4e2a-b566-2b49e16230c1 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:33.219950 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5867b17-f6a3-43ff-8ce3-19395edb0dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:33.221554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5867b17-f6a3-43ff-8ce3-19395edb0dcf admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:33.222529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5867b17-f6a3-43ff-8ce3-19395edb0dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:33.222867 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5867b17-f6a3-43ff-8ce3-19395edb0dcf admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:33.223553 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5867b17-f6a3-43ff-8ce3-19395edb0dcf admin admin] RBAC: Adding query filter params (name=image) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:33.223862 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5867b17-f6a3-43ff-8ce3-19395edb0dcf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:33.225504 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5867b17-f6a3-43ff-8ce3-19395edb0dcf admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:33.231217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 460/917] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:33 2021] GET /identity/v3/services?name=image => generated 122 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:33.238446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d225419-f762-4485-85fc-f13fc34ca333 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:33.249044 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d225419-f762-4485-85fc-f13fc34ca333 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:33.254904 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57acf7-2095-46a5-909b-d933d8364c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:33.255591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57acf7-2095-46a5-909b-d933d8364c5e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:33.255893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57acf7-2095-46a5-909b-d933d8364c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:33.256179 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57acf7-2095-46a5-909b-d933d8364c5e admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:33.256903 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57acf7-2095-46a5-909b-d933d8364c5e admin admin] RBAC: Adding query filter params (type=image) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:33.257226 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57acf7-2095-46a5-909b-d933d8364c5e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:33.258883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57acf7-2095-46a5-909b-d933d8364c5e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:33.269998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 458/918] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:33 2021] GET /identity/v3/services?type=image => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:33.272653 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5867b17-f6a3-43ff-8ce3-19395edb0dcf admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:33.282716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5867b17-f6a3-43ff-8ce3-19395edb0dcf admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:33.288793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f192fd8-766f-4605-850b-bca172628a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:33.289472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f192fd8-766f-4605-850b-bca172628a2f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:33.289759 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f192fd8-766f-4605-850b-bca172628a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:33.290039 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f192fd8-766f-4605-850b-bca172628a2f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:33.290879 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f192fd8-766f-4605-850b-bca172628a2f admin admin] RBAC: Adding query filter params (interface=public, service_id=c7d95919209e4199a6b0418567a1a5c3, region_id=RegionOne) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:33.291186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f192fd8-766f-4605-850b-bca172628a2f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:33.292799 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f192fd8-766f-4605-850b-bca172628a2f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:33.299634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 461/919] 10.222.0.50 () {56 vars in 1272 bytes} [Tue Nov 16 00:20:33 2021] GET /identity/v3/endpoints?service_id=c7d95919209e4199a6b0418567a1a5c3&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:33.306126 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57acf7-2095-46a5-909b-d933d8364c5e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:33.316906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57acf7-2095-46a5-909b-d933d8364c5e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:33.321644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b3d33-1477-4262-9956-3d37976e5fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:33.322322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b3d33-1477-4262-9956-3d37976e5fab admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:33.322611 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b3d33-1477-4262-9956-3d37976e5fab admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:33.323273 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b3d33-1477-4262-9956-3d37976e5fab admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:33.323969 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b3d33-1477-4262-9956-3d37976e5fab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:33.325586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b3d33-1477-4262-9956-3d37976e5fab admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:33.334035 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 459/920] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Nov 16 00:20:33 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:20:34.493996 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e6dbf-c3ae-49e3-b416-943e6f378fd2 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:34.494543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e6dbf-c3ae-49e3-b416-943e6f378fd2 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:34.494543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e6dbf-c3ae-49e3-b416-943e6f378fd2 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:34.496546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 462/921] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:34.503819 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e57609-8f09-4ad7-9360-6bb8fa2c512c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:34.504257 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e57609-8f09-4ad7-9360-6bb8fa2c512c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:34.504457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e57609-8f09-4ad7-9360-6bb8fa2c512c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:34.522776 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-d7e57609-8f09-4ad7-9360-6bb8fa2c512c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:34.524233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d7e57609-8f09-4ad7-9360-6bb8fa2c512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:34.532373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 460/922] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:34 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:34.557316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e6dbf-c3ae-49e3-b416-943e6f378fd2 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:34.570157 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e6dbf-c3ae-49e3-b416-943e6f378fd2 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:34.574563 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1744c7d-f8c3-4fc4-bb56-2f32410c2953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:34.575380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744c7d-f8c3-4fc4-bb56-2f32410c2953 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:34.575666 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744c7d-f8c3-4fc4-bb56-2f32410c2953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:34.575945 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744c7d-f8c3-4fc4-bb56-2f32410c2953 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:34.577120 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1744c7d-f8c3-4fc4-bb56-2f32410c2953 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:34.578805 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1744c7d-f8c3-4fc4-bb56-2f32410c2953 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:34.581244 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 463/923] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:34.587815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e57609-8f09-4ad7-9360-6bb8fa2c512c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:34.597693 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e57609-8f09-4ad7-9360-6bb8fa2c512c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:34.602253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac31fc2-fc82-4a96-ba70-9ecae3dd2c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:34.602940 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31fc2-fc82-4a96-ba70-9ecae3dd2c85 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:34.603230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31fc2-fc82-4a96-ba70-9ecae3dd2c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:34.603507 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31fc2-fc82-4a96-ba70-9ecae3dd2c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:34.604223 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac31fc2-fc82-4a96-ba70-9ecae3dd2c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:34.606119 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac31fc2-fc82-4a96-ba70-9ecae3dd2c85 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:34.638896 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 461/924] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Nov 16 00:20:34 2021] POST /identity/v3/projects => generated 311 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:20:35.493217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4acdc-34a0-4fe5-8ca4-0b6db3de346c None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.493615 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4acdc-34a0-4fe5-8ca4-0b6db3de346c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.493894 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4acdc-34a0-4fe5-8ca4-0b6db3de346c None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.495735 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 464/925] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:35.503816 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851fb8f-a18d-4621-8748-67600e4b4af3 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.504111 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851fb8f-a18d-4621-8748-67600e4b4af3 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.504592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851fb8f-a18d-4621-8748-67600e4b4af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.522618 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7851fb8f-a18d-4621-8748-67600e4b4af3 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:35.523843 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7851fb8f-a18d-4621-8748-67600e4b4af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:35.551707 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7efe96-46e2-4b74-8b4c-4ca92e11b1d7 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.552007 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7efe96-46e2-4b74-8b4c-4ca92e11b1d7 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.552288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7efe96-46e2-4b74-8b4c-4ca92e11b1d7 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.554217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 465/926] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:20:35.561187 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc7004-5cff-464e-89c5-4cf4020660ab None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.561426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc7004-5cff-464e-89c5-4cf4020660ab None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.561641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc7004-5cff-464e-89c5-4cf4020660ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.579840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-85dc7004-5cff-464e-89c5-4cf4020660ab None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:35.581517 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-85dc7004-5cff-464e-89c5-4cf4020660ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:35.582347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 462/927] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:35 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:35.589480 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 466/928] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:35 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:20:35.607554 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851fb8f-a18d-4621-8748-67600e4b4af3 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:35.613131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc7004-5cff-464e-89c5-4cf4020660ab None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:35.616963 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851fb8f-a18d-4621-8748-67600e4b4af3 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:35.621987 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc7004-5cff-464e-89c5-4cf4020660ab None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:35.622100 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c51fb-bd4c-4b2d-9deb-de3a71b31518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:35.622805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c51fb-bd4c-4b2d-9deb-de3a71b31518 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.623129 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c51fb-bd4c-4b2d-9deb-de3a71b31518 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.623450 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c51fb-bd4c-4b2d-9deb-de3a71b31518 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.627129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d20b0-6370-44fb-91e9-9b0253720056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:35.628017 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d20b0-6370-44fb-91e9-9b0253720056 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.628308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d20b0-6370-44fb-91e9-9b0253720056 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.628584 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d20b0-6370-44fb-91e9-9b0253720056 admin admin] PATH_INFO: `/v3/services/image` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.629245 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d20b0-6370-44fb-91e9-9b0253720056 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:35.630850 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d20b0-6370-44fb-91e9-9b0253720056 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:35.634584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c51fb-bd4c-4b2d-9deb-de3a71b31518 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:35.641242 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-9d5d20b0-6370-44fb-91e9-9b0253720056 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 16 00:20:35.641767 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-288c51fb-bd4c-4b2d-9deb-de3a71b31518 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 16 00:20:35.646923 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 467/929] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Nov 16 00:20:35 2021] GET /identity/v3/services/image => generated 86 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:35.647153 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 463/930] 10.222.0.50 () {56 vars in 1141 bytes} [Tue Nov 16 00:20:35 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:35.649859 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d20b0-6370-44fb-91e9-9b0253720056 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:35.650328 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c51fb-bd4c-4b2d-9deb-de3a71b31518 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:35.659942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d20b0-6370-44fb-91e9-9b0253720056 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:35.661037 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c51fb-bd4c-4b2d-9deb-de3a71b31518 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:35.664619 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8f79-c38d-4cbd-9aac-28771b9334ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:35.665275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8f79-c38d-4cbd-9aac-28771b9334ac admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.665563 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8f79-c38d-4cbd-9aac-28771b9334ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.665668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c68e9-3c47-4534-aca1-a80185ba3235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:35.665892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8f79-c38d-4cbd-9aac-28771b9334ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.666198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c68e9-3c47-4534-aca1-a80185ba3235 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.666482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c68e9-3c47-4534-aca1-a80185ba3235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.666637 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e8f79-c38d-4cbd-9aac-28771b9334ac admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:35.666802 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c68e9-3c47-4534-aca1-a80185ba3235 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.667004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e8f79-c38d-4cbd-9aac-28771b9334ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:35.667488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c68e9-3c47-4534-aca1-a80185ba3235 admin admin] RBAC: Adding query filter params (name=image) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:35.667800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c68e9-3c47-4534-aca1-a80185ba3235 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:35.668564 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e8f79-c38d-4cbd-9aac-28771b9334ac admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:35.669407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c68e9-3c47-4534-aca1-a80185ba3235 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:35.675115 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 464/931] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:35 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:35.681418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c68e9-3c47-4534-aca1-a80185ba3235 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:35.682201 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 468/932] 10.222.0.50 () {56 vars in 1136 bytes} [Tue Nov 16 00:20:35 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:35.688161 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8f79-c38d-4cbd-9aac-28771b9334ac admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:35.692092 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c68e9-3c47-4534-aca1-a80185ba3235 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:35.696738 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa75c55-5fd3-4db9-9b38-99e4c29bcc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:35.697393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa75c55-5fd3-4db9-9b38-99e4c29bcc41 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.697680 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa75c55-5fd3-4db9-9b38-99e4c29bcc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.697957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa75c55-5fd3-4db9-9b38-99e4c29bcc41 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.698656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa75c55-5fd3-4db9-9b38-99e4c29bcc41 admin admin] RBAC: Adding query filter params (type=image) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:35.699005 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa75c55-5fd3-4db9-9b38-99e4c29bcc41 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:35.699367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8f79-c38d-4cbd-9aac-28771b9334ac admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:35.700607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa75c55-5fd3-4db9-9b38-99e4c29bcc41 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:35.704329 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0556fb0-d91f-4e75-b084-4f5c4f6e01da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:35.705636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0556fb0-d91f-4e75-b084-4f5c4f6e01da admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.706236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0556fb0-d91f-4e75-b084-4f5c4f6e01da admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.706356 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 465/933] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:35 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:35.706430 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0556fb0-d91f-4e75-b084-4f5c4f6e01da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.712283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa75c55-5fd3-4db9-9b38-99e4c29bcc41 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:35.717183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0556fb0-d91f-4e75-b084-4f5c4f6e01da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:35.719068 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0556fb0-d91f-4e75-b084-4f5c4f6e01da admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:35.722620 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa75c55-5fd3-4db9-9b38-99e4c29bcc41 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:35.727248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b56ce2-59b6-4f43-bfe6-d91deb4055f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:35.727887 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b56ce2-59b6-4f43-bfe6-d91deb4055f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.728410 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b56ce2-59b6-4f43-bfe6-d91deb4055f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.728516 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b56ce2-59b6-4f43-bfe6-d91deb4055f9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.729180 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b56ce2-59b6-4f43-bfe6-d91deb4055f9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:35.730771 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b56ce2-59b6-4f43-bfe6-d91deb4055f9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:35.737210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-c0556fb0-d91f-4e75-b084-4f5c4f6e01da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:35.738964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 469/934] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:35.744910 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0556fb0-d91f-4e75-b084-4f5c4f6e01da admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:35.755801 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0556fb0-d91f-4e75-b084-4f5c4f6e01da admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:35.756350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 466/935] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Nov 16 00:20:35 2021] POST /identity/v3/endpoints => generated 327 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:20:35.772414 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1608a8-5b73-40ed-8a7c-1259db2645cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:35.773101 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1608a8-5b73-40ed-8a7c-1259db2645cb admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.773385 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1608a8-5b73-40ed-8a7c-1259db2645cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.773657 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1608a8-5b73-40ed-8a7c-1259db2645cb admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.774453 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1608a8-5b73-40ed-8a7c-1259db2645cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:35.774766 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1608a8-5b73-40ed-8a7c-1259db2645cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:35.776497 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1608a8-5b73-40ed-8a7c-1259db2645cb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:35.794908 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 470/936] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:35.797836 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b56ce2-59b6-4f43-bfe6-d91deb4055f9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:35.808728 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b56ce2-59b6-4f43-bfe6-d91deb4055f9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:35.814879 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa28af-2895-4b80-96bd-b3f751624eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:35.815749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa28af-2895-4b80-96bd-b3f751624eef admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.816093 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa28af-2895-4b80-96bd-b3f751624eef admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.816374 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa28af-2895-4b80-96bd-b3f751624eef admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.826610 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa28af-2895-4b80-96bd-b3f751624eef admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:35.828810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa28af-2895-4b80-96bd-b3f751624eef admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:35.844962 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-e3aa28af-2895-4b80-96bd-b3f751624eef admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 00:20:35.852958 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 467/937] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Nov 16 00:20:35 2021] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:20:35.854431 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1608a8-5b73-40ed-8a7c-1259db2645cb admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:35.865353 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1608a8-5b73-40ed-8a7c-1259db2645cb admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:35.870120 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af79fc-e769-4bd5-afa8-4fa5a23e91d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:35.870814 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af79fc-e769-4bd5-afa8-4fa5a23e91d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.871202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af79fc-e769-4bd5-afa8-4fa5a23e91d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.871491 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af79fc-e769-4bd5-afa8-4fa5a23e91d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.872348 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af79fc-e769-4bd5-afa8-4fa5a23e91d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:35.872665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af79fc-e769-4bd5-afa8-4fa5a23e91d2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:35.874547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af79fc-e769-4bd5-afa8-4fa5a23e91d2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:35.895037 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 471/938] 10.222.0.50 () {56 vars in 1154 bytes} [Tue Nov 16 00:20:35 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:35.901349 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa28af-2895-4b80-96bd-b3f751624eef admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:35.912461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa28af-2895-4b80-96bd-b3f751624eef admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:35.917136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb1316-a98c-473b-b41a-aa7f93b38ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:35.917794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb1316-a98c-473b-b41a-aa7f93b38ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.918084 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb1316-a98c-473b-b41a-aa7f93b38ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.918365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb1316-a98c-473b-b41a-aa7f93b38ee9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.932892 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb1316-a98c-473b-b41a-aa7f93b38ee9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:35.934736 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb1316-a98c-473b-b41a-aa7f93b38ee9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:35.945778 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 468/939] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:35 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:20:35.952156 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af79fc-e769-4bd5-afa8-4fa5a23e91d2 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:35.962808 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af79fc-e769-4bd5-afa8-4fa5a23e91d2 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:35.967864 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598a800-16c1-428e-9800-7b34fc7f07af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:35.968670 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598a800-16c1-428e-9800-7b34fc7f07af admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:35.969368 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598a800-16c1-428e-9800-7b34fc7f07af admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:35.969368 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598a800-16c1-428e-9800-7b34fc7f07af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:35.981076 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598a800-16c1-428e-9800-7b34fc7f07af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:35.983466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598a800-16c1-428e-9800-7b34fc7f07af admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:36.003986 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-5598a800-16c1-428e-9800-7b34fc7f07af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:36.006099 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 472/940] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:36.011751 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb1316-a98c-473b-b41a-aa7f93b38ee9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:36.020912 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb1316-a98c-473b-b41a-aa7f93b38ee9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:36.025579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf31e6c-4a50-4729-9ea0-ff914628eaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:36.026330 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf31e6c-4a50-4729-9ea0-ff914628eaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:36.026690 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf31e6c-4a50-4729-9ea0-ff914628eaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:36.027071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf31e6c-4a50-4729-9ea0-ff914628eaa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:36.027863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf31e6c-4a50-4729-9ea0-ff914628eaa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:36.028246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf31e6c-4a50-4729-9ea0-ff914628eaa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:36.029930 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf31e6c-4a50-4729-9ea0-ff914628eaa7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:36.042075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 469/941] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:36.047984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598a800-16c1-428e-9800-7b34fc7f07af admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:36.058526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598a800-16c1-428e-9800-7b34fc7f07af admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:36.063065 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f4897-ab1d-4479-aacb-c377052e9b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:36.063852 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f4897-ab1d-4479-aacb-c377052e9b3c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:36.064177 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f4897-ab1d-4479-aacb-c377052e9b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:36.064457 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f4897-ab1d-4479-aacb-c377052e9b3c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:36.071547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f4897-ab1d-4479-aacb-c377052e9b3c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:36.073497 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f4897-ab1d-4479-aacb-c377052e9b3c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:36.086284 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-a46f4897-ab1d-4479-aacb-c377052e9b3c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:36.087692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 473/942] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:36.094020 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf31e6c-4a50-4729-9ea0-ff914628eaa7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:36.105585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf31e6c-4a50-4729-9ea0-ff914628eaa7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:36.110412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0c0da-6f7a-4ecd-b712-b5497e7d3efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:36.111654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0c0da-6f7a-4ecd-b712-b5497e7d3efd admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:36.111654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0c0da-6f7a-4ecd-b712-b5497e7d3efd admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:36.112211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0c0da-6f7a-4ecd-b712-b5497e7d3efd admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:36.113082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0c0da-6f7a-4ecd-b712-b5497e7d3efd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:36.113416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0c0da-6f7a-4ecd-b712-b5497e7d3efd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:36.115590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0c0da-6f7a-4ecd-b712-b5497e7d3efd admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:36.130497 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 470/943] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:36.136975 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f4897-ab1d-4479-aacb-c377052e9b3c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:36.147370 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f4897-ab1d-4479-aacb-c377052e9b3c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:36.151912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68893d16-c6db-4d27-9f41-5d026475f5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:36.152555 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68893d16-c6db-4d27-9f41-5d026475f5fe admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:36.152839 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68893d16-c6db-4d27-9f41-5d026475f5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:36.153118 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68893d16-c6db-4d27-9f41-5d026475f5fe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:36.153944 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68893d16-c6db-4d27-9f41-5d026475f5fe admin admin] RBAC: Adding query filter params (role.id=fdd83e9cf60a40aabeb6a3a298f41e7e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=442cc0e13dcb49f0a4a870c06e0edf1d) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:36.154261 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68893d16-c6db-4d27-9f41-5d026475f5fe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:36.156152 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68893d16-c6db-4d27-9f41-5d026475f5fe admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:36.162653 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 474/944] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:36 2021] GET /identity/v3/role_assignments?user.id=442cc0e13dcb49f0a4a870c06e0edf1d&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=fdd83e9cf60a40aabeb6a3a298f41e7e => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:36.856330 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a50b24-b757-4f01-8954-1d1c08789dfa None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:36.856847 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a50b24-b757-4f01-8954-1d1c08789dfa None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:36.856945 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a50b24-b757-4f01-8954-1d1c08789dfa None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:36.858697 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 471/945] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:36.866981 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ea329-c1ba-4fc7-91b4-3899a621c5c5 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:36.867439 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ea329-c1ba-4fc7-91b4-3899a621c5c5 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:36.867622 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ea329-c1ba-4fc7-91b4-3899a621c5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:36.884571 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-769ea329-c1ba-4fc7-91b4-3899a621c5c5 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:36.885752 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-769ea329-c1ba-4fc7-91b4-3899a621c5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:36.893604 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 475/946] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:36.919495 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a50b24-b757-4f01-8954-1d1c08789dfa None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:36.934055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a50b24-b757-4f01-8954-1d1c08789dfa None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:36.938439 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5babe5-5861-4fb2-b7da-1cc239dc3e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:36.939293 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5babe5-5861-4fb2-b7da-1cc239dc3e47 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:36.939580 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5babe5-5861-4fb2-b7da-1cc239dc3e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:36.939865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5babe5-5861-4fb2-b7da-1cc239dc3e47 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:36.941038 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5babe5-5861-4fb2-b7da-1cc239dc3e47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:36.942827 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5babe5-5861-4fb2-b7da-1cc239dc3e47 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:36.952205 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 472/947] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:36 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:36.952351 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ea329-c1ba-4fc7-91b4-3899a621c5c5 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:36.960238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ea329-c1ba-4fc7-91b4-3899a621c5c5 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:36.964885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98cdb9-b78a-4a07-83d9-d936e99d06df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:36.965589 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98cdb9-b78a-4a07-83d9-d936e99d06df admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:36.965875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98cdb9-b78a-4a07-83d9-d936e99d06df admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:36.966885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98cdb9-b78a-4a07-83d9-d936e99d06df admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:36.967033 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98cdb9-b78a-4a07-83d9-d936e99d06df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:36.968932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98cdb9-b78a-4a07-83d9-d936e99d06df admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:36.992528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 476/948] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Nov 16 00:20:36 2021] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:20:37.996395 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1abf4-4682-4e8c-9fb4-200c444bcb28 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:37.996906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1abf4-4682-4e8c-9fb4-200c444bcb28 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:37.996983 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1abf4-4682-4e8c-9fb4-200c444bcb28 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:37.998769 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 473/949] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:38.007256 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a226db-72f1-46a4-a4c1-5e96a3ce284b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.007727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a226db-72f1-46a4-a4c1-5e96a3ce284b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.007802 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a226db-72f1-46a4-a4c1-5e96a3ce284b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.025119 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-46a226db-72f1-46a4-a4c1-5e96a3ce284b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:38.026299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-46a226db-72f1-46a4-a4c1-5e96a3ce284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:38.034213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 477/950] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:38.057607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1abf4-4682-4e8c-9fb4-200c444bcb28 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:38.070373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1abf4-4682-4e8c-9fb4-200c444bcb28 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:38.074792 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017156b-8b27-42f2-9f8e-07a579499984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:38.075457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017156b-8b27-42f2-9f8e-07a579499984 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.075746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017156b-8b27-42f2-9f8e-07a579499984 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.076025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017156b-8b27-42f2-9f8e-07a579499984 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.084142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017156b-8b27-42f2-9f8e-07a579499984 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:38.085906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017156b-8b27-42f2-9f8e-07a579499984 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:38.095024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 474/951] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:38 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:20:38.101617 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a226db-72f1-46a4-a4c1-5e96a3ce284b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:38.110561 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a226db-72f1-46a4-a4c1-5e96a3ce284b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:38.115763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54568fa8-a6d3-49b8-ac39-f5fe83a15e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:38.116559 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568fa8-a6d3-49b8-ac39-f5fe83a15e43 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.116850 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568fa8-a6d3-49b8-ac39-f5fe83a15e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.117125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568fa8-a6d3-49b8-ac39-f5fe83a15e43 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.118307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54568fa8-a6d3-49b8-ac39-f5fe83a15e43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:38.120050 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54568fa8-a6d3-49b8-ac39-f5fe83a15e43 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:38.121854 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 478/952] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:38 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:38.332610 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3a8d-6a2f-43d5-839c-fbd540276d06 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.333512 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3a8d-6a2f-43d5-839c-fbd540276d06 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.333905 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3a8d-6a2f-43d5-839c-fbd540276d06 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.336358 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 475/953] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:38.344265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fa4d1-403f-41d7-b24f-a4b9aa6732f7 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.344557 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fa4d1-403f-41d7-b24f-a4b9aa6732f7 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.344840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fa4d1-403f-41d7-b24f-a4b9aa6732f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.363231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-039fa4d1-403f-41d7-b24f-a4b9aa6732f7 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:38.364428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-039fa4d1-403f-41d7-b24f-a4b9aa6732f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:38.372667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 479/954] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:38.397123 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a3a8d-6a2f-43d5-839c-fbd540276d06 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:38.409488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a3a8d-6a2f-43d5-839c-fbd540276d06 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:38.413957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee25f1-b750-40df-b1eb-da9ed148dcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:38.414759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee25f1-b750-40df-b1eb-da9ed148dcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.415082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee25f1-b750-40df-b1eb-da9ed148dcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.415365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee25f1-b750-40df-b1eb-da9ed148dcd9 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.425689 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee25f1-b750-40df-b1eb-da9ed148dcd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:38.432927 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-72ee25f1-b750-40df-b1eb-da9ed148dcd9 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 16 00:20:38.434466 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 476/955] 10.222.0.50 () {56 vars in 1141 bytes} [Tue Nov 16 00:20:38 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:38.441303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fa4d1-403f-41d7-b24f-a4b9aa6732f7 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:38.450227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fa4d1-403f-41d7-b24f-a4b9aa6732f7 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:38.455289 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a7ea2-5598-4390-928a-4a770acc66fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:38.455948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a7ea2-5598-4390-928a-4a770acc66fe admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.456231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a7ea2-5598-4390-928a-4a770acc66fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.456509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a7ea2-5598-4390-928a-4a770acc66fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.457256 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a7ea2-5598-4390-928a-4a770acc66fe admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:38.457562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a7ea2-5598-4390-928a-4a770acc66fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:38.459169 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a7ea2-5598-4390-928a-4a770acc66fe admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:38.467023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 480/956] 10.222.0.50 () {56 vars in 1136 bytes} [Tue Nov 16 00:20:38 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:38.473578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee25f1-b750-40df-b1eb-da9ed148dcd9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:38.484260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee25f1-b750-40df-b1eb-da9ed148dcd9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:38.489356 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86296e33-bf9a-4289-b928-344e4ebaf317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:38.490124 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86296e33-bf9a-4289-b928-344e4ebaf317 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.490412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86296e33-bf9a-4289-b928-344e4ebaf317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.490698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86296e33-bf9a-4289-b928-344e4ebaf317 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.500588 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86296e33-bf9a-4289-b928-344e4ebaf317 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:38.503042 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86296e33-bf9a-4289-b928-344e4ebaf317 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:38.520060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-86296e33-bf9a-4289-b928-344e4ebaf317 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:38.521222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 477/957] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:38.527528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a7ea2-5598-4390-928a-4a770acc66fe admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:38.537493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a7ea2-5598-4390-928a-4a770acc66fe admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:38.541949 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d3dff-241a-4703-b29b-09382580cb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:38.542590 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d3dff-241a-4703-b29b-09382580cb66 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.542897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d3dff-241a-4703-b29b-09382580cb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.543176 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d3dff-241a-4703-b29b-09382580cb66 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.543886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d3dff-241a-4703-b29b-09382580cb66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:38.544188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d3dff-241a-4703-b29b-09382580cb66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:38.545752 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d3dff-241a-4703-b29b-09382580cb66 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:38.557494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 481/958] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:38.563558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86296e33-bf9a-4289-b928-344e4ebaf317 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:38.573512 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86296e33-bf9a-4289-b928-344e4ebaf317 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:38.578045 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e847a-da68-4a5d-96ab-29b4af2a86fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:38.578819 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e847a-da68-4a5d-96ab-29b4af2a86fe admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.579141 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e847a-da68-4a5d-96ab-29b4af2a86fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.579421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e847a-da68-4a5d-96ab-29b4af2a86fe admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.587395 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e847a-da68-4a5d-96ab-29b4af2a86fe admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:38.589346 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e847a-da68-4a5d-96ab-29b4af2a86fe admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:38.602999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-d42e847a-da68-4a5d-96ab-29b4af2a86fe admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 00:20:38.604122 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 478/959] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Nov 16 00:20:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:38.610194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d3dff-241a-4703-b29b-09382580cb66 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:38.620559 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d3dff-241a-4703-b29b-09382580cb66 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:38.625172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534c0f6-fa11-47d0-8c48-a3f3a05fd12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:38.625834 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534c0f6-fa11-47d0-8c48-a3f3a05fd12c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.626119 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534c0f6-fa11-47d0-8c48-a3f3a05fd12c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.626920 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534c0f6-fa11-47d0-8c48-a3f3a05fd12c admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.628028 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534c0f6-fa11-47d0-8c48-a3f3a05fd12c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:38.628349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534c0f6-fa11-47d0-8c48-a3f3a05fd12c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:38.630230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534c0f6-fa11-47d0-8c48-a3f3a05fd12c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:38.648369 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 482/960] 10.222.0.50 () {56 vars in 1154 bytes} [Tue Nov 16 00:20:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:38.654303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e847a-da68-4a5d-96ab-29b4af2a86fe admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:38.664480 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e847a-da68-4a5d-96ab-29b4af2a86fe admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:38.668961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce22da-3918-4e70-ac5b-65d6d4033e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:38.669734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce22da-3918-4e70-ac5b-65d6d4033e2e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.670018 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce22da-3918-4e70-ac5b-65d6d4033e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.670296 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce22da-3918-4e70-ac5b-65d6d4033e2e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.680957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce22da-3918-4e70-ac5b-65d6d4033e2e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:38.682810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce22da-3918-4e70-ac5b-65d6d4033e2e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:38.699001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-acce22da-3918-4e70-ac5b-65d6d4033e2e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:38.700142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 479/961] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:38.706944 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534c0f6-fa11-47d0-8c48-a3f3a05fd12c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:38.716413 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534c0f6-fa11-47d0-8c48-a3f3a05fd12c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:38.722250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22ceb7-fcbd-48f5-9ea5-a0f400dcc4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:38.722921 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22ceb7-fcbd-48f5-9ea5-a0f400dcc4cd admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.723206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22ceb7-fcbd-48f5-9ea5-a0f400dcc4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.723479 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22ceb7-fcbd-48f5-9ea5-a0f400dcc4cd admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.724220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22ceb7-fcbd-48f5-9ea5-a0f400dcc4cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:38.724527 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22ceb7-fcbd-48f5-9ea5-a0f400dcc4cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:38.726102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22ceb7-fcbd-48f5-9ea5-a0f400dcc4cd admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:38.737687 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 483/962] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:38.743890 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce22da-3918-4e70-ac5b-65d6d4033e2e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:38.753499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce22da-3918-4e70-ac5b-65d6d4033e2e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:38.758022 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bffd4e-7465-4b8f-82af-25ed153383a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:38.758799 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bffd4e-7465-4b8f-82af-25ed153383a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.759108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bffd4e-7465-4b8f-82af-25ed153383a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.759387 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bffd4e-7465-4b8f-82af-25ed153383a5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.766167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bffd4e-7465-4b8f-82af-25ed153383a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:38.768834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bffd4e-7465-4b8f-82af-25ed153383a5 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:38.781363 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-49bffd4e-7465-4b8f-82af-25ed153383a5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:38.782511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 480/963] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:38.789349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22ceb7-fcbd-48f5-9ea5-a0f400dcc4cd admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:38.799567 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22ceb7-fcbd-48f5-9ea5-a0f400dcc4cd admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:38.804174 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ab72a-7f13-4846-97b0-a4a8db221b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:38.804896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ab72a-7f13-4846-97b0-a4a8db221b6f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.805246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ab72a-7f13-4846-97b0-a4a8db221b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.805528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ab72a-7f13-4846-97b0-a4a8db221b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.806300 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ab72a-7f13-4846-97b0-a4a8db221b6f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:38.806608 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ab72a-7f13-4846-97b0-a4a8db221b6f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:38.808475 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ab72a-7f13-4846-97b0-a4a8db221b6f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:38.820688 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 484/964] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:38.827251 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bffd4e-7465-4b8f-82af-25ed153383a5 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:38.838289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bffd4e-7465-4b8f-82af-25ed153383a5 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:38.842746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be1ed0-4430-4488-afd4-12c46a13124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:38.843645 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be1ed0-4430-4488-afd4-12c46a13124f admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:38.843931 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be1ed0-4430-4488-afd4-12c46a13124f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:38.844213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be1ed0-4430-4488-afd4-12c46a13124f admin admin] PATH_INFO: `/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/442cc0e13dcb49f0a4a870c06e0edf1d/roles/fdd83e9cf60a40aabeb6a3a298f41e7e` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:38.847859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be1ed0-4430-4488-afd4-12c46a13124f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce43bc1cdb744a2b2c65dd4c50d6599, user_id=442cc0e13dcb49f0a4a870c06e0edf1d, role_id=fdd83e9cf60a40aabeb6a3a298f41e7e)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:38.850527 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be1ed0-4430-4488-afd4-12c46a13124f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:38.863775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 481/965] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:20:38 2021] PUT /identity/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/442cc0e13dcb49f0a4a870c06e0edf1d/roles/fdd83e9cf60a40aabeb6a3a298f41e7e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:20:39.229085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770f23e-3c76-42f6-8080-a204e83f95ec None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:39.229585 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770f23e-3c76-42f6-8080-a204e83f95ec None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:39.229585 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770f23e-3c76-42f6-8080-a204e83f95ec None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:39.231355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 485/966] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:39.238645 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74977b21-15b1-43db-b7e4-9d6d70d43270 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:39.239110 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74977b21-15b1-43db-b7e4-9d6d70d43270 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:39.239230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74977b21-15b1-43db-b7e4-9d6d70d43270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:39.257057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-74977b21-15b1-43db-b7e4-9d6d70d43270 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:39.258229 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-74977b21-15b1-43db-b7e4-9d6d70d43270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:39.311782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 482/967] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:39.336394 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770f23e-3c76-42f6-8080-a204e83f95ec None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:39.349158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770f23e-3c76-42f6-8080-a204e83f95ec None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:39.353466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5e916-d9e3-4842-874a-92d1746d69d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:39.354246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5e916-d9e3-4842-874a-92d1746d69d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:39.354540 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5e916-d9e3-4842-874a-92d1746d69d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:39.354790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5e916-d9e3-4842-874a-92d1746d69d7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:39.365565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5e916-d9e3-4842-874a-92d1746d69d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:39.372340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-7be5e916-d9e3-4842-874a-92d1746d69d7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:20:39.373507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 486/968] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:20:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:39.380899 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74977b21-15b1-43db-b7e4-9d6d70d43270 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:39.389626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74977b21-15b1-43db-b7e4-9d6d70d43270 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:39.397965 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9f9b6-2366-4f24-809d-f4d5dfe5d09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:39.398615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9f9b6-2366-4f24-809d-f4d5dfe5d09e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:39.398926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9f9b6-2366-4f24-809d-f4d5dfe5d09e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:39.399207 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9f9b6-2366-4f24-809d-f4d5dfe5d09e admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:39.399947 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9f9b6-2366-4f24-809d-f4d5dfe5d09e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:39.400255 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9f9b6-2366-4f24-809d-f4d5dfe5d09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:39.401860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9f9b6-2366-4f24-809d-f4d5dfe5d09e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:39.410462 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 483/969] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:20:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:39.416807 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5e916-d9e3-4842-874a-92d1746d69d7 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:39.428027 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5e916-d9e3-4842-874a-92d1746d69d7 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:39.432726 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9772206-b0d9-4cc6-b66a-cbe03f874f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:39.433575 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772206-b0d9-4cc6-b66a-cbe03f874f2b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:39.433860 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772206-b0d9-4cc6-b66a-cbe03f874f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:39.434135 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772206-b0d9-4cc6-b66a-cbe03f874f2b admin admin] PATH_INFO: `/v3/users/c874f064718e4994b8c09d46e3f6e91a` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:39.448100 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9772206-b0d9-4cc6-b66a-cbe03f874f2b admin admin] RBAC: Authorizing `identity:get_user(user_id=c874f064718e4994b8c09d46e3f6e91a)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:39.450231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9772206-b0d9-4cc6-b66a-cbe03f874f2b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:39.451912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 487/970] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:20:39 2021] GET /identity/v3/users/c874f064718e4994b8c09d46e3f6e91a => generated 285 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:39.458772 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9f9b6-2366-4f24-809d-f4d5dfe5d09e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:39.468246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9f9b6-2366-4f24-809d-f4d5dfe5d09e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:39.473527 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da598eb-4593-4eac-ace7-7883f4a89a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:39.474155 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da598eb-4593-4eac-ace7-7883f4a89a92 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:39.474439 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da598eb-4593-4eac-ace7-7883f4a89a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:39.474716 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da598eb-4593-4eac-ace7-7883f4a89a92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:39.482238 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da598eb-4593-4eac-ace7-7883f4a89a92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:39.483946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da598eb-4593-4eac-ace7-7883f4a89a92 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:39.493615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 484/971] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:39 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:20:39.499947 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9772206-b0d9-4cc6-b66a-cbe03f874f2b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:39.510083 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9772206-b0d9-4cc6-b66a-cbe03f874f2b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:39.514595 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9242582-2eb6-47f8-8f3a-dd5662080707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:39.515464 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9242582-2eb6-47f8-8f3a-dd5662080707 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:39.515746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9242582-2eb6-47f8-8f3a-dd5662080707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:39.516022 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9242582-2eb6-47f8-8f3a-dd5662080707 admin admin] PATH_INFO: `/v3/projects/7ee20201e21947beb712da1e7df970d8` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:39.517274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9242582-2eb6-47f8-8f3a-dd5662080707 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ee20201e21947beb712da1e7df970d8)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:39.519341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9242582-2eb6-47f8-8f3a-dd5662080707 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:39.521009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 488/972] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:20:39 2021] GET /identity/v3/projects/7ee20201e21947beb712da1e7df970d8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:39.528083 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da598eb-4593-4eac-ace7-7883f4a89a92 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:39.537532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da598eb-4593-4eac-ace7-7883f4a89a92 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:39.542056 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f795a-07d2-4254-8ccb-5c0d19c37c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:39.542684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f795a-07d2-4254-8ccb-5c0d19c37c62 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:39.543001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f795a-07d2-4254-8ccb-5c0d19c37c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:39.543277 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f795a-07d2-4254-8ccb-5c0d19c37c62 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:39.544097 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f795a-07d2-4254-8ccb-5c0d19c37c62 admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=7ee20201e21947beb712da1e7df970d8, user.id=c874f064718e4994b8c09d46e3f6e91a) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:39.544407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f795a-07d2-4254-8ccb-5c0d19c37c62 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:39.546233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f795a-07d2-4254-8ccb-5c0d19c37c62 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:39.552834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 485/973] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:39 2021] GET /identity/v3/role_assignments?user.id=c874f064718e4994b8c09d46e3f6e91a&scope.project.id=7ee20201e21947beb712da1e7df970d8&role.id=2813231cc8954b998440e4bf5ede2945 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:41.025613 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc02489-2cbc-4533-ae38-590b70b9092c None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.026156 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc02489-2cbc-4533-ae38-590b70b9092c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.026156 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc02489-2cbc-4533-ae38-590b70b9092c None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.027971 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 489/974] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:41.035205 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcc15b-17c8-434a-a1da-cf5c5c393b6f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.035711 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcc15b-17c8-434a-a1da-cf5c5c393b6f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.035816 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcc15b-17c8-434a-a1da-cf5c5c393b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.053800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-ecfcc15b-17c8-434a-a1da-cf5c5c393b6f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:41.055056 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ecfcc15b-17c8-434a-a1da-cf5c5c393b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:41.062756 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 486/975] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:41.087863 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc02489-2cbc-4533-ae38-590b70b9092c None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.100146 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc02489-2cbc-4533-ae38-590b70b9092c None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.104498 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d6d2c-a593-43f3-b06f-eb662e865f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.105291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d6d2c-a593-43f3-b06f-eb662e865f73 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.105576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d6d2c-a593-43f3-b06f-eb662e865f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.105851 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d6d2c-a593-43f3-b06f-eb662e865f73 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.116522 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d6d2c-a593-43f3-b06f-eb662e865f73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:41.123644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-381d6d2c-a593-43f3-b06f-eb662e865f73 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 16 00:20:41.124817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 490/976] 10.222.0.50 () {56 vars in 1141 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:41.132034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcc15b-17c8-434a-a1da-cf5c5c393b6f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.141034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcc15b-17c8-434a-a1da-cf5c5c393b6f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.145601 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d7a99-f692-41f0-a22c-73ebad095274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.146265 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7a99-f692-41f0-a22c-73ebad095274 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.146554 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7a99-f692-41f0-a22c-73ebad095274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.146851 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d7a99-f692-41f0-a22c-73ebad095274 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.147605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d7a99-f692-41f0-a22c-73ebad095274 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:41.147917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d7a99-f692-41f0-a22c-73ebad095274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.149512 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d7a99-f692-41f0-a22c-73ebad095274 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.157480 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 487/977] 10.222.0.50 () {56 vars in 1136 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:41.163772 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d6d2c-a593-43f3-b06f-eb662e865f73 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.174536 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d6d2c-a593-43f3-b06f-eb662e865f73 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.179132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8bd0e-ebb0-4778-aa63-7b52badedcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.179850 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8bd0e-ebb0-4778-aa63-7b52badedcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.180131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8bd0e-ebb0-4778-aa63-7b52badedcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.180403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8bd0e-ebb0-4778-aa63-7b52badedcf7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.190918 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8bd0e-ebb0-4778-aa63-7b52badedcf7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.192751 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8bd0e-ebb0-4778-aa63-7b52badedcf7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.208834 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-fdd8bd0e-ebb0-4778-aa63-7b52badedcf7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:41.209991 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 491/978] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:41.216484 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d7a99-f692-41f0-a22c-73ebad095274 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.226447 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d7a99-f692-41f0-a22c-73ebad095274 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.231032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029110ad-65a9-484c-8f5c-0ecf3d9c7fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.231693 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029110ad-65a9-484c-8f5c-0ecf3d9c7fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.231983 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029110ad-65a9-484c-8f5c-0ecf3d9c7fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.232267 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029110ad-65a9-484c-8f5c-0ecf3d9c7fb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.232993 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029110ad-65a9-484c-8f5c-0ecf3d9c7fb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:41.233307 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029110ad-65a9-484c-8f5c-0ecf3d9c7fb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.234931 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029110ad-65a9-484c-8f5c-0ecf3d9c7fb5 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.247108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 488/979] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:41.253840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8bd0e-ebb0-4778-aa63-7b52badedcf7 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.263403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8bd0e-ebb0-4778-aa63-7b52badedcf7 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.267931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f442a18-1862-4a1c-baad-fb42c54b45e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.268706 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f442a18-1862-4a1c-baad-fb42c54b45e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.268992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f442a18-1862-4a1c-baad-fb42c54b45e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.269271 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f442a18-1862-4a1c-baad-fb42c54b45e8 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.276430 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f442a18-1862-4a1c-baad-fb42c54b45e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.278445 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f442a18-1862-4a1c-baad-fb42c54b45e8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.292549 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-3f442a18-1862-4a1c-baad-fb42c54b45e8 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 00:20:41.293705 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 492/980] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:41.300699 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029110ad-65a9-484c-8f5c-0ecf3d9c7fb5 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.310475 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029110ad-65a9-484c-8f5c-0ecf3d9c7fb5 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.315708 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c55923-34dd-49a8-a360-de00e68e2fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.316370 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c55923-34dd-49a8-a360-de00e68e2fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.316661 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c55923-34dd-49a8-a360-de00e68e2fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.316945 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c55923-34dd-49a8-a360-de00e68e2fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.317782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c55923-34dd-49a8-a360-de00e68e2fd1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:41.318099 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c55923-34dd-49a8-a360-de00e68e2fd1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.320007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c55923-34dd-49a8-a360-de00e68e2fd1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.337811 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 489/981] 10.222.0.50 () {56 vars in 1154 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:41.344048 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f442a18-1862-4a1c-baad-fb42c54b45e8 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.353973 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f442a18-1862-4a1c-baad-fb42c54b45e8 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.358437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660dae4-4f6e-478b-96be-b67a070ffb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.359106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660dae4-4f6e-478b-96be-b67a070ffb89 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.359391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660dae4-4f6e-478b-96be-b67a070ffb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.359669 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660dae4-4f6e-478b-96be-b67a070ffb89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.367425 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660dae4-4f6e-478b-96be-b67a070ffb89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.369175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660dae4-4f6e-478b-96be-b67a070ffb89 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.378403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 493/982] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:20:41.384815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c55923-34dd-49a8-a360-de00e68e2fd1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.395076 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c55923-34dd-49a8-a360-de00e68e2fd1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.399711 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc2620-f5be-4028-8d34-229b3f883822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.400497 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc2620-f5be-4028-8d34-229b3f883822 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.400788 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc2620-f5be-4028-8d34-229b3f883822 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.401071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc2620-f5be-4028-8d34-229b3f883822 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.411101 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc2620-f5be-4028-8d34-229b3f883822 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.412951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc2620-f5be-4028-8d34-229b3f883822 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.433362 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-82fc2620-f5be-4028-8d34-229b3f883822 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:20:41.434606 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 490/983] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:41.442323 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660dae4-4f6e-478b-96be-b67a070ffb89 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.451186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660dae4-4f6e-478b-96be-b67a070ffb89 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.456759 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb34db-fad7-48b3-a034-de0aa63a2b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.457407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb34db-fad7-48b3-a034-de0aa63a2b95 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.457686 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb34db-fad7-48b3-a034-de0aa63a2b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.457959 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb34db-fad7-48b3-a034-de0aa63a2b95 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.458670 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb34db-fad7-48b3-a034-de0aa63a2b95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:41.459015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb34db-fad7-48b3-a034-de0aa63a2b95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.460592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb34db-fad7-48b3-a034-de0aa63a2b95 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.472302 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 494/984] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:41.478606 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc2620-f5be-4028-8d34-229b3f883822 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.489073 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc2620-f5be-4028-8d34-229b3f883822 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.493651 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc2aaa-7d3e-4dca-8241-736153227534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.494433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc2aaa-7d3e-4dca-8241-736153227534 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.494725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc2aaa-7d3e-4dca-8241-736153227534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.495040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc2aaa-7d3e-4dca-8241-736153227534 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.502449 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc2aaa-7d3e-4dca-8241-736153227534 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.504464 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc2aaa-7d3e-4dca-8241-736153227534 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.517764 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-84fc2aaa-7d3e-4dca-8241-736153227534 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:20:41.518862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 491/985] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:41.525151 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb34db-fad7-48b3-a034-de0aa63a2b95 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.534774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb34db-fad7-48b3-a034-de0aa63a2b95 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.539327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241639c-a677-4e3b-82fd-a508b44633f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.539975 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241639c-a677-4e3b-82fd-a508b44633f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.540262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241639c-a677-4e3b-82fd-a508b44633f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.540542 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241639c-a677-4e3b-82fd-a508b44633f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.541327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241639c-a677-4e3b-82fd-a508b44633f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:41.541639 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241639c-a677-4e3b-82fd-a508b44633f4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.543535 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241639c-a677-4e3b-82fd-a508b44633f4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.555612 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 495/986] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:20:41.562089 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc2aaa-7d3e-4dca-8241-736153227534 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.572816 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc2aaa-7d3e-4dca-8241-736153227534 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.577300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105d4ce-abfd-442b-9a67-c32f862f7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.577927 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d4ce-abfd-442b-9a67-c32f862f7eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.578215 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d4ce-abfd-442b-9a67-c32f862f7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.578494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d4ce-abfd-442b-9a67-c32f862f7eb7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.579350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105d4ce-abfd-442b-9a67-c32f862f7eb7 admin admin] RBAC: Adding query filter params (role.id=fdd83e9cf60a40aabeb6a3a298f41e7e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=442cc0e13dcb49f0a4a870c06e0edf1d) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:41.580228 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105d4ce-abfd-442b-9a67-c32f862f7eb7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.582084 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105d4ce-abfd-442b-9a67-c32f862f7eb7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.589161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 492/987] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/role_assignments?user.id=442cc0e13dcb49f0a4a870c06e0edf1d&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=fdd83e9cf60a40aabeb6a3a298f41e7e => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:41.723615 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d9f19-170d-4da6-98bb-514fb91b82e7 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.723831 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d9f19-170d-4da6-98bb-514fb91b82e7 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.724112 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d9f19-170d-4da6-98bb-514fb91b82e7 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.725891 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 496/988] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:41.733861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d9b74-6d90-46b5-9349-bf1664ef4501 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.734157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d9b74-6d90-46b5-9349-bf1664ef4501 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.734437 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d9b74-6d90-46b5-9349-bf1664ef4501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.754650 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7f4d9b74-6d90-46b5-9349-bf1664ef4501 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:41.755907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7f4d9b74-6d90-46b5-9349-bf1664ef4501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:41.763823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 493/989] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:41.787505 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d9f19-170d-4da6-98bb-514fb91b82e7 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.800523 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d9f19-170d-4da6-98bb-514fb91b82e7 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.804883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8e968-fcf6-4588-ba84-18b5e240ca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.805667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8e968-fcf6-4588-ba84-18b5e240ca95 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.805949 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8e968-fcf6-4588-ba84-18b5e240ca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.806225 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8e968-fcf6-4588-ba84-18b5e240ca95 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.817214 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8e968-fcf6-4588-ba84-18b5e240ca95 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:41.823833 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-1fa8e968-fcf6-4588-ba84-18b5e240ca95 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:20:41.825005 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 497/990] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:41.832281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d9b74-6d90-46b5-9349-bf1664ef4501 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.841473 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d9b74-6d90-46b5-9349-bf1664ef4501 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.846110 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc99988-21ce-4757-b98e-1afe9ba35583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.846764 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc99988-21ce-4757-b98e-1afe9ba35583 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.847386 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc99988-21ce-4757-b98e-1afe9ba35583 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.847661 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc99988-21ce-4757-b98e-1afe9ba35583 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.848402 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc99988-21ce-4757-b98e-1afe9ba35583 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:41.850807 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc99988-21ce-4757-b98e-1afe9ba35583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.852403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc99988-21ce-4757-b98e-1afe9ba35583 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.861411 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 494/991] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:41.868892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8e968-fcf6-4588-ba84-18b5e240ca95 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.880800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8e968-fcf6-4588-ba84-18b5e240ca95 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.885400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b70e9d-1ee1-4da8-8f36-07de14c938c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.886253 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b70e9d-1ee1-4da8-8f36-07de14c938c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.886538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b70e9d-1ee1-4da8-8f36-07de14c938c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.886815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b70e9d-1ee1-4da8-8f36-07de14c938c5 admin admin] PATH_INFO: `/v3/users/c874f064718e4994b8c09d46e3f6e91a` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.888097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b70e9d-1ee1-4da8-8f36-07de14c938c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=c874f064718e4994b8c09d46e3f6e91a)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.890230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b70e9d-1ee1-4da8-8f36-07de14c938c5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.891869 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 498/992] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/users/c874f064718e4994b8c09d46e3f6e91a => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:41.898466 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc99988-21ce-4757-b98e-1afe9ba35583 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.908580 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc99988-21ce-4757-b98e-1afe9ba35583 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.913215 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07a584-a990-43bf-8f8a-b273da1e321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.914060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07a584-a990-43bf-8f8a-b273da1e321e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.914345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07a584-a990-43bf-8f8a-b273da1e321e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.914621 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07a584-a990-43bf-8f8a-b273da1e321e admin admin] PATH_INFO: `/v3/projects/7ee20201e21947beb712da1e7df970d8` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.915836 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07a584-a990-43bf-8f8a-b273da1e321e admin admin] RBAC: Authorizing `identity:get_project(project_id=7ee20201e21947beb712da1e7df970d8)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.917883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07a584-a990-43bf-8f8a-b273da1e321e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.919605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 495/993] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:20:41 2021] GET /identity/v3/projects/7ee20201e21947beb712da1e7df970d8 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:41.929510 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b70e9d-1ee1-4da8-8f36-07de14c938c5 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:41.940850 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b70e9d-1ee1-4da8-8f36-07de14c938c5 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:41.945599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00493189-16fc-4b22-ab7e-3054115619b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:41.946490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00493189-16fc-4b22-ab7e-3054115619b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:41.946782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00493189-16fc-4b22-ab7e-3054115619b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:41.947091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00493189-16fc-4b22-ab7e-3054115619b3 admin admin] PATH_INFO: `/v3/projects/7ee20201e21947beb712da1e7df970d8/users/c874f064718e4994b8c09d46e3f6e91a/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:41.949092 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00493189-16fc-4b22-ab7e-3054115619b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee20201e21947beb712da1e7df970d8, user_id=c874f064718e4994b8c09d46e3f6e91a, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:41.951771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00493189-16fc-4b22-ab7e-3054115619b3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:41.965698 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 499/994] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:20:41 2021] PUT /identity/v3/projects/7ee20201e21947beb712da1e7df970d8/users/c874f064718e4994b8c09d46e3f6e91a/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:20:44.088976 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb4f09-9a86-4b3e-afce-f3377e99776a None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:44.089500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb4f09-9a86-4b3e-afce-f3377e99776a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:44.089614 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb4f09-9a86-4b3e-afce-f3377e99776a None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:44.091368 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 496/995] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:44.100127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8e59c-bd36-460c-bc21-9fd13bd9f789 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:44.100539 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8e59c-bd36-460c-bc21-9fd13bd9f789 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:44.100674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8e59c-bd36-460c-bc21-9fd13bd9f789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:44.117722 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-78a8e59c-bd36-460c-bc21-9fd13bd9f789 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:44.118911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-78a8e59c-bd36-460c-bc21-9fd13bd9f789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:44.173514 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 500/996] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:44 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:44.197302 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb4f09-9a86-4b3e-afce-f3377e99776a None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:44.209859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb4f09-9a86-4b3e-afce-f3377e99776a None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:44.214271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8387899-7e1f-4bed-b1c5-9a745d2ae205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:44.215073 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8387899-7e1f-4bed-b1c5-9a745d2ae205 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:44.215363 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8387899-7e1f-4bed-b1c5-9a745d2ae205 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:44.215641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8387899-7e1f-4bed-b1c5-9a745d2ae205 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:44.226548 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8387899-7e1f-4bed-b1c5-9a745d2ae205 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:20:44.233282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-e8387899-7e1f-4bed-b1c5-9a745d2ae205 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:20:44.234404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 497/997] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:20:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:20:44.240570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8e59c-bd36-460c-bc21-9fd13bd9f789 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:44.249055 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8e59c-bd36-460c-bc21-9fd13bd9f789 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:44.256878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b619c-c138-4f6d-9fc2-2a42f19c7a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:44.256878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b619c-c138-4f6d-9fc2-2a42f19c7a7a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:44.256878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b619c-c138-4f6d-9fc2-2a42f19c7a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:44.256878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b619c-c138-4f6d-9fc2-2a42f19c7a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:44.257227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b619c-c138-4f6d-9fc2-2a42f19c7a7a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:44.257227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b619c-c138-4f6d-9fc2-2a42f19c7a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:44.257981 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b619c-c138-4f6d-9fc2-2a42f19c7a7a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:44.268063 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 501/998] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:20:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:44.274877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8387899-7e1f-4bed-b1c5-9a745d2ae205 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:44.286368 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8387899-7e1f-4bed-b1c5-9a745d2ae205 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:44.290958 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21822f67-50fc-47c6-8fee-1c5edbefc47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:44.291806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21822f67-50fc-47c6-8fee-1c5edbefc47f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:44.292090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21822f67-50fc-47c6-8fee-1c5edbefc47f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:44.292364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21822f67-50fc-47c6-8fee-1c5edbefc47f admin admin] PATH_INFO: `/v3/users/c874f064718e4994b8c09d46e3f6e91a` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:44.293557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21822f67-50fc-47c6-8fee-1c5edbefc47f admin admin] RBAC: Authorizing `identity:get_user(user_id=c874f064718e4994b8c09d46e3f6e91a)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:44.295737 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21822f67-50fc-47c6-8fee-1c5edbefc47f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:44.297318 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 498/999] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:20:44 2021] GET /identity/v3/users/c874f064718e4994b8c09d46e3f6e91a => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:44.303731 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b619c-c138-4f6d-9fc2-2a42f19c7a7a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:44.313180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b619c-c138-4f6d-9fc2-2a42f19c7a7a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:44.318516 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757a394-07ea-4856-af97-5d71359314b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:44.319183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757a394-07ea-4856-af97-5d71359314b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:44.319466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757a394-07ea-4856-af97-5d71359314b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:44.319743 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757a394-07ea-4856-af97-5d71359314b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:44.327233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757a394-07ea-4856-af97-5d71359314b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:44.328956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757a394-07ea-4856-af97-5d71359314b9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:44.338349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 502/1000] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:44 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:20:44.344421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21822f67-50fc-47c6-8fee-1c5edbefc47f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:44.354370 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21822f67-50fc-47c6-8fee-1c5edbefc47f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:44.358899 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b8dd8-6d65-4e13-9d20-10adbe0cc8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:44.359716 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b8dd8-6d65-4e13-9d20-10adbe0cc8ce admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:44.359998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b8dd8-6d65-4e13-9d20-10adbe0cc8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:44.360274 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b8dd8-6d65-4e13-9d20-10adbe0cc8ce admin admin] PATH_INFO: `/v3/projects/7ee20201e21947beb712da1e7df970d8` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:44.361867 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b8dd8-6d65-4e13-9d20-10adbe0cc8ce admin admin] RBAC: Authorizing `identity:get_project(project_id=7ee20201e21947beb712da1e7df970d8)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:44.363900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b8dd8-6d65-4e13-9d20-10adbe0cc8ce admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:44.365506 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 499/1001] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:20:44 2021] GET /identity/v3/projects/7ee20201e21947beb712da1e7df970d8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:44.371684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757a394-07ea-4856-af97-5d71359314b9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:44.380699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757a394-07ea-4856-af97-5d71359314b9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:44.385194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44131a3-f764-41c1-a686-b48efaadc2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:44.385806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44131a3-f764-41c1-a686-b48efaadc2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:44.386091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44131a3-f764-41c1-a686-b48efaadc2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:44.386367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44131a3-f764-41c1-a686-b48efaadc2d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:44.387216 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44131a3-f764-41c1-a686-b48efaadc2d1 admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=7ee20201e21947beb712da1e7df970d8, user.id=c874f064718e4994b8c09d46e3f6e91a) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:44.387529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44131a3-f764-41c1-a686-b48efaadc2d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:44.389318 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44131a3-f764-41c1-a686-b48efaadc2d1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:44.395571 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 503/1002] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:44 2021] GET /identity/v3/role_assignments?user.id=c874f064718e4994b8c09d46e3f6e91a&scope.project.id=7ee20201e21947beb712da1e7df970d8&role.id=2813231cc8954b998440e4bf5ede2945 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:46.618237 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57040bce-2329-4351-accd-2a27cf7bc8a1 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:46.618782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57040bce-2329-4351-accd-2a27cf7bc8a1 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:46.618782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57040bce-2329-4351-accd-2a27cf7bc8a1 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:46.620649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 500/1003] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:46.629111 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0779b5-949b-4f95-8741-0dfd0c25abda None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:46.629618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0779b5-949b-4f95-8741-0dfd0c25abda None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:46.629709 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0779b5-949b-4f95-8741-0dfd0c25abda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:46.654704 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-7b0779b5-949b-4f95-8741-0dfd0c25abda None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:46.655924 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7b0779b5-949b-4f95-8741-0dfd0c25abda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:46.663905 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 504/1004] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:46.689565 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57040bce-2329-4351-accd-2a27cf7bc8a1 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:46.701926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57040bce-2329-4351-accd-2a27cf7bc8a1 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:46.706985 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351540de-0675-4abd-b6fb-e29e174792d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:46.707768 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351540de-0675-4abd-b6fb-e29e174792d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:46.708056 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351540de-0675-4abd-b6fb-e29e174792d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:46.708338 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351540de-0675-4abd-b6fb-e29e174792d5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:46.709515 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351540de-0675-4abd-b6fb-e29e174792d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:46.711238 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351540de-0675-4abd-b6fb-e29e174792d5 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:46.712806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 501/1005] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:46.718650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0779b5-949b-4f95-8741-0dfd0c25abda None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:46.727717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0779b5-949b-4f95-8741-0dfd0c25abda None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:46.732202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe6a11-4bc2-4298-a1df-4754ae457a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:46.732849 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe6a11-4bc2-4298-a1df-4754ae457a09 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:46.733134 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe6a11-4bc2-4298-a1df-4754ae457a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:46.733411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe6a11-4bc2-4298-a1df-4754ae457a09 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:46.734110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe6a11-4bc2-4298-a1df-4754ae457a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:46.736284 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe6a11-4bc2-4298-a1df-4754ae457a09 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:46.756192 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 505/1006] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Nov 16 00:20:46 2021] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:20:48.969125 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7bf3f-b184-4ed2-89b8-22180aa01f6e None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:48.969583 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7bf3f-b184-4ed2-89b8-22180aa01f6e None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:48.969698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7bf3f-b184-4ed2-89b8-22180aa01f6e None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:48.972271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 502/1007] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:48.979610 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6698a-a9ce-4461-a2a7-4388935136f1 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:48.980010 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6698a-a9ce-4461-a2a7-4388935136f1 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:48.980173 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6698a-a9ce-4461-a2a7-4388935136f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:49.001712 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-6dc6698a-a9ce-4461-a2a7-4388935136f1 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:49.002714 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6dc6698a-a9ce-4461-a2a7-4388935136f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:49.010655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 506/1008] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:49.035886 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7bf3f-b184-4ed2-89b8-22180aa01f6e None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:49.048687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7bf3f-b184-4ed2-89b8-22180aa01f6e None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:49.053118 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8837c22-ac41-4d80-b1dc-af535c0b7e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:49.053952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8837c22-ac41-4d80-b1dc-af535c0b7e96 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:49.054262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8837c22-ac41-4d80-b1dc-af535c0b7e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:49.054543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8837c22-ac41-4d80-b1dc-af535c0b7e96 admin admin] PATH_INFO: `/v3/roles/5f5b315594d34a0da8fd0e1cc476318e` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:49.056048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8837c22-ac41-4d80-b1dc-af535c0b7e96 admin admin] RBAC: Authorizing `identity:get_role(role_id=5f5b315594d34a0da8fd0e1cc476318e)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:49.057067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-a8837c22-ac41-4d80-b1dc-af535c0b7e96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:20:49.057067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:20:49.057067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:20:49.057950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8837c22-ac41-4d80-b1dc-af535c0b7e96 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:49.059307 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 503/1009] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:20:49 2021] GET /identity/v3/roles/5f5b315594d34a0da8fd0e1cc476318e => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:49.065868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6698a-a9ce-4461-a2a7-4388935136f1 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:49.074672 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6698a-a9ce-4461-a2a7-4388935136f1 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:49.079154 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aed8c9-f683-4fd8-a1c5-97e11f626bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:49.080010 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed8c9-f683-4fd8-a1c5-97e11f626bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:49.080296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed8c9-f683-4fd8-a1c5-97e11f626bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:49.080578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed8c9-f683-4fd8-a1c5-97e11f626bd1 admin admin] PATH_INFO: `/v3/users/ce9cac1643b14f3298cffb6dcc550925` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:49.093451 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aed8c9-f683-4fd8-a1c5-97e11f626bd1 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce9cac1643b14f3298cffb6dcc550925)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:49.096402 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aed8c9-f683-4fd8-a1c5-97e11f626bd1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:49.098255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 507/1010] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:20:49 2021] GET /identity/v3/users/ce9cac1643b14f3298cffb6dcc550925 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:49.104355 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8837c22-ac41-4d80-b1dc-af535c0b7e96 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:49.114331 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8837c22-ac41-4d80-b1dc-af535c0b7e96 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:49.118826 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cd495-0b36-4b82-818f-78fcaff3b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:49.119476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cd495-0b36-4b82-818f-78fcaff3b1fd admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:49.119765 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cd495-0b36-4b82-818f-78fcaff3b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:49.120047 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cd495-0b36-4b82-818f-78fcaff3b1fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:49.127846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cd495-0b36-4b82-818f-78fcaff3b1fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:49.129573 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cd495-0b36-4b82-818f-78fcaff3b1fd admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:49.138226 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 504/1011] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:49 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:20:49.144338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aed8c9-f683-4fd8-a1c5-97e11f626bd1 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:49.153509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aed8c9-f683-4fd8-a1c5-97e11f626bd1 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:49.159064 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9f5cb-2add-49a4-b0b2-9918adc969c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:49.159892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9f5cb-2add-49a4-b0b2-9918adc969c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:49.160176 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9f5cb-2add-49a4-b0b2-9918adc969c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:49.160452 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9f5cb-2add-49a4-b0b2-9918adc969c7 admin admin] PATH_INFO: `/v3/projects/7ee20201e21947beb712da1e7df970d8` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:49.161635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9f5cb-2add-49a4-b0b2-9918adc969c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ee20201e21947beb712da1e7df970d8)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:49.163678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9f5cb-2add-49a4-b0b2-9918adc969c7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:49.165294 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 508/1012] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:20:49 2021] GET /identity/v3/projects/7ee20201e21947beb712da1e7df970d8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:49.171410 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cd495-0b36-4b82-818f-78fcaff3b1fd admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:49.181383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cd495-0b36-4b82-818f-78fcaff3b1fd admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:49.185847 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b83f-ab2e-4d8a-b932-774879b64d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:49.186472 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b83f-ab2e-4d8a-b932-774879b64d50 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:49.186758 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b83f-ab2e-4d8a-b932-774879b64d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:49.187069 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b83f-ab2e-4d8a-b932-774879b64d50 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:49.187885 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b83f-ab2e-4d8a-b932-774879b64d50 admin admin] RBAC: Adding query filter params (role.id=5f5b315594d34a0da8fd0e1cc476318e, scope.project.id=7ee20201e21947beb712da1e7df970d8, user.id=ce9cac1643b14f3298cffb6dcc550925) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:49.188200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b83f-ab2e-4d8a-b932-774879b64d50 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:49.190066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b83f-ab2e-4d8a-b932-774879b64d50 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:49.195181 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 505/1013] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:49 2021] GET /identity/v3/role_assignments?user.id=ce9cac1643b14f3298cffb6dcc550925&scope.project.id=7ee20201e21947beb712da1e7df970d8&role.id=5f5b315594d34a0da8fd0e1cc476318e => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:51.329948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15d301-c567-42cd-adb5-f44027a57617 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:51.330507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15d301-c567-42cd-adb5-f44027a57617 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:51.330507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15d301-c567-42cd-adb5-f44027a57617 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:51.332309 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 509/1014] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:51.339408 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416e5a7-249c-4cca-a176-915a9d05d313 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:51.339835 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416e5a7-249c-4cca-a176-915a9d05d313 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:51.339977 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416e5a7-249c-4cca-a176-915a9d05d313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:51.358078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7416e5a7-249c-4cca-a176-915a9d05d313 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:51.359292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7416e5a7-249c-4cca-a176-915a9d05d313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:51.367698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 506/1015] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:51 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:51.390846 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15d301-c567-42cd-adb5-f44027a57617 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:51.402767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15d301-c567-42cd-adb5-f44027a57617 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:51.407740 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d1966-5821-4746-94b5-e3ef294b1fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:51.408711 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d1966-5821-4746-94b5-e3ef294b1fbc admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:51.409004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d1966-5821-4746-94b5-e3ef294b1fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:51.409285 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d1966-5821-4746-94b5-e3ef294b1fbc admin admin] PATH_INFO: `/v3/roles/5f5b315594d34a0da8fd0e1cc476318e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:51.410764 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d1966-5821-4746-94b5-e3ef294b1fbc admin admin] RBAC: Authorizing `identity:get_role(role_id=5f5b315594d34a0da8fd0e1cc476318e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:51.411845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-818d1966-5821-4746-94b5-e3ef294b1fbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:20:51.411845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:20:51.411845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:20:51.412723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d1966-5821-4746-94b5-e3ef294b1fbc admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:51.414035 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 510/1016] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:20:51 2021] GET /identity/v3/roles/5f5b315594d34a0da8fd0e1cc476318e => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:51.419982 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416e5a7-249c-4cca-a176-915a9d05d313 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:51.429434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416e5a7-249c-4cca-a176-915a9d05d313 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:51.433912 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e240f9-3b0f-4f7e-a05a-645cba4bde87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:51.434753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e240f9-3b0f-4f7e-a05a-645cba4bde87 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:51.435070 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e240f9-3b0f-4f7e-a05a-645cba4bde87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:51.435346 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e240f9-3b0f-4f7e-a05a-645cba4bde87 admin admin] PATH_INFO: `/v3/users/ce9cac1643b14f3298cffb6dcc550925` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:51.436534 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e240f9-3b0f-4f7e-a05a-645cba4bde87 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce9cac1643b14f3298cffb6dcc550925)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:51.438742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e240f9-3b0f-4f7e-a05a-645cba4bde87 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:51.440327 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 507/1017] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:20:51 2021] GET /identity/v3/users/ce9cac1643b14f3298cffb6dcc550925 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:51.446164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d1966-5821-4746-94b5-e3ef294b1fbc admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:51.455929 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d1966-5821-4746-94b5-e3ef294b1fbc admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:51.460440 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4e1c7-e98c-4cb6-9b4e-0b59352f504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:51.461247 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4e1c7-e98c-4cb6-9b4e-0b59352f504f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:51.461537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4e1c7-e98c-4cb6-9b4e-0b59352f504f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:51.461820 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4e1c7-e98c-4cb6-9b4e-0b59352f504f admin admin] PATH_INFO: `/v3/projects/7ee20201e21947beb712da1e7df970d8` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:51.463011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4e1c7-e98c-4cb6-9b4e-0b59352f504f admin admin] RBAC: Authorizing `identity:get_project(project_id=7ee20201e21947beb712da1e7df970d8)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:51.464998 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4e1c7-e98c-4cb6-9b4e-0b59352f504f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:51.466611 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 511/1018] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:20:51 2021] GET /identity/v3/projects/7ee20201e21947beb712da1e7df970d8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:51.473837 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e240f9-3b0f-4f7e-a05a-645cba4bde87 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:51.483340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e240f9-3b0f-4f7e-a05a-645cba4bde87 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:51.487880 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdc646-d31d-4928-ac27-078009b5cf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:51.488725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdc646-d31d-4928-ac27-078009b5cf3e admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:51.489009 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdc646-d31d-4928-ac27-078009b5cf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:51.489283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdc646-d31d-4928-ac27-078009b5cf3e admin admin] PATH_INFO: `/v3/projects/7ee20201e21947beb712da1e7df970d8/users/ce9cac1643b14f3298cffb6dcc550925/roles/5f5b315594d34a0da8fd0e1cc476318e` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:51.491490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdc646-d31d-4928-ac27-078009b5cf3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee20201e21947beb712da1e7df970d8, user_id=ce9cac1643b14f3298cffb6dcc550925, role_id=5f5b315594d34a0da8fd0e1cc476318e)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:51.494087 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdc646-d31d-4928-ac27-078009b5cf3e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:51.506639 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 508/1019] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:20:51 2021] PUT /identity/v3/projects/7ee20201e21947beb712da1e7df970d8/users/ce9cac1643b14f3298cffb6dcc550925/roles/5f5b315594d34a0da8fd0e1cc476318e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:20:53.680880 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da765779-2335-4b3a-b728-cf20df7c17f3 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:53.681406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da765779-2335-4b3a-b728-cf20df7c17f3 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:53.681524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da765779-2335-4b3a-b728-cf20df7c17f3 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:53.683233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 512/1020] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:53.691016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3bc18-d524-448d-8832-d762d7d7b759 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:53.691454 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3bc18-d524-448d-8832-d762d7d7b759 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:53.691582 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3bc18-d524-448d-8832-d762d7d7b759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:53.708718 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-62d3bc18-d524-448d-8832-d762d7d7b759 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:53.709913 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-62d3bc18-d524-448d-8832-d762d7d7b759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:53.764866 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 509/1021] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:53 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:53.789349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da765779-2335-4b3a-b728-cf20df7c17f3 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:53.801851 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da765779-2335-4b3a-b728-cf20df7c17f3 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:53.806194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6fba7-0d25-448e-9eaa-bb16596fcc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:53.807089 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6fba7-0d25-448e-9eaa-bb16596fcc53 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:53.807370 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6fba7-0d25-448e-9eaa-bb16596fcc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:53.807644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6fba7-0d25-448e-9eaa-bb16596fcc53 admin admin] PATH_INFO: `/v3/roles/5f5b315594d34a0da8fd0e1cc476318e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:53.809096 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6fba7-0d25-448e-9eaa-bb16596fcc53 admin admin] RBAC: Authorizing `identity:get_role(role_id=5f5b315594d34a0da8fd0e1cc476318e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:53.810681 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6fba7-0d25-448e-9eaa-bb16596fcc53 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:53.812023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 513/1022] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:20:53 2021] GET /identity/v3/roles/5f5b315594d34a0da8fd0e1cc476318e => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:53.818649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3bc18-d524-448d-8832-d762d7d7b759 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:53.827418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3bc18-d524-448d-8832-d762d7d7b759 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:53.832183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b5471-ca37-42c4-ab81-74471de64571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:53.833034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b5471-ca37-42c4-ab81-74471de64571 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:53.833316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b5471-ca37-42c4-ab81-74471de64571 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:53.833590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b5471-ca37-42c4-ab81-74471de64571 admin admin] PATH_INFO: `/v3/users/ce9cac1643b14f3298cffb6dcc550925` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:53.834794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b5471-ca37-42c4-ab81-74471de64571 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce9cac1643b14f3298cffb6dcc550925)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:53.836952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b5471-ca37-42c4-ab81-74471de64571 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:53.838662 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 510/1023] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:20:53 2021] GET /identity/v3/users/ce9cac1643b14f3298cffb6dcc550925 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:53.844311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6fba7-0d25-448e-9eaa-bb16596fcc53 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:53.853874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6fba7-0d25-448e-9eaa-bb16596fcc53 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:53.858349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a434329-c81f-4fab-a5a4-928307a0b649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:53.858981 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a434329-c81f-4fab-a5a4-928307a0b649 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:53.859266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a434329-c81f-4fab-a5a4-928307a0b649 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:53.859542 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a434329-c81f-4fab-a5a4-928307a0b649 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:53.867742 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a434329-c81f-4fab-a5a4-928307a0b649 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:53.869433 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a434329-c81f-4fab-a5a4-928307a0b649 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:53.878634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 514/1024] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:20:53 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:20:53.884659 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b5471-ca37-42c4-ab81-74471de64571 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:53.893956 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b5471-ca37-42c4-ab81-74471de64571 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:53.898438 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fb81a-0713-4bff-b5d0-de314e72585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:53.899270 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fb81a-0713-4bff-b5d0-de314e72585d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:53.899556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fb81a-0713-4bff-b5d0-de314e72585d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:53.899832 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fb81a-0713-4bff-b5d0-de314e72585d admin admin] PATH_INFO: `/v3/projects/7ee20201e21947beb712da1e7df970d8` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:53.900986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fb81a-0713-4bff-b5d0-de314e72585d admin admin] RBAC: Authorizing `identity:get_project(project_id=7ee20201e21947beb712da1e7df970d8)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:53.903013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fb81a-0713-4bff-b5d0-de314e72585d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:53.904613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 511/1025] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:20:53 2021] GET /identity/v3/projects/7ee20201e21947beb712da1e7df970d8 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:53.910738 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a434329-c81f-4fab-a5a4-928307a0b649 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:53.919105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a434329-c81f-4fab-a5a4-928307a0b649 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:53.924432 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf848c-0480-4e3f-9584-ddd700316b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:53.925053 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf848c-0480-4e3f-9584-ddd700316b71 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:53.925345 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf848c-0480-4e3f-9584-ddd700316b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:53.925623 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf848c-0480-4e3f-9584-ddd700316b71 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:53.926440 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf848c-0480-4e3f-9584-ddd700316b71 admin admin] RBAC: Adding query filter params (role.id=5f5b315594d34a0da8fd0e1cc476318e, scope.project.id=7ee20201e21947beb712da1e7df970d8, user.id=ce9cac1643b14f3298cffb6dcc550925) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:20:53.926754 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf848c-0480-4e3f-9584-ddd700316b71 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:53.928594 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf848c-0480-4e3f-9584-ddd700316b71 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:53.934496 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 515/1026] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:20:53 2021] GET /identity/v3/role_assignments?user.id=ce9cac1643b14f3298cffb6dcc550925&scope.project.id=7ee20201e21947beb712da1e7df970d8&role.id=5f5b315594d34a0da8fd0e1cc476318e => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:56.118233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603384ce-3fad-4668-9521-2cd760b1089d None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:56.118813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603384ce-3fad-4668-9521-2cd760b1089d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:56.118813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603384ce-3fad-4668-9521-2cd760b1089d None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:56.120604 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 512/1027] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:56.128408 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d2c26-5e1e-4608-877e-a7074af6ea20 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:56.128837 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d2c26-5e1e-4608-877e-a7074af6ea20 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:56.128973 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d2c26-5e1e-4608-877e-a7074af6ea20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:56.146702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-cf2d2c26-5e1e-4608-877e-a7074af6ea20 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:56.147917 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-cf2d2c26-5e1e-4608-877e-a7074af6ea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:56.155545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 516/1028] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:56 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:56.180844 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603384ce-3fad-4668-9521-2cd760b1089d None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:56.193477 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603384ce-3fad-4668-9521-2cd760b1089d None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:56.197874 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba87a85-31f3-4135-b613-b824f3ed77da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:56.198646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87a85-31f3-4135-b613-b824f3ed77da admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:56.198963 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87a85-31f3-4135-b613-b824f3ed77da admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:56.199247 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87a85-31f3-4135-b613-b824f3ed77da admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:56.200415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba87a85-31f3-4135-b613-b824f3ed77da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:56.202097 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba87a85-31f3-4135-b613-b824f3ed77da admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:56.203692 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 513/1029] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:56.209651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d2c26-5e1e-4608-877e-a7074af6ea20 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:56.218378 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d2c26-5e1e-4608-877e-a7074af6ea20 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:56.223217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e1f7f-6ea3-417a-82be-e7348e3265e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:56.223857 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e1f7f-6ea3-417a-82be-e7348e3265e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:56.224142 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e1f7f-6ea3-417a-82be-e7348e3265e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:56.224420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e1f7f-6ea3-417a-82be-e7348e3265e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:56.225121 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e1f7f-6ea3-417a-82be-e7348e3265e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:56.227028 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e1f7f-6ea3-417a-82be-e7348e3265e0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:56.252636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 517/1030] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Nov 16 00:20:56 2021] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:20:58.438309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88183ed1-7a0d-45d0-9448-f2b8bd669892 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:58.439238 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88183ed1-7a0d-45d0-9448-f2b8bd669892 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:58.439687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88183ed1-7a0d-45d0-9448-f2b8bd669892 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:58.441646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 514/1031] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:20:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:20:58.449234 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027920-25ba-456c-989f-5741fd3785c6 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:58.449671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027920-25ba-456c-989f-5741fd3785c6 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:58.449845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027920-25ba-456c-989f-5741fd3785c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:58.468144 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-00027920-25ba-456c-989f-5741fd3785c6 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:20:58.469328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-00027920-25ba-456c-989f-5741fd3785c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:20:58.526641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 518/1032] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:20:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:20:58.553341 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88183ed1-7a0d-45d0-9448-f2b8bd669892 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:58.566269 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88183ed1-7a0d-45d0-9448-f2b8bd669892 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:58.570592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a2a3a-bd1f-49f4-a204-57379fd03548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:58.571385 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a2a3a-bd1f-49f4-a204-57379fd03548 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:58.571671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a2a3a-bd1f-49f4-a204-57379fd03548 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:58.571945 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a2a3a-bd1f-49f4-a204-57379fd03548 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:58.573108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a2a3a-bd1f-49f4-a204-57379fd03548 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:58.574797 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a2a3a-bd1f-49f4-a204-57379fd03548 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:58.576387 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 515/1033] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:20:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:20:58.582905 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00027920-25ba-456c-989f-5741fd3785c6 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:20:58.591500 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00027920-25ba-456c-989f-5741fd3785c6 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:20:58.596236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec27d13-06b1-46db-9c29-0cca5b0f2e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:20:58.597137 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec27d13-06b1-46db-9c29-0cca5b0f2e33 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:20:58.597421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec27d13-06b1-46db-9c29-0cca5b0f2e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:20:58.597694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec27d13-06b1-46db-9c29-0cca5b0f2e33 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:20:58.598403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec27d13-06b1-46db-9c29-0cca5b0f2e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:20:58.600317 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec27d13-06b1-46db-9c29-0cca5b0f2e33 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:20:58.619554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 519/1034] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Nov 16 00:20:58 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:21:00.814139 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739da232-1bea-439f-be99-528342491206 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:00.814694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739da232-1bea-439f-be99-528342491206 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:00.814694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739da232-1bea-439f-be99-528342491206 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:00.816522 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 516/1035] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:21:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:21:00.823465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde05a1-d2a1-4b8f-b2f0-97f524a019ad None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:00.823906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde05a1-d2a1-4b8f-b2f0-97f524a019ad None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:00.824007 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde05a1-d2a1-4b8f-b2f0-97f524a019ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:00.841364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-adde05a1-d2a1-4b8f-b2f0-97f524a019ad None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:21:00.842551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-adde05a1-d2a1-4b8f-b2f0-97f524a019ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:21:00.851104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 520/1036] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:21:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:21:00.875559 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739da232-1bea-439f-be99-528342491206 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:00.887515 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739da232-1bea-439f-be99-528342491206 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:00.891959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517d6ed-2b37-4bec-afaf-bffde8003a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:00.892724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d6ed-2b37-4bec-afaf-bffde8003a9d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:00.893010 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d6ed-2b37-4bec-afaf-bffde8003a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:00.893292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d6ed-2b37-4bec-afaf-bffde8003a9d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:00.903201 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517d6ed-2b37-4bec-afaf-bffde8003a9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:21:00.910496 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-d517d6ed-2b37-4bec-afaf-bffde8003a9d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:21:00.911646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 517/1037] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:21:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:21:00.917928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde05a1-d2a1-4b8f-b2f0-97f524a019ad None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:00.927720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde05a1-d2a1-4b8f-b2f0-97f524a019ad None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:00.932229 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f4424-b366-44ee-bbd1-c4491b1b8177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:00.932886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f4424-b366-44ee-bbd1-c4491b1b8177 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:00.933171 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f4424-b366-44ee-bbd1-c4491b1b8177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:00.933448 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f4424-b366-44ee-bbd1-c4491b1b8177 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:00.934200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f4424-b366-44ee-bbd1-c4491b1b8177 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:21:00.934510 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f4424-b366-44ee-bbd1-c4491b1b8177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:00.936138 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f4424-b366-44ee-bbd1-c4491b1b8177 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:00.944610 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 521/1038] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:21:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:21:00.950942 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517d6ed-2b37-4bec-afaf-bffde8003a9d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:00.961315 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517d6ed-2b37-4bec-afaf-bffde8003a9d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:00.965893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c673ad-89a4-4c94-9a11-82054171d23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:00.966746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c673ad-89a4-4c94-9a11-82054171d23e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:00.967061 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c673ad-89a4-4c94-9a11-82054171d23e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:00.967340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c673ad-89a4-4c94-9a11-82054171d23e admin admin] PATH_INFO: `/v3/users/3d1c037c181944bd8755142c048f806a` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:00.980899 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c673ad-89a4-4c94-9a11-82054171d23e admin admin] RBAC: Authorizing `identity:get_user(user_id=3d1c037c181944bd8755142c048f806a)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:00.983064 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c673ad-89a4-4c94-9a11-82054171d23e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:00.984655 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 518/1039] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:21:00 2021] GET /identity/v3/users/3d1c037c181944bd8755142c048f806a => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:00.991701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f4424-b366-44ee-bbd1-c4491b1b8177 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:01.001511 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f4424-b366-44ee-bbd1-c4491b1b8177 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:01.005953 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb07cd-c136-461f-ab94-3ebdc4fb9f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:01.006577 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb07cd-c136-461f-ab94-3ebdc4fb9f11 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:01.006878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb07cd-c136-461f-ab94-3ebdc4fb9f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:01.007157 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb07cd-c136-461f-ab94-3ebdc4fb9f11 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:01.014549 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb07cd-c136-461f-ab94-3ebdc4fb9f11 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:01.016749 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb07cd-c136-461f-ab94-3ebdc4fb9f11 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:01.025243 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 522/1040] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:21:00 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:21:01.031195 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c673ad-89a4-4c94-9a11-82054171d23e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:01.041022 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c673ad-89a4-4c94-9a11-82054171d23e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:01.045533 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476361b9-189b-42ec-b298-ce5a8132bbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:01.046359 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476361b9-189b-42ec-b298-ce5a8132bbaa admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:01.046645 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476361b9-189b-42ec-b298-ce5a8132bbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:01.046968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476361b9-189b-42ec-b298-ce5a8132bbaa admin admin] PATH_INFO: `/v3/projects/84c0a45d51a245899960f92d5de86861` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:01.049209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476361b9-189b-42ec-b298-ce5a8132bbaa admin admin] RBAC: Authorizing `identity:get_project(project_id=84c0a45d51a245899960f92d5de86861)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:01.051250 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476361b9-189b-42ec-b298-ce5a8132bbaa admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:01.053038 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 519/1041] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:21:01 2021] GET /identity/v3/projects/84c0a45d51a245899960f92d5de86861 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:01.059083 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb07cd-c136-461f-ab94-3ebdc4fb9f11 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:01.067777 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb07cd-c136-461f-ab94-3ebdc4fb9f11 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:01.072207 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a320f7-71e4-4c42-9187-25b438762790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:01.072820 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a320f7-71e4-4c42-9187-25b438762790 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:01.073102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a320f7-71e4-4c42-9187-25b438762790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:01.073380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a320f7-71e4-4c42-9187-25b438762790 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:01.074196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a320f7-71e4-4c42-9187-25b438762790 admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=84c0a45d51a245899960f92d5de86861, user.id=3d1c037c181944bd8755142c048f806a) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:21:01.074507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a320f7-71e4-4c42-9187-25b438762790 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:01.076349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a320f7-71e4-4c42-9187-25b438762790 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:01.081786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 523/1042] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:21:01 2021] GET /identity/v3/role_assignments?user.id=3d1c037c181944bd8755142c048f806a&scope.project.id=84c0a45d51a245899960f92d5de86861&role.id=2813231cc8954b998440e4bf5ede2945 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:21:03.254404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79c8b-c3e0-4f58-b2a8-89f549015aae None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:03.254925 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79c8b-c3e0-4f58-b2a8-89f549015aae None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:03.254925 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79c8b-c3e0-4f58-b2a8-89f549015aae None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:03.256767 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 520/1043] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:21:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:21:03.264104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8b155-f526-4a65-93cf-348b6cad2652 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:03.264543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8b155-f526-4a65-93cf-348b6cad2652 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:03.264665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8b155-f526-4a65-93cf-348b6cad2652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:03.282466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-51f8b155-f526-4a65-93cf-348b6cad2652 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:21:03.283761 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-51f8b155-f526-4a65-93cf-348b6cad2652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:21:03.291360 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 524/1044] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:21:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:21:03.315488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da79c8b-c3e0-4f58-b2a8-89f549015aae None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:03.327265 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da79c8b-c3e0-4f58-b2a8-89f549015aae None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:03.332108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d7a81-d0f4-44fa-8a8f-3f61a90dd2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:03.332869 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d7a81-d0f4-44fa-8a8f-3f61a90dd2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:03.333152 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d7a81-d0f4-44fa-8a8f-3f61a90dd2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:03.333424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d7a81-d0f4-44fa-8a8f-3f61a90dd2a7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:03.343216 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d7a81-d0f4-44fa-8a8f-3f61a90dd2a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:21:03.350975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-e08d7a81-d0f4-44fa-8a8f-3f61a90dd2a7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:21:03.352086 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 521/1045] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:21:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:21:03.358367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8b155-f526-4a65-93cf-348b6cad2652 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:03.368136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8b155-f526-4a65-93cf-348b6cad2652 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:03.372690 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae45a53-0803-498e-b9d7-2ab0bbcd707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:03.373367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45a53-0803-498e-b9d7-2ab0bbcd707b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:03.373657 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45a53-0803-498e-b9d7-2ab0bbcd707b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:03.373938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45a53-0803-498e-b9d7-2ab0bbcd707b admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:03.374689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae45a53-0803-498e-b9d7-2ab0bbcd707b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:21:03.375030 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae45a53-0803-498e-b9d7-2ab0bbcd707b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:03.376792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae45a53-0803-498e-b9d7-2ab0bbcd707b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:03.384985 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 525/1046] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:21:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:03.390933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d7a81-d0f4-44fa-8a8f-3f61a90dd2a7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:03.401453 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d7a81-d0f4-44fa-8a8f-3f61a90dd2a7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:03.405938 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2d4a2-d00f-46a6-beb6-2766ec21d399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:03.407457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2d4a2-d00f-46a6-beb6-2766ec21d399 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:03.408143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2d4a2-d00f-46a6-beb6-2766ec21d399 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:03.408423 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2d4a2-d00f-46a6-beb6-2766ec21d399 admin admin] PATH_INFO: `/v3/users/3d1c037c181944bd8755142c048f806a` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:03.409613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2d4a2-d00f-46a6-beb6-2766ec21d399 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d1c037c181944bd8755142c048f806a)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:03.411768 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2d4a2-d00f-46a6-beb6-2766ec21d399 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:03.413327 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 522/1047] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:21:03 2021] GET /identity/v3/users/3d1c037c181944bd8755142c048f806a => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:03.419406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae45a53-0803-498e-b9d7-2ab0bbcd707b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:03.429328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae45a53-0803-498e-b9d7-2ab0bbcd707b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:03.433848 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5f609-3b95-4d4d-ad55-031a32e1d2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:03.434704 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5f609-3b95-4d4d-ad55-031a32e1d2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:03.435008 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5f609-3b95-4d4d-ad55-031a32e1d2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:03.435284 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5f609-3b95-4d4d-ad55-031a32e1d2a9 admin admin] PATH_INFO: `/v3/projects/84c0a45d51a245899960f92d5de86861` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:03.436445 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5f609-3b95-4d4d-ad55-031a32e1d2a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=84c0a45d51a245899960f92d5de86861)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:03.438548 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5f609-3b95-4d4d-ad55-031a32e1d2a9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:03.440204 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 526/1048] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:21:03 2021] GET /identity/v3/projects/84c0a45d51a245899960f92d5de86861 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:03.446278 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2d4a2-d00f-46a6-beb6-2766ec21d399 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:03.456325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2d4a2-d00f-46a6-beb6-2766ec21d399 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:03.460859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86a6fd-c711-4cbc-8791-b4d322d0d8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:03.461715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86a6fd-c711-4cbc-8791-b4d322d0d8a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:03.462001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86a6fd-c711-4cbc-8791-b4d322d0d8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:03.462281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86a6fd-c711-4cbc-8791-b4d322d0d8a2 admin admin] PATH_INFO: `/v3/projects/84c0a45d51a245899960f92d5de86861/users/3d1c037c181944bd8755142c048f806a/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:03.464262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86a6fd-c711-4cbc-8791-b4d322d0d8a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c0a45d51a245899960f92d5de86861, user_id=3d1c037c181944bd8755142c048f806a, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:03.466891 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86a6fd-c711-4cbc-8791-b4d322d0d8a2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:03.480837 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 523/1049] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:21:03 2021] PUT /identity/v3/projects/84c0a45d51a245899960f92d5de86861/users/3d1c037c181944bd8755142c048f806a/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:21:05.628841 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc674d-76f5-4f58-bb9d-8f90325e5e4b None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:05.629411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc674d-76f5-4f58-bb9d-8f90325e5e4b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:05.629411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc674d-76f5-4f58-bb9d-8f90325e5e4b None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:05.631229 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 527/1050] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:21:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:21:05.638274 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6866476-bba7-4875-9d25-a3f335f7afbe None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:05.638644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6866476-bba7-4875-9d25-a3f335f7afbe None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:05.638855 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6866476-bba7-4875-9d25-a3f335f7afbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:05.656270 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-c6866476-bba7-4875-9d25-a3f335f7afbe None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:21:05.658031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-c6866476-bba7-4875-9d25-a3f335f7afbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:21:05.714142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 524/1051] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:21:05 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:21:05.741094 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc674d-76f5-4f58-bb9d-8f90325e5e4b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:05.754667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc674d-76f5-4f58-bb9d-8f90325e5e4b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:05.759016 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b501b-eb34-456f-9a02-26f180c6b1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:05.759793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b501b-eb34-456f-9a02-26f180c6b1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:05.760075 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b501b-eb34-456f-9a02-26f180c6b1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:05.760351 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b501b-eb34-456f-9a02-26f180c6b1d0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:05.771049 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b501b-eb34-456f-9a02-26f180c6b1d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:21:05.777569 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-939b501b-eb34-456f-9a02-26f180c6b1d0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:21:05.778694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 528/1052] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:21:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:21:05.785906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6866476-bba7-4875-9d25-a3f335f7afbe None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:05.794761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6866476-bba7-4875-9d25-a3f335f7afbe None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:05.799567 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b136fc-a57c-4bd6-b605-51f39922fee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:05.800223 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b136fc-a57c-4bd6-b605-51f39922fee3 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:05.800513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b136fc-a57c-4bd6-b605-51f39922fee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:05.800798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b136fc-a57c-4bd6-b605-51f39922fee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:05.801546 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b136fc-a57c-4bd6-b605-51f39922fee3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:21:05.801861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b136fc-a57c-4bd6-b605-51f39922fee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:05.803588 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b136fc-a57c-4bd6-b605-51f39922fee3 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:05.811626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 525/1053] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:21:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:05.817693 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b501b-eb34-456f-9a02-26f180c6b1d0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:05.827633 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b501b-eb34-456f-9a02-26f180c6b1d0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:05.832695 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf75f3b-463f-4eda-b122-6a4d29a52849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:05.833531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf75f3b-463f-4eda-b122-6a4d29a52849 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:05.833818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf75f3b-463f-4eda-b122-6a4d29a52849 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:05.834097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf75f3b-463f-4eda-b122-6a4d29a52849 admin admin] PATH_INFO: `/v3/users/3d1c037c181944bd8755142c048f806a` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:05.835399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf75f3b-463f-4eda-b122-6a4d29a52849 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d1c037c181944bd8755142c048f806a)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:05.837506 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf75f3b-463f-4eda-b122-6a4d29a52849 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:05.839100 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 529/1054] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:21:05 2021] GET /identity/v3/users/3d1c037c181944bd8755142c048f806a => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:05.845594 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b136fc-a57c-4bd6-b605-51f39922fee3 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:05.855236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b136fc-a57c-4bd6-b605-51f39922fee3 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:05.859761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb676d-8969-4ce8-b6e2-2aa076960154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:05.860375 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb676d-8969-4ce8-b6e2-2aa076960154 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:05.860661 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb676d-8969-4ce8-b6e2-2aa076960154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:05.860941 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb676d-8969-4ce8-b6e2-2aa076960154 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:05.868497 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb676d-8969-4ce8-b6e2-2aa076960154 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:05.870213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb676d-8969-4ce8-b6e2-2aa076960154 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:05.879052 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 526/1055] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:21:05 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:21:05.885023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf75f3b-463f-4eda-b122-6a4d29a52849 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:05.894733 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf75f3b-463f-4eda-b122-6a4d29a52849 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:05.899143 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a096f-8740-4de2-b620-71bf665e6e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:05.899943 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a096f-8740-4de2-b620-71bf665e6e3b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:05.900220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a096f-8740-4de2-b620-71bf665e6e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:05.900489 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a096f-8740-4de2-b620-71bf665e6e3b admin admin] PATH_INFO: `/v3/projects/84c0a45d51a245899960f92d5de86861` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:05.901634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a096f-8740-4de2-b620-71bf665e6e3b admin admin] RBAC: Authorizing `identity:get_project(project_id=84c0a45d51a245899960f92d5de86861)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:05.903661 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a096f-8740-4de2-b620-71bf665e6e3b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:05.905381 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 530/1056] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:21:05 2021] GET /identity/v3/projects/84c0a45d51a245899960f92d5de86861 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:05.911812 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb676d-8969-4ce8-b6e2-2aa076960154 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:05.920202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb676d-8969-4ce8-b6e2-2aa076960154 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:05.924741 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c3f90-c52d-48d4-9a5f-44a05a62632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:05.925362 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c3f90-c52d-48d4-9a5f-44a05a62632d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:05.925647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c3f90-c52d-48d4-9a5f-44a05a62632d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:05.925929 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c3f90-c52d-48d4-9a5f-44a05a62632d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:05.926754 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c3f90-c52d-48d4-9a5f-44a05a62632d admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=84c0a45d51a245899960f92d5de86861, user.id=3d1c037c181944bd8755142c048f806a) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:21:05.927109 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c3f90-c52d-48d4-9a5f-44a05a62632d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:05.928925 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c3f90-c52d-48d4-9a5f-44a05a62632d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:05.934683 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 527/1057] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:21:05 2021] GET /identity/v3/role_assignments?user.id=3d1c037c181944bd8755142c048f806a&scope.project.id=84c0a45d51a245899960f92d5de86861&role.id=2813231cc8954b998440e4bf5ede2945 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:21:08.091482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4bf9-5ee2-4f68-9a4a-f1bf4a24d019 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:08.092028 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4bf9-5ee2-4f68-9a4a-f1bf4a24d019 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:08.092028 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4bf9-5ee2-4f68-9a4a-f1bf4a24d019 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:08.093799 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 531/1058] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:21:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:21:08.101920 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521728b-bc95-4748-9ac5-4a2304828e65 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:08.102372 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521728b-bc95-4748-9ac5-4a2304828e65 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:08.102471 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521728b-bc95-4748-9ac5-4a2304828e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:08.120260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-5521728b-bc95-4748-9ac5-4a2304828e65 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:21:08.121453 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-5521728b-bc95-4748-9ac5-4a2304828e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:21:08.129798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 528/1059] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:21:08 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:21:08.153226 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb4bf9-5ee2-4f68-9a4a-f1bf4a24d019 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:08.165162 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb4bf9-5ee2-4f68-9a4a-f1bf4a24d019 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:08.169436 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def2ffd-4ce8-483e-ad10-cd66cebcf13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:08.170058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def2ffd-4ce8-483e-ad10-cd66cebcf13d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:08.170338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def2ffd-4ce8-483e-ad10-cd66cebcf13d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:08.170610 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def2ffd-4ce8-483e-ad10-cd66cebcf13d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:08.178640 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def2ffd-4ce8-483e-ad10-cd66cebcf13d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:08.180340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def2ffd-4ce8-483e-ad10-cd66cebcf13d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:08.189518 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 532/1060] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:21:08 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:21:08.195765 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521728b-bc95-4748-9ac5-4a2304828e65 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:08.204561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521728b-bc95-4748-9ac5-4a2304828e65 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:08.210417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5a17e-189e-4949-8a73-df4c332277d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:08.211753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5a17e-189e-4949-8a73-df4c332277d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:08.212245 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5a17e-189e-4949-8a73-df4c332277d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:08.212721 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5a17e-189e-4949-8a73-df4c332277d7 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:08.220285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5a17e-189e-4949-8a73-df4c332277d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:08.222362 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5a17e-189e-4949-8a73-df4c332277d7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:08.236173 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-95c5a17e-189e-4949-8a73-df4c332277d7 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 16 00:21:08.237280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 529/1061] 10.222.0.50 () {56 vars in 1138 bytes} [Tue Nov 16 00:21:08 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:21:08.243650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def2ffd-4ce8-483e-ad10-cd66cebcf13d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:08.252945 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def2ffd-4ce8-483e-ad10-cd66cebcf13d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:08.257421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256e2c9-f0ee-41eb-92d4-6aab763f92ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:08.258053 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256e2c9-f0ee-41eb-92d4-6aab763f92ea admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:08.258334 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256e2c9-f0ee-41eb-92d4-6aab763f92ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:08.258608 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256e2c9-f0ee-41eb-92d4-6aab763f92ea admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:08.259349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256e2c9-f0ee-41eb-92d4-6aab763f92ea admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:21:08.259652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256e2c9-f0ee-41eb-92d4-6aab763f92ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:08.261193 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256e2c9-f0ee-41eb-92d4-6aab763f92ea admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:08.268537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 533/1062] 10.222.0.50 () {56 vars in 1136 bytes} [Tue Nov 16 00:21:08 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:10.411431 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b6fd-6b50-4d3e-8819-d9851bc7215f None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:10.411995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b6fd-6b50-4d3e-8819-d9851bc7215f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:10.411995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b6fd-6b50-4d3e-8819-d9851bc7215f None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:10.413775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 530/1063] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:21:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:21:10.420732 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115df68d-ac59-4d59-91d0-5589360270dd None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:10.421168 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115df68d-ac59-4d59-91d0-5589360270dd None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:10.421273 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115df68d-ac59-4d59-91d0-5589360270dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:10.439646 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-115df68d-ac59-4d59-91d0-5589360270dd None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:21:10.440806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-115df68d-ac59-4d59-91d0-5589360270dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:21:10.448345 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 534/1064] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:21:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:21:10.473946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b6fd-6b50-4d3e-8819-d9851bc7215f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:10.486140 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b6fd-6b50-4d3e-8819-d9851bc7215f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:10.490555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59ef13-bb67-4821-bd49-488ec25eeb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:10.491227 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59ef13-bb67-4821-bd49-488ec25eeb20 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:10.491516 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59ef13-bb67-4821-bd49-488ec25eeb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:10.491796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59ef13-bb67-4821-bd49-488ec25eeb20 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:10.492544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59ef13-bb67-4821-bd49-488ec25eeb20 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:10.493569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-8f59ef13-bb67-4821-bd49-488ec25eeb20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:21:10.493569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:21:10.493569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:21:10.494450 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59ef13-bb67-4821-bd49-488ec25eeb20 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:10.510312 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 531/1065] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Nov 16 00:21:10 2021] POST /identity/v3/domains => generated 267 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:21:12.769404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d648aa-6587-4010-b341-64c3dbbc5bbd None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:12.769953 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d648aa-6587-4010-b341-64c3dbbc5bbd None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:12.769953 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d648aa-6587-4010-b341-64c3dbbc5bbd None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:12.771747 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 535/1066] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:21:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:21:12.778808 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a089a-23de-411f-9af0-d6e761597ba4 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:12.779279 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a089a-23de-411f-9af0-d6e761597ba4 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:12.779416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a089a-23de-411f-9af0-d6e761597ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:12.797356 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0a8a089a-23de-411f-9af0-d6e761597ba4 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:21:12.798536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0a8a089a-23de-411f-9af0-d6e761597ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:21:12.854112 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 532/1067] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:21:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:21:12.879703 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d648aa-6587-4010-b341-64c3dbbc5bbd None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:12.892104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d648aa-6587-4010-b341-64c3dbbc5bbd None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:12.896418 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f6b6b-0a33-4b4a-b8f5-381e2668242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:12.897247 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f6b6b-0a33-4b4a-b8f5-381e2668242f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:12.897527 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f6b6b-0a33-4b4a-b8f5-381e2668242f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:12.897800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f6b6b-0a33-4b4a-b8f5-381e2668242f admin admin] PATH_INFO: `/v3/domains/16b1d48fcff644b2a938ba77561ceb9b` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:12.908295 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f6b6b-0a33-4b4a-b8f5-381e2668242f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=16b1d48fcff644b2a938ba77561ceb9b)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:12.910225 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f6b6b-0a33-4b4a-b8f5-381e2668242f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:12.911822 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 536/1068] 10.222.0.50 () {56 vars in 1204 bytes} [Tue Nov 16 00:21:12 2021] GET /identity/v3/domains/16b1d48fcff644b2a938ba77561ceb9b => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:21:12.917950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a089a-23de-411f-9af0-d6e761597ba4 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:12.926798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a089a-23de-411f-9af0-d6e761597ba4 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:12.931351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d48202-185a-437a-8aa0-80bbe856aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:12.931999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d48202-185a-437a-8aa0-80bbe856aa5f admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:12.932290 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d48202-185a-437a-8aa0-80bbe856aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:12.932569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d48202-185a-437a-8aa0-80bbe856aa5f admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:12.933280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d48202-185a-437a-8aa0-80bbe856aa5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:12.935196 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d48202-185a-437a-8aa0-80bbe856aa5f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:12.962081 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 533/1069] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Nov 16 00:21:12 2021] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:21:15.171423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd2fee-d5d7-4693-a943-221cc4f995a7 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:15.171946 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd2fee-d5d7-4693-a943-221cc4f995a7 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:15.172033 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd2fee-d5d7-4693-a943-221cc4f995a7 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:15.173805 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 537/1070] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:21:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:21:15.180862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29afa9-3226-4daf-b8d9-35417539776f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:15.181263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29afa9-3226-4daf-b8d9-35417539776f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:15.181352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29afa9-3226-4daf-b8d9-35417539776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:15.199057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-ae29afa9-3226-4daf-b8d9-35417539776f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:21:15.200230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ae29afa9-3226-4daf-b8d9-35417539776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:21:15.254896 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 534/1071] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:21:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:21:15.282518 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd2fee-d5d7-4693-a943-221cc4f995a7 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:15.294635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd2fee-d5d7-4693-a943-221cc4f995a7 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:15.299221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb178af-568b-41b1-918e-8de3dcc977df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:15.300063 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb178af-568b-41b1-918e-8de3dcc977df admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:15.300347 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb178af-568b-41b1-918e-8de3dcc977df admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:15.300626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb178af-568b-41b1-918e-8de3dcc977df admin admin] PATH_INFO: `/v3/domains/16b1d48fcff644b2a938ba77561ceb9b` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:15.301806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb178af-568b-41b1-918e-8de3dcc977df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=16b1d48fcff644b2a938ba77561ceb9b)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:15.303781 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb178af-568b-41b1-918e-8de3dcc977df admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:15.305345 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 538/1072] 10.222.0.50 () {56 vars in 1204 bytes} [Tue Nov 16 00:21:15 2021] GET /identity/v3/domains/16b1d48fcff644b2a938ba77561ceb9b => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:15.311314 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29afa9-3226-4daf-b8d9-35417539776f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:15.321266 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29afa9-3226-4daf-b8d9-35417539776f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:15.326389 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbb02a-b89c-48fd-9a40-312c5885e387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:15.327123 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbb02a-b89c-48fd-9a40-312c5885e387 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:15.327412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbb02a-b89c-48fd-9a40-312c5885e387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:15.327886 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbb02a-b89c-48fd-9a40-312c5885e387 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:15.329522 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbb02a-b89c-48fd-9a40-312c5885e387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:15.332421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbb02a-b89c-48fd-9a40-312c5885e387 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:15.356775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 535/1073] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Nov 16 00:21:15 2021] POST /identity/v3/users => generated 311 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:21:17.559759 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9178a04-252b-4dd0-8f39-2e18cd9a7878 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:17.560283 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9178a04-252b-4dd0-8f39-2e18cd9a7878 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:17.560370 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9178a04-252b-4dd0-8f39-2e18cd9a7878 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:17.562099 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 539/1074] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:21:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:21:17.570320 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366984d3-b2aa-483f-8093-0677307e880f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:17.570738 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366984d3-b2aa-483f-8093-0677307e880f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:17.570911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366984d3-b2aa-483f-8093-0677307e880f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:17.589056 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-366984d3-b2aa-483f-8093-0677307e880f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:21:17.590256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-366984d3-b2aa-483f-8093-0677307e880f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:21:17.598418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 536/1075] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:21:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:21:17.622943 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9178a04-252b-4dd0-8f39-2e18cd9a7878 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:17.635739 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9178a04-252b-4dd0-8f39-2e18cd9a7878 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:17.639995 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d302c4-22a0-490e-97b5-0716670c4ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:17.641378 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d302c4-22a0-490e-97b5-0716670c4ccc admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:17.641655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d302c4-22a0-490e-97b5-0716670c4ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:17.641926 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d302c4-22a0-490e-97b5-0716670c4ccc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:17.652242 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d302c4-22a0-490e-97b5-0716670c4ccc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:21:17.658904 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-70d302c4-22a0-490e-97b5-0716670c4ccc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:21:17.660013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 540/1076] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:21:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:21:17.666399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366984d3-b2aa-483f-8093-0677307e880f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:17.675960 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366984d3-b2aa-483f-8093-0677307e880f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:17.680516 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae69ea-81f3-4359-8fb1-9921f487c8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:17.681168 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae69ea-81f3-4359-8fb1-9921f487c8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:17.681458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae69ea-81f3-4359-8fb1-9921f487c8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:17.681740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae69ea-81f3-4359-8fb1-9921f487c8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:17.682489 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae69ea-81f3-4359-8fb1-9921f487c8a2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:21:17.682800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae69ea-81f3-4359-8fb1-9921f487c8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:17.684424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae69ea-81f3-4359-8fb1-9921f487c8a2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:17.693261 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 537/1077] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:21:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:17.699337 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d302c4-22a0-490e-97b5-0716670c4ccc admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:17.708620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d302c4-22a0-490e-97b5-0716670c4ccc admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:17.713022 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8087a-2791-419e-91e3-19607a14fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:17.713841 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8087a-2791-419e-91e3-19607a14fb21 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:17.714121 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8087a-2791-419e-91e3-19607a14fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:17.714396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8087a-2791-419e-91e3-19607a14fb21 admin admin] PATH_INFO: `/v3/users/5e23af7b9b744afa8c6fde6cbed5da87` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:17.728208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8087a-2791-419e-91e3-19607a14fb21 admin admin] RBAC: Authorizing `identity:get_user(user_id=5e23af7b9b744afa8c6fde6cbed5da87)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:17.730704 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8087a-2791-419e-91e3-19607a14fb21 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:17.732434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 541/1078] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:21:17 2021] GET /identity/v3/users/5e23af7b9b744afa8c6fde6cbed5da87 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:17.739666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae69ea-81f3-4359-8fb1-9921f487c8a2 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:17.750680 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae69ea-81f3-4359-8fb1-9921f487c8a2 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:17.755226 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3e41b-65f0-45b0-a3e2-8a498733898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:17.755864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3e41b-65f0-45b0-a3e2-8a498733898b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:17.756150 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3e41b-65f0-45b0-a3e2-8a498733898b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:17.756454 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3e41b-65f0-45b0-a3e2-8a498733898b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:17.764047 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3e41b-65f0-45b0-a3e2-8a498733898b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:17.765794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3e41b-65f0-45b0-a3e2-8a498733898b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:17.774745 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 538/1079] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:21:17 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:21:17.781007 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8087a-2791-419e-91e3-19607a14fb21 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:17.790429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8087a-2791-419e-91e3-19607a14fb21 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:17.795063 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103717a5-a8bd-4134-8764-187caff31974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:17.795900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103717a5-a8bd-4134-8764-187caff31974 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:17.796179 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103717a5-a8bd-4134-8764-187caff31974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:17.796450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103717a5-a8bd-4134-8764-187caff31974 admin admin] PATH_INFO: `/v3/projects/f31f08c0e40f46f09e2d0d61590b966e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:17.798181 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103717a5-a8bd-4134-8764-187caff31974 admin admin] RBAC: Authorizing `identity:get_project(project_id=f31f08c0e40f46f09e2d0d61590b966e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:17.800217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103717a5-a8bd-4134-8764-187caff31974 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:17.801842 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 542/1080] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:21:17 2021] GET /identity/v3/projects/f31f08c0e40f46f09e2d0d61590b966e => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:17.808059 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3e41b-65f0-45b0-a3e2-8a498733898b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:17.817380 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3e41b-65f0-45b0-a3e2-8a498733898b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:17.821832 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea33a7-f5a7-4c24-8548-baa646396236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:17.822447 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea33a7-f5a7-4c24-8548-baa646396236 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:17.822733 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea33a7-f5a7-4c24-8548-baa646396236 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:17.823050 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea33a7-f5a7-4c24-8548-baa646396236 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:17.823860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea33a7-f5a7-4c24-8548-baa646396236 admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=f31f08c0e40f46f09e2d0d61590b966e, user.id=5e23af7b9b744afa8c6fde6cbed5da87) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:21:17.824176 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea33a7-f5a7-4c24-8548-baa646396236 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:17.825963 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea33a7-f5a7-4c24-8548-baa646396236 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:17.831169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 539/1081] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:21:17 2021] GET /identity/v3/role_assignments?user.id=5e23af7b9b744afa8c6fde6cbed5da87&scope.project.id=f31f08c0e40f46f09e2d0d61590b966e&role.id=2813231cc8954b998440e4bf5ede2945 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:19.949605 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebaa51-ca20-455a-b511-a7b660f1e751 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:19.950091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebaa51-ca20-455a-b511-a7b660f1e751 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:19.950181 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebaa51-ca20-455a-b511-a7b660f1e751 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:19.952126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 543/1082] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:21:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:21:19.959963 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fe0c4-cb8f-4b94-bdf0-b7701156bba2 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:19.960381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fe0c4-cb8f-4b94-bdf0-b7701156bba2 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:19.960535 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fe0c4-cb8f-4b94-bdf0-b7701156bba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:19.979030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-e37fe0c4-cb8f-4b94-bdf0-b7701156bba2 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:21:19.980220 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e37fe0c4-cb8f-4b94-bdf0-b7701156bba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:21:19.988019 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 540/1083] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:21:19 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:21:20.010846 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebaa51-ca20-455a-b511-a7b660f1e751 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:20.023114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebaa51-ca20-455a-b511-a7b660f1e751 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:20.027365 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e92c1f-a678-4ec8-b3dc-69a57ff3be11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:20.028125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92c1f-a678-4ec8-b3dc-69a57ff3be11 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:20.028404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92c1f-a678-4ec8-b3dc-69a57ff3be11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:20.028675 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92c1f-a678-4ec8-b3dc-69a57ff3be11 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:20.039044 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e92c1f-a678-4ec8-b3dc-69a57ff3be11 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:21:20.045567 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-77e92c1f-a678-4ec8-b3dc-69a57ff3be11 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:21:20.046720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 544/1084] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:21:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:21:20.052992 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fe0c4-cb8f-4b94-bdf0-b7701156bba2 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:20.061732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fe0c4-cb8f-4b94-bdf0-b7701156bba2 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:20.066352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5ec28-a7be-404f-a64e-7a001613fa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:20.067037 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5ec28-a7be-404f-a64e-7a001613fa2f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:20.067329 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5ec28-a7be-404f-a64e-7a001613fa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:20.067611 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5ec28-a7be-404f-a64e-7a001613fa2f admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:20.068359 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5ec28-a7be-404f-a64e-7a001613fa2f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:21:20.068673 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5ec28-a7be-404f-a64e-7a001613fa2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:20.070264 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5ec28-a7be-404f-a64e-7a001613fa2f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:20.078826 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 541/1085] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:21:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:20.084948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e92c1f-a678-4ec8-b3dc-69a57ff3be11 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:20.098916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e92c1f-a678-4ec8-b3dc-69a57ff3be11 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:20.103416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781292a3-dbb5-45de-9fb8-4c15704ac93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:20.104269 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781292a3-dbb5-45de-9fb8-4c15704ac93e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:20.104552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781292a3-dbb5-45de-9fb8-4c15704ac93e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:20.104827 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781292a3-dbb5-45de-9fb8-4c15704ac93e admin admin] PATH_INFO: `/v3/users/5e23af7b9b744afa8c6fde6cbed5da87` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:20.106006 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781292a3-dbb5-45de-9fb8-4c15704ac93e admin admin] RBAC: Authorizing `identity:get_user(user_id=5e23af7b9b744afa8c6fde6cbed5da87)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:20.108145 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781292a3-dbb5-45de-9fb8-4c15704ac93e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:20.110312 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 545/1086] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:21:20 2021] GET /identity/v3/users/5e23af7b9b744afa8c6fde6cbed5da87 => generated 311 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:20.116992 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5ec28-a7be-404f-a64e-7a001613fa2f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:20.126765 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5ec28-a7be-404f-a64e-7a001613fa2f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:20.131361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fec387-f0e2-4a8d-8e27-555f52e0c5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:20.132198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fec387-f0e2-4a8d-8e27-555f52e0c5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:20.132482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fec387-f0e2-4a8d-8e27-555f52e0c5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:20.132760 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fec387-f0e2-4a8d-8e27-555f52e0c5e8 admin admin] PATH_INFO: `/v3/projects/f31f08c0e40f46f09e2d0d61590b966e` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:20.133926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fec387-f0e2-4a8d-8e27-555f52e0c5e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=f31f08c0e40f46f09e2d0d61590b966e)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:20.136003 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fec387-f0e2-4a8d-8e27-555f52e0c5e8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:20.137630 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 542/1087] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:21:20 2021] GET /identity/v3/projects/f31f08c0e40f46f09e2d0d61590b966e => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:20.144211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781292a3-dbb5-45de-9fb8-4c15704ac93e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:20.153587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781292a3-dbb5-45de-9fb8-4c15704ac93e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:20.158798 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719a0fe-9439-4685-8699-c0d09dfeec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:20.159677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719a0fe-9439-4685-8699-c0d09dfeec6d admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:20.159965 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719a0fe-9439-4685-8699-c0d09dfeec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:20.160246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719a0fe-9439-4685-8699-c0d09dfeec6d admin admin] PATH_INFO: `/v3/projects/f31f08c0e40f46f09e2d0d61590b966e/users/5e23af7b9b744afa8c6fde6cbed5da87/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:20.162188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719a0fe-9439-4685-8699-c0d09dfeec6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31f08c0e40f46f09e2d0d61590b966e, user_id=5e23af7b9b744afa8c6fde6cbed5da87, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:20.164818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719a0fe-9439-4685-8699-c0d09dfeec6d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:20.178298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 546/1088] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:21:20 2021] PUT /identity/v3/projects/f31f08c0e40f46f09e2d0d61590b966e/users/5e23af7b9b744afa8c6fde6cbed5da87/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:21:22.312508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a672284-908b-4b74-8542-0e93d368ffb5 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:22.313593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a672284-908b-4b74-8542-0e93d368ffb5 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:22.313840 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a672284-908b-4b74-8542-0e93d368ffb5 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:22.315682 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 543/1089] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:21:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:21:22.322674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccb6d7-ba00-46c7-b1ab-2ad57ef152f6 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:22.323116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccb6d7-ba00-46c7-b1ab-2ad57ef152f6 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:22.323255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccb6d7-ba00-46c7-b1ab-2ad57ef152f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:22.340636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-29ccb6d7-ba00-46c7-b1ab-2ad57ef152f6 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:21:22.341804 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-29ccb6d7-ba00-46c7-b1ab-2ad57ef152f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:21:22.396668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 547/1090] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:21:22 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:21:22.420762 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a672284-908b-4b74-8542-0e93d368ffb5 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:22.433397 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a672284-908b-4b74-8542-0e93d368ffb5 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:22.438459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f5086-5738-42aa-9fa8-aed43d06016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:22.439263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f5086-5738-42aa-9fa8-aed43d06016d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:22.439557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f5086-5738-42aa-9fa8-aed43d06016d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:22.439842 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f5086-5738-42aa-9fa8-aed43d06016d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:22.449830 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f5086-5738-42aa-9fa8-aed43d06016d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:21:22.456502 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-ca3f5086-5738-42aa-9fa8-aed43d06016d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:21:22.457640 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 544/1091] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:21:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:21:22.464017 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccb6d7-ba00-46c7-b1ab-2ad57ef152f6 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:22.473171 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccb6d7-ba00-46c7-b1ab-2ad57ef152f6 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:22.477646 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af407d2a-9904-4208-a1b2-14cd8ffecec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:22.478292 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af407d2a-9904-4208-a1b2-14cd8ffecec0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:22.478576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af407d2a-9904-4208-a1b2-14cd8ffecec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:22.478882 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af407d2a-9904-4208-a1b2-14cd8ffecec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:22.479625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af407d2a-9904-4208-a1b2-14cd8ffecec0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:21:22.479932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af407d2a-9904-4208-a1b2-14cd8ffecec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:22.481514 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af407d2a-9904-4208-a1b2-14cd8ffecec0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:22.490089 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 548/1092] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:21:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:22.496098 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f5086-5738-42aa-9fa8-aed43d06016d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:22.507062 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f5086-5738-42aa-9fa8-aed43d06016d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:22.511463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7a965-7608-4668-97d4-436a00521375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:22.512286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7a965-7608-4668-97d4-436a00521375 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:22.512568 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7a965-7608-4668-97d4-436a00521375 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:22.512841 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7a965-7608-4668-97d4-436a00521375 admin admin] PATH_INFO: `/v3/users/5e23af7b9b744afa8c6fde6cbed5da87` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:22.514004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7a965-7608-4668-97d4-436a00521375 admin admin] RBAC: Authorizing `identity:get_user(user_id=5e23af7b9b744afa8c6fde6cbed5da87)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:22.516706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7a965-7608-4668-97d4-436a00521375 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:22.518259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 545/1093] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:21:22 2021] GET /identity/v3/users/5e23af7b9b744afa8c6fde6cbed5da87 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:21:22.524051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af407d2a-9904-4208-a1b2-14cd8ffecec0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:22.533643 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af407d2a-9904-4208-a1b2-14cd8ffecec0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:22.538109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7024f3-02e0-46c5-abc8-cce43493bbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:22.538720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7024f3-02e0-46c5-abc8-cce43493bbdd admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:22.539050 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7024f3-02e0-46c5-abc8-cce43493bbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:22.539330 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7024f3-02e0-46c5-abc8-cce43493bbdd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:22.546756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7024f3-02e0-46c5-abc8-cce43493bbdd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:22.549085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7024f3-02e0-46c5-abc8-cce43493bbdd admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:22.557632 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 549/1094] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:21:22 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:21:22.564071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7a965-7608-4668-97d4-436a00521375 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:22.573130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7a965-7608-4668-97d4-436a00521375 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:22.577576 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d4dde-ae63-4410-9287-03b837fa78da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:22.578923 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d4dde-ae63-4410-9287-03b837fa78da admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:22.579213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d4dde-ae63-4410-9287-03b837fa78da admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:22.579491 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d4dde-ae63-4410-9287-03b837fa78da admin admin] PATH_INFO: `/v3/projects/f31f08c0e40f46f09e2d0d61590b966e` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:22.580641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d4dde-ae63-4410-9287-03b837fa78da admin admin] RBAC: Authorizing `identity:get_project(project_id=f31f08c0e40f46f09e2d0d61590b966e)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:22.582624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d4dde-ae63-4410-9287-03b837fa78da admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:22.584378 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 546/1095] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:21:22 2021] GET /identity/v3/projects/f31f08c0e40f46f09e2d0d61590b966e => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:21:22.590210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7024f3-02e0-46c5-abc8-cce43493bbdd admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:21:22.599396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7024f3-02e0-46c5-abc8-cce43493bbdd admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:21:22.603878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088561a7-6a95-498e-ad0a-10799525c5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:21:22.604500 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088561a7-6a95-498e-ad0a-10799525c5ed admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:21:22.604773 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088561a7-6a95-498e-ad0a-10799525c5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:21:22.605052 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088561a7-6a95-498e-ad0a-10799525c5ed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:21:22.605862 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088561a7-6a95-498e-ad0a-10799525c5ed admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=f31f08c0e40f46f09e2d0d61590b966e, user.id=5e23af7b9b744afa8c6fde6cbed5da87) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:21:22.606175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088561a7-6a95-498e-ad0a-10799525c5ed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:21:22.607984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088561a7-6a95-498e-ad0a-10799525c5ed admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:21:22.614083 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 550/1096] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:21:22 2021] GET /identity/v3/role_assignments?user.id=5e23af7b9b744afa8c6fde6cbed5da87&scope.project.id=f31f08c0e40f46f09e2d0d61590b966e&role.id=2813231cc8954b998440e4bf5ede2945 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:17.767795 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cde8d-25cd-47ab-a993-825222f153e7 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:17.768401 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cde8d-25cd-47ab-a993-825222f153e7 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:17.768401 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cde8d-25cd-47ab-a993-825222f153e7 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:17.770326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 547/1097] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:22:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:22:17.777912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0847b-cf4d-4fd5-b753-8923d509fb9e None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:17.778438 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0847b-cf4d-4fd5-b753-8923d509fb9e None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:17.778556 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0847b-cf4d-4fd5-b753-8923d509fb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:17.797752 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-fba0847b-cf4d-4fd5-b753-8923d509fb9e None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:22:17.798968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-fba0847b-cf4d-4fd5-b753-8923d509fb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:22:17.807474 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 551/1098] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:22:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:22:17.834901 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cde8d-25cd-47ab-a993-825222f153e7 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:17.848994 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cde8d-25cd-47ab-a993-825222f153e7 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:17.854059 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b988942-aca3-4a2c-83b1-9f4088e602dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:17.854864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b988942-aca3-4a2c-83b1-9f4088e602dc admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:17.855166 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b988942-aca3-4a2c-83b1-9f4088e602dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:17.855447 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b988942-aca3-4a2c-83b1-9f4088e602dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:17.866633 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b988942-aca3-4a2c-83b1-9f4088e602dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:17.868633 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b988942-aca3-4a2c-83b1-9f4088e602dc admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:17.886174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-7b988942-aca3-4a2c-83b1-9f4088e602dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:22:17.887642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 548/1099] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:17.895403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0847b-cf4d-4fd5-b753-8923d509fb9e None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:17.905074 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0847b-cf4d-4fd5-b753-8923d509fb9e None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:17.911080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a520b55-347e-452a-b48e-a23589d255c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:17.911804 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520b55-347e-452a-b48e-a23589d255c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:17.912093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520b55-347e-452a-b48e-a23589d255c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:17.912407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a520b55-347e-452a-b48e-a23589d255c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:17.913157 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a520b55-347e-452a-b48e-a23589d255c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:17.913512 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a520b55-347e-452a-b48e-a23589d255c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:17.915167 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a520b55-347e-452a-b48e-a23589d255c0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:17.933010 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 552/1100] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:22:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:17.939709 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b988942-aca3-4a2c-83b1-9f4088e602dc admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:17.955065 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b988942-aca3-4a2c-83b1-9f4088e602dc admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:17.960312 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f07f9-d175-4dfe-a22a-049653045b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:17.961373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f07f9-d175-4dfe-a22a-049653045b2f admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:17.961643 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f07f9-d175-4dfe-a22a-049653045b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:17.962106 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f07f9-d175-4dfe-a22a-049653045b2f admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:17.963154 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f07f9-d175-4dfe-a22a-049653045b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:17.965377 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f07f9-d175-4dfe-a22a-049653045b2f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:17.992058 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 549/1101] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Nov 16 00:22:17 2021] POST /identity/v3/users => generated 251 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:22:20.531991 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99935f5-9024-4f3d-a59d-6aa1c1009bd2 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:20.532537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99935f5-9024-4f3d-a59d-6aa1c1009bd2 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:20.532537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99935f5-9024-4f3d-a59d-6aa1c1009bd2 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:20.534881 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 553/1102] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:22:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:22:20.543591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e114ec-720a-438d-b968-49b573f444ae None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:20.544081 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e114ec-720a-438d-b968-49b573f444ae None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:20.544284 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e114ec-720a-438d-b968-49b573f444ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:20.564276 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-16e114ec-720a-438d-b968-49b573f444ae None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:22:20.565932 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-16e114ec-720a-438d-b968-49b573f444ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:22:20.578990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 550/1103] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:22:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:22:20.608138 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99935f5-9024-4f3d-a59d-6aa1c1009bd2 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:20.622149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99935f5-9024-4f3d-a59d-6aa1c1009bd2 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:20.627627 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661e479-ed53-4cee-80c8-251545fb249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:20.628459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661e479-ed53-4cee-80c8-251545fb249e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:20.628761 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661e479-ed53-4cee-80c8-251545fb249e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:20.629093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661e479-ed53-4cee-80c8-251545fb249e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:20.643566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661e479-ed53-4cee-80c8-251545fb249e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:22:20.651223 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-4661e479-ed53-4cee-80c8-251545fb249e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:22:20.654262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 554/1104] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:22:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:20.660994 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e114ec-720a-438d-b968-49b573f444ae None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:20.673545 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e114ec-720a-438d-b968-49b573f444ae None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:20.678993 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b5835-c54e-4782-9547-73640136a91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:20.679716 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5835-c54e-4782-9547-73640136a91c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:20.680027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5835-c54e-4782-9547-73640136a91c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:20.680325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5835-c54e-4782-9547-73640136a91c admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:20.681102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b5835-c54e-4782-9547-73640136a91c admin admin] RBAC: Adding query filter params (name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:20.681471 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b5835-c54e-4782-9547-73640136a91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:20.683169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b5835-c54e-4782-9547-73640136a91c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:20.693173 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 551/1105] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:22:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:20.700223 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661e479-ed53-4cee-80c8-251545fb249e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:20.712583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661e479-ed53-4cee-80c8-251545fb249e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:20.720273 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193d581-f84d-4ac8-b12a-fbed79bb82a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:20.721272 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193d581-f84d-4ac8-b12a-fbed79bb82a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:20.721868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193d581-f84d-4ac8-b12a-fbed79bb82a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:20.722191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193d581-f84d-4ac8-b12a-fbed79bb82a3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:20.734583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193d581-f84d-4ac8-b12a-fbed79bb82a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:20.736636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193d581-f84d-4ac8-b12a-fbed79bb82a3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:20.754729 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-d193d581-f84d-4ac8-b12a-fbed79bb82a3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:22:20.756104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 555/1106] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:20.762725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b5835-c54e-4782-9547-73640136a91c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:20.773973 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b5835-c54e-4782-9547-73640136a91c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:20.778931 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2b5d3-2966-4d11-a435-7c3906998e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:20.779632 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2b5d3-2966-4d11-a435-7c3906998e29 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:20.779957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2b5d3-2966-4d11-a435-7c3906998e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:20.780208 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2b5d3-2966-4d11-a435-7c3906998e29 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:20.781793 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2b5d3-2966-4d11-a435-7c3906998e29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:20.782157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2b5d3-2966-4d11-a435-7c3906998e29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:20.783889 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2b5d3-2966-4d11-a435-7c3906998e29 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:20.799586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 552/1107] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:22:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:20.806153 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193d581-f84d-4ac8-b12a-fbed79bb82a3 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:20.818955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193d581-f84d-4ac8-b12a-fbed79bb82a3 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:20.824780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b75412-a95a-4bec-8598-9d595a0cbac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:20.825733 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b75412-a95a-4bec-8598-9d595a0cbac2 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:20.826158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b75412-a95a-4bec-8598-9d595a0cbac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:20.826443 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b75412-a95a-4bec-8598-9d595a0cbac2 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:20.835820 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b75412-a95a-4bec-8598-9d595a0cbac2 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:20.838246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b75412-a95a-4bec-8598-9d595a0cbac2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:20.854793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-50b75412-a95a-4bec-8598-9d595a0cbac2 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 16 00:22:20.856567 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 556/1108] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:20 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:20.863240 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2b5d3-2966-4d11-a435-7c3906998e29 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:20.874067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2b5d3-2966-4d11-a435-7c3906998e29 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:20.881208 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faf05a-bdf3-420b-ae4e-e635dccd2cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:20.882176 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faf05a-bdf3-420b-ae4e-e635dccd2cfd admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:20.882664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faf05a-bdf3-420b-ae4e-e635dccd2cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:20.883252 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faf05a-bdf3-420b-ae4e-e635dccd2cfd admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:20.884414 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faf05a-bdf3-420b-ae4e-e635dccd2cfd admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:20.884731 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faf05a-bdf3-420b-ae4e-e635dccd2cfd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:20.886750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faf05a-bdf3-420b-ae4e-e635dccd2cfd admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:20.906638 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 553/1109] 10.222.0.50 () {56 vars in 1164 bytes} [Tue Nov 16 00:22:20 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:20.913213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b75412-a95a-4bec-8598-9d595a0cbac2 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:20.928545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b75412-a95a-4bec-8598-9d595a0cbac2 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:20.933442 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576a09a-e916-4cfe-91f9-8dad1232f988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:20.934093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576a09a-e916-4cfe-91f9-8dad1232f988 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:20.934382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576a09a-e916-4cfe-91f9-8dad1232f988 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:20.934672 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576a09a-e916-4cfe-91f9-8dad1232f988 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:20.945073 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576a09a-e916-4cfe-91f9-8dad1232f988 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:20.947106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576a09a-e916-4cfe-91f9-8dad1232f988 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:20.957984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 557/1110] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:22:20 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:22:20.964922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faf05a-bdf3-420b-ae4e-e635dccd2cfd admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:20.977409 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faf05a-bdf3-420b-ae4e-e635dccd2cfd admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:20.983165 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded6618-411b-41b8-bcc7-80f715bab351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:20.984611 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded6618-411b-41b8-bcc7-80f715bab351 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:20.984939 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded6618-411b-41b8-bcc7-80f715bab351 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:20.985243 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded6618-411b-41b8-bcc7-80f715bab351 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:20.997282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded6618-411b-41b8-bcc7-80f715bab351 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:20.999872 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded6618-411b-41b8-bcc7-80f715bab351 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:21.018698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-4ded6618-411b-41b8-bcc7-80f715bab351 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:22:21.020075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 554/1111] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:21.026962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576a09a-e916-4cfe-91f9-8dad1232f988 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:21.038462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576a09a-e916-4cfe-91f9-8dad1232f988 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:21.043915 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496035-21e3-4dd9-8ea5-ff35fbfa5e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:21.044635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496035-21e3-4dd9-8ea5-ff35fbfa5e68 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:21.045021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496035-21e3-4dd9-8ea5-ff35fbfa5e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:21.045287 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496035-21e3-4dd9-8ea5-ff35fbfa5e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:21.046681 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce496035-21e3-4dd9-8ea5-ff35fbfa5e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:21.047051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce496035-21e3-4dd9-8ea5-ff35fbfa5e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:21.048803 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce496035-21e3-4dd9-8ea5-ff35fbfa5e68 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:21.061999 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 558/1112] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:22:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:21.068958 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded6618-411b-41b8-bcc7-80f715bab351 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:21.080186 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded6618-411b-41b8-bcc7-80f715bab351 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:21.084955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc045d-ef98-4594-a8a2-d4003ad8b560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:21.085924 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc045d-ef98-4594-a8a2-d4003ad8b560 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:21.086214 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc045d-ef98-4594-a8a2-d4003ad8b560 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:21.086504 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc045d-ef98-4594-a8a2-d4003ad8b560 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:21.095404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc045d-ef98-4594-a8a2-d4003ad8b560 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:21.097792 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc045d-ef98-4594-a8a2-d4003ad8b560 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:21.112872 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-90dc045d-ef98-4594-a8a2-d4003ad8b560 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:22:21.114203 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 555/1113] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:22:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:21.120844 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496035-21e3-4dd9-8ea5-ff35fbfa5e68 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:21.131636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496035-21e3-4dd9-8ea5-ff35fbfa5e68 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:21.138672 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02969c-1ce2-4c79-9c3f-1478171930c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:21.139555 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02969c-1ce2-4c79-9c3f-1478171930c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:21.139991 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02969c-1ce2-4c79-9c3f-1478171930c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:21.140499 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02969c-1ce2-4c79-9c3f-1478171930c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:21.141477 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02969c-1ce2-4c79-9c3f-1478171930c7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:21.141927 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02969c-1ce2-4c79-9c3f-1478171930c7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:21.144033 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02969c-1ce2-4c79-9c3f-1478171930c7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:21.162873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 559/1114] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:22:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:21.166275 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc045d-ef98-4594-a8a2-d4003ad8b560 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:21.179254 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc045d-ef98-4594-a8a2-d4003ad8b560 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:21.184360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382f39e-41a9-48c5-822b-add3cfb515cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:21.185069 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f39e-41a9-48c5-822b-add3cfb515cc admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:21.185391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f39e-41a9-48c5-822b-add3cfb515cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:21.185707 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f39e-41a9-48c5-822b-add3cfb515cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:21.186735 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382f39e-41a9-48c5-822b-add3cfb515cc admin admin] RBAC: Adding query filter params (role.id=de4c885bb354403b98a2f1aefb43754e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=678965f2159e4c33bf2465058f69ff02) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:21.187137 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382f39e-41a9-48c5-822b-add3cfb515cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:21.189117 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382f39e-41a9-48c5-822b-add3cfb515cc admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:21.206864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 556/1115] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:22:21 2021] GET /identity/v3/role_assignments?user.id=678965f2159e4c33bf2465058f69ff02&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=de4c885bb354403b98a2f1aefb43754e => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:22:23.552646 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1682-5aa6-4ea9-8f7a-eb5b50db4b29 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:23.553291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1682-5aa6-4ea9-8f7a-eb5b50db4b29 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:23.553291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1682-5aa6-4ea9-8f7a-eb5b50db4b29 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:23.555371 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 560/1116] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:22:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:22:23.564550 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb364b-07f8-4211-aed7-7b380322446d None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:23.564990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb364b-07f8-4211-aed7-7b380322446d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:23.565228 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb364b-07f8-4211-aed7-7b380322446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:23.585509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-e9fb364b-07f8-4211-aed7-7b380322446d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:22:23.586988 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e9fb364b-07f8-4211-aed7-7b380322446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:22:23.595822 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 557/1117] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:22:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:22:23.621667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1682-5aa6-4ea9-8f7a-eb5b50db4b29 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:23.634892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1682-5aa6-4ea9-8f7a-eb5b50db4b29 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:23.639196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4fb66-84c1-447f-a930-5cbae55e7c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:23.640477 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4fb66-84c1-447f-a930-5cbae55e7c71 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:23.640757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4fb66-84c1-447f-a930-5cbae55e7c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:23.641037 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4fb66-84c1-447f-a930-5cbae55e7c71 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:23.651295 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4fb66-84c1-447f-a930-5cbae55e7c71 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:22:23.658363 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-5bb4fb66-84c1-447f-a930-5cbae55e7c71 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:22:23.659574 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 561/1118] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:22:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:23.666943 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb364b-07f8-4211-aed7-7b380322446d None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:23.676860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb364b-07f8-4211-aed7-7b380322446d None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:23.681511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8100c0c-e22b-4445-99ce-9adb828ad051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:23.682162 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100c0c-e22b-4445-99ce-9adb828ad051 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:23.682444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100c0c-e22b-4445-99ce-9adb828ad051 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:23.682718 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100c0c-e22b-4445-99ce-9adb828ad051 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:23.683498 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8100c0c-e22b-4445-99ce-9adb828ad051 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:23.683978 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8100c0c-e22b-4445-99ce-9adb828ad051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:23.685580 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8100c0c-e22b-4445-99ce-9adb828ad051 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:23.695162 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 558/1119] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:22:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:23.701989 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4fb66-84c1-447f-a930-5cbae55e7c71 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:23.713403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4fb66-84c1-447f-a930-5cbae55e7c71 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:23.718991 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b4db9-3c26-4ab7-bc64-c1be1119991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:23.719773 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b4db9-3c26-4ab7-bc64-c1be1119991e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:23.720060 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b4db9-3c26-4ab7-bc64-c1be1119991e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:23.720336 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b4db9-3c26-4ab7-bc64-c1be1119991e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:23.731047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b4db9-3c26-4ab7-bc64-c1be1119991e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:23.732941 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b4db9-3c26-4ab7-bc64-c1be1119991e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:23.752369 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-0d0b4db9-3c26-4ab7-bc64-c1be1119991e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:22:23.753577 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 562/1120] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:23.760692 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8100c0c-e22b-4445-99ce-9adb828ad051 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:23.773585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8100c0c-e22b-4445-99ce-9adb828ad051 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:23.778482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f412f-f671-4e09-b158-1029880090da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:23.779208 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f412f-f671-4e09-b158-1029880090da admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:23.779490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f412f-f671-4e09-b158-1029880090da admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:23.779766 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f412f-f671-4e09-b158-1029880090da admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:23.781242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f412f-f671-4e09-b158-1029880090da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:23.781558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f412f-f671-4e09-b158-1029880090da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:23.783190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f412f-f671-4e09-b158-1029880090da admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:23.794871 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 559/1121] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:22:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:23.802107 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b4db9-3c26-4ab7-bc64-c1be1119991e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:23.813282 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b4db9-3c26-4ab7-bc64-c1be1119991e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:23.818091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71feeb-a50e-4de7-8d26-09deb4a8be00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:23.818974 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71feeb-a50e-4de7-8d26-09deb4a8be00 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:23.819272 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71feeb-a50e-4de7-8d26-09deb4a8be00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:23.819553 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71feeb-a50e-4de7-8d26-09deb4a8be00 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:23.827578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71feeb-a50e-4de7-8d26-09deb4a8be00 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:23.829819 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71feeb-a50e-4de7-8d26-09deb4a8be00 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:23.844807 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-fa71feeb-a50e-4de7-8d26-09deb4a8be00 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 16 00:22:23.846009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 563/1122] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:23 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:23.853110 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f412f-f671-4e09-b158-1029880090da admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:23.863280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f412f-f671-4e09-b158-1029880090da admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:23.867846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eba276-8cc3-4999-8ec2-9a5fe7702371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:23.868499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba276-8cc3-4999-8ec2-9a5fe7702371 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:23.868786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba276-8cc3-4999-8ec2-9a5fe7702371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:23.869081 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba276-8cc3-4999-8ec2-9a5fe7702371 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:23.869895 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eba276-8cc3-4999-8ec2-9a5fe7702371 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:23.870207 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eba276-8cc3-4999-8ec2-9a5fe7702371 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:23.872076 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eba276-8cc3-4999-8ec2-9a5fe7702371 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:23.890912 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 560/1123] 10.222.0.50 () {56 vars in 1164 bytes} [Tue Nov 16 00:22:23 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:23.897316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71feeb-a50e-4de7-8d26-09deb4a8be00 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:23.908326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71feeb-a50e-4de7-8d26-09deb4a8be00 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:23.913330 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376b9ee-e433-4d90-970f-1f43c69a9106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:23.914175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b9ee-e433-4d90-970f-1f43c69a9106 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:23.914466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b9ee-e433-4d90-970f-1f43c69a9106 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:23.914775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b9ee-e433-4d90-970f-1f43c69a9106 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:23.926332 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376b9ee-e433-4d90-970f-1f43c69a9106 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:23.928543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376b9ee-e433-4d90-970f-1f43c69a9106 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:23.947897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-6376b9ee-e433-4d90-970f-1f43c69a9106 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:22:23.949641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 564/1124] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:22:23.956549 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eba276-8cc3-4999-8ec2-9a5fe7702371 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:23.968893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eba276-8cc3-4999-8ec2-9a5fe7702371 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:23.975263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21d7b9-977f-4ed7-8d8d-edd05532c1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:23.976147 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21d7b9-977f-4ed7-8d8d-edd05532c1ac admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:23.976551 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21d7b9-977f-4ed7-8d8d-edd05532c1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:23.976950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21d7b9-977f-4ed7-8d8d-edd05532c1ac admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:23.977677 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21d7b9-977f-4ed7-8d8d-edd05532c1ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:23.977999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21d7b9-977f-4ed7-8d8d-edd05532c1ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:23.979880 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21d7b9-977f-4ed7-8d8d-edd05532c1ac admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:23.993565 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 561/1125] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:22:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:24.000702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376b9ee-e433-4d90-970f-1f43c69a9106 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:24.011618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376b9ee-e433-4d90-970f-1f43c69a9106 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:24.017220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf160c77-5c68-4fe7-8922-8b4a04a3bf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:24.018308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf160c77-5c68-4fe7-8922-8b4a04a3bf12 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:24.018604 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf160c77-5c68-4fe7-8922-8b4a04a3bf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:24.018912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf160c77-5c68-4fe7-8922-8b4a04a3bf12 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:24.026583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf160c77-5c68-4fe7-8922-8b4a04a3bf12 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:24.028970 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf160c77-5c68-4fe7-8922-8b4a04a3bf12 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:24.044000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-cf160c77-5c68-4fe7-8922-8b4a04a3bf12 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:22:24.045485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 565/1126] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:22:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:24.053488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21d7b9-977f-4ed7-8d8d-edd05532c1ac admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:24.064236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21d7b9-977f-4ed7-8d8d-edd05532c1ac admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:24.069207 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b726b42-2494-4f5b-a10e-4c73fae87779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:24.069876 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b726b42-2494-4f5b-a10e-4c73fae87779 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:24.070166 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b726b42-2494-4f5b-a10e-4c73fae87779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:24.070564 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b726b42-2494-4f5b-a10e-4c73fae87779 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:24.071386 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b726b42-2494-4f5b-a10e-4c73fae87779 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:24.071698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b726b42-2494-4f5b-a10e-4c73fae87779 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:24.073954 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b726b42-2494-4f5b-a10e-4c73fae87779 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:24.087535 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 562/1127] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:22:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:24.097363 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf160c77-5c68-4fe7-8922-8b4a04a3bf12 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:24.106621 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf160c77-5c68-4fe7-8922-8b4a04a3bf12 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:24.111225 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf7a97-3d28-40c5-89eb-761705711911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:24.112098 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7a97-3d28-40c5-89eb-761705711911 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:24.112387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7a97-3d28-40c5-89eb-761705711911 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:24.112666 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf7a97-3d28-40c5-89eb-761705711911 admin admin] PATH_INFO: `/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/678965f2159e4c33bf2465058f69ff02/roles/de4c885bb354403b98a2f1aefb43754e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:24.126944 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf7a97-3d28-40c5-89eb-761705711911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce43bc1cdb744a2b2c65dd4c50d6599, user_id=678965f2159e4c33bf2465058f69ff02, role_id=de4c885bb354403b98a2f1aefb43754e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:24.129631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf7a97-3d28-40c5-89eb-761705711911 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:24.142969 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 566/1128] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:22:24 2021] PUT /identity/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/678965f2159e4c33bf2465058f69ff02/roles/de4c885bb354403b98a2f1aefb43754e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:22:26.377994 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61edfd-5d34-42da-8283-e060d1e7e669 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:26.378575 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61edfd-5d34-42da-8283-e060d1e7e669 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:26.378575 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61edfd-5d34-42da-8283-e060d1e7e669 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:26.380461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 563/1129] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:22:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:22:26.388245 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40cc01-5629-4b89-a12b-ea0b51371c81 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:26.388717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40cc01-5629-4b89-a12b-ea0b51371c81 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:26.388862 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40cc01-5629-4b89-a12b-ea0b51371c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:26.409479 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-db40cc01-5629-4b89-a12b-ea0b51371c81 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:22:26.411212 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-db40cc01-5629-4b89-a12b-ea0b51371c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:22:26.476299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 567/1130] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:22:26 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:22:26.505666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61edfd-5d34-42da-8283-e060d1e7e669 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:26.521173 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61edfd-5d34-42da-8283-e060d1e7e669 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:26.527762 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e594eb-ce82-49e5-944f-9c451e6127f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:26.528728 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e594eb-ce82-49e5-944f-9c451e6127f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:26.529164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e594eb-ce82-49e5-944f-9c451e6127f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:26.529529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e594eb-ce82-49e5-944f-9c451e6127f0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:26.542761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e594eb-ce82-49e5-944f-9c451e6127f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:22:26.551216 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-f0e594eb-ce82-49e5-944f-9c451e6127f0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 00:22:26.552443 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 564/1131] 10.222.0.50 () {56 vars in 1123 bytes} [Tue Nov 16 00:22:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:22:26.560283 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40cc01-5629-4b89-a12b-ea0b51371c81 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:26.570020 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40cc01-5629-4b89-a12b-ea0b51371c81 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:26.575017 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449b1ce-736b-4b05-baa4-39bd350c4ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:26.575820 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449b1ce-736b-4b05-baa4-39bd350c4ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:26.576096 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449b1ce-736b-4b05-baa4-39bd350c4ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:26.576385 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449b1ce-736b-4b05-baa4-39bd350c4ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:26.577250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449b1ce-736b-4b05-baa4-39bd350c4ab5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:26.577542 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449b1ce-736b-4b05-baa4-39bd350c4ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:26.579453 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449b1ce-736b-4b05-baa4-39bd350c4ab5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:26.588505 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 568/1132] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Nov 16 00:22:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:26.596974 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e594eb-ce82-49e5-944f-9c451e6127f0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:26.609727 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e594eb-ce82-49e5-944f-9c451e6127f0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:26.615404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d06668-93c2-41a9-a8e0-9436c39e9150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:26.616388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d06668-93c2-41a9-a8e0-9436c39e9150 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:26.616672 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d06668-93c2-41a9-a8e0-9436c39e9150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:26.617068 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d06668-93c2-41a9-a8e0-9436c39e9150 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:26.630224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d06668-93c2-41a9-a8e0-9436c39e9150 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:26.632161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d06668-93c2-41a9-a8e0-9436c39e9150 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:26.652986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-95d06668-93c2-41a9-a8e0-9436c39e9150 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:22:26.654475 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 565/1133] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:26.662520 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449b1ce-736b-4b05-baa4-39bd350c4ab5 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:26.673533 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449b1ce-736b-4b05-baa4-39bd350c4ab5 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:26.678772 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac7a7a-db82-4fd8-b136-e72aae938356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:26.679657 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac7a7a-db82-4fd8-b136-e72aae938356 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:26.680008 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac7a7a-db82-4fd8-b136-e72aae938356 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:26.680400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac7a7a-db82-4fd8-b136-e72aae938356 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:26.681250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac7a7a-db82-4fd8-b136-e72aae938356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:26.681566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac7a7a-db82-4fd8-b136-e72aae938356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:26.683496 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac7a7a-db82-4fd8-b136-e72aae938356 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:26.697416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 569/1134] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:22:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:26.704484 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d06668-93c2-41a9-a8e0-9436c39e9150 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:26.715527 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d06668-93c2-41a9-a8e0-9436c39e9150 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:26.721729 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541afe9-2fcb-40d9-8a0c-4ca16f6d4440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:26.722532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541afe9-2fcb-40d9-8a0c-4ca16f6d4440 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:26.722843 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541afe9-2fcb-40d9-8a0c-4ca16f6d4440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:26.723183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541afe9-2fcb-40d9-8a0c-4ca16f6d4440 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:26.731554 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541afe9-2fcb-40d9-8a0c-4ca16f6d4440 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:26.733727 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541afe9-2fcb-40d9-8a0c-4ca16f6d4440 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:26.748660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-d541afe9-2fcb-40d9-8a0c-4ca16f6d4440 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 16 00:22:26.749928 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 566/1135] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:26 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:26.756942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac7a7a-db82-4fd8-b136-e72aae938356 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:26.769240 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac7a7a-db82-4fd8-b136-e72aae938356 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:26.774142 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bc4c7-30a9-4878-9f0e-5e95e19e2059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:26.774903 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bc4c7-30a9-4878-9f0e-5e95e19e2059 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:26.775249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bc4c7-30a9-4878-9f0e-5e95e19e2059 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:26.775516 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bc4c7-30a9-4878-9f0e-5e95e19e2059 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:26.776415 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bc4c7-30a9-4878-9f0e-5e95e19e2059 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:26.776727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bc4c7-30a9-4878-9f0e-5e95e19e2059 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:26.778570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bc4c7-30a9-4878-9f0e-5e95e19e2059 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:26.798391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 570/1136] 10.222.0.50 () {56 vars in 1164 bytes} [Tue Nov 16 00:22:26 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:22:26.805751 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541afe9-2fcb-40d9-8a0c-4ca16f6d4440 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:26.816854 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541afe9-2fcb-40d9-8a0c-4ca16f6d4440 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:26.821933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f80b3-e459-4c54-a065-67b3cb54ff3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:26.822570 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f80b3-e459-4c54-a065-67b3cb54ff3d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:26.822937 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f80b3-e459-4c54-a065-67b3cb54ff3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:26.823165 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f80b3-e459-4c54-a065-67b3cb54ff3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:26.831914 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f80b3-e459-4c54-a065-67b3cb54ff3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:26.833656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f80b3-e459-4c54-a065-67b3cb54ff3d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:26.843288 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 567/1137] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:22:26 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:22:26.850101 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bc4c7-30a9-4878-9f0e-5e95e19e2059 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:26.859952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bc4c7-30a9-4878-9f0e-5e95e19e2059 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:26.864489 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb352a-a6ef-42de-8a6e-857a33301555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:26.865282 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb352a-a6ef-42de-8a6e-857a33301555 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:26.865571 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb352a-a6ef-42de-8a6e-857a33301555 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:26.865853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb352a-a6ef-42de-8a6e-857a33301555 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:26.875921 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb352a-a6ef-42de-8a6e-857a33301555 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:26.877763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb352a-a6ef-42de-8a6e-857a33301555 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:26.896128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-c1bb352a-a6ef-42de-8a6e-857a33301555 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:22:26.897335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 571/1138] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:26.904000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f80b3-e459-4c54-a065-67b3cb54ff3d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:26.913975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f80b3-e459-4c54-a065-67b3cb54ff3d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:26.918962 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51560929-ed34-464e-aeef-4b4534ee9f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:26.919760 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51560929-ed34-464e-aeef-4b4534ee9f93 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:26.920027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51560929-ed34-464e-aeef-4b4534ee9f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:26.920342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51560929-ed34-464e-aeef-4b4534ee9f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:26.921287 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51560929-ed34-464e-aeef-4b4534ee9f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:26.921552 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51560929-ed34-464e-aeef-4b4534ee9f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:26.923379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51560929-ed34-464e-aeef-4b4534ee9f93 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:26.936073 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 568/1139] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:22:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:26.943636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb352a-a6ef-42de-8a6e-857a33301555 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:26.955676 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb352a-a6ef-42de-8a6e-857a33301555 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:26.961966 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4f71-9154-4252-b5e5-0ab554a4d7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:26.963093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4f71-9154-4252-b5e5-0ab554a4d7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:26.963420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4f71-9154-4252-b5e5-0ab554a4d7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:26.963853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4f71-9154-4252-b5e5-0ab554a4d7a0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:26.973768 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da4f71-9154-4252-b5e5-0ab554a4d7a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:26.976203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da4f71-9154-4252-b5e5-0ab554a4d7a0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:26.991864 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-07da4f71-9154-4252-b5e5-0ab554a4d7a0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:22:26.993173 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 572/1140] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:22:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:27.001173 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51560929-ed34-464e-aeef-4b4534ee9f93 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:27.011532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51560929-ed34-464e-aeef-4b4534ee9f93 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:27.017120 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722b46d-98ec-4902-bac6-f4087339910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:27.017783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722b46d-98ec-4902-bac6-f4087339910c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:27.018143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722b46d-98ec-4902-bac6-f4087339910c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:27.018542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722b46d-98ec-4902-bac6-f4087339910c admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:27.019525 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722b46d-98ec-4902-bac6-f4087339910c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:27.019874 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722b46d-98ec-4902-bac6-f4087339910c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:27.021913 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722b46d-98ec-4902-bac6-f4087339910c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:27.034990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 569/1141] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:22:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:22:27.041761 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4f71-9154-4252-b5e5-0ab554a4d7a0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:27.053895 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4f71-9154-4252-b5e5-0ab554a4d7a0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:27.058560 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd456dd3-919b-4861-8f76-9e49493c0106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:27.059259 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456dd3-919b-4861-8f76-9e49493c0106 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:27.059547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456dd3-919b-4861-8f76-9e49493c0106 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:27.059799 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456dd3-919b-4861-8f76-9e49493c0106 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:27.060619 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd456dd3-919b-4861-8f76-9e49493c0106 admin admin] RBAC: Adding query filter params (role.id=de4c885bb354403b98a2f1aefb43754e, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=678965f2159e4c33bf2465058f69ff02) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:27.060931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd456dd3-919b-4861-8f76-9e49493c0106 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:27.063349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd456dd3-919b-4861-8f76-9e49493c0106 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:27.069179 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 573/1142] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:22:27 2021] GET /identity/v3/role_assignments?user.id=678965f2159e4c33bf2465058f69ff02&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=de4c885bb354403b98a2f1aefb43754e => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:22:29.401079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244ef76-eeb6-4ada-8a33-6f621cb1e0df None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:29.401681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244ef76-eeb6-4ada-8a33-6f621cb1e0df None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:29.401681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244ef76-eeb6-4ada-8a33-6f621cb1e0df None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:29.403536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 570/1143] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:22:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:22:29.412630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c98f0-d728-42fa-a64e-3243a9d14f51 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:29.413149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c98f0-d728-42fa-a64e-3243a9d14f51 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:29.413236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c98f0-d728-42fa-a64e-3243a9d14f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:29.432203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-187c98f0-d728-42fa-a64e-3243a9d14f51 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:22:29.433528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-187c98f0-d728-42fa-a64e-3243a9d14f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:22:29.442994 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 574/1144] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:22:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:22:29.473199 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244ef76-eeb6-4ada-8a33-6f621cb1e0df None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:29.487432 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244ef76-eeb6-4ada-8a33-6f621cb1e0df None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:29.491755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d12f7-58bc-4d23-a9ef-c48c1f79f7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:29.492528 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d12f7-58bc-4d23-a9ef-c48c1f79f7ae admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:29.492810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d12f7-58bc-4d23-a9ef-c48c1f79f7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:29.493085 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d12f7-58bc-4d23-a9ef-c48c1f79f7ae admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:29.504331 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d12f7-58bc-4d23-a9ef-c48c1f79f7ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:22:29.511470 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-319d12f7-58bc-4d23-a9ef-c48c1f79f7ae admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:22:29.513105 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 571/1145] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:22:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:22:29.520670 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c98f0-d728-42fa-a64e-3243a9d14f51 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:29.530562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c98f0-d728-42fa-a64e-3243a9d14f51 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:29.535532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63027adf-5d94-4f4f-b444-6639b4dd9008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:29.536213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63027adf-5d94-4f4f-b444-6639b4dd9008 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:29.536481 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63027adf-5d94-4f4f-b444-6639b4dd9008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:29.536759 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63027adf-5d94-4f4f-b444-6639b4dd9008 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:29.537513 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63027adf-5d94-4f4f-b444-6639b4dd9008 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:29.537821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63027adf-5d94-4f4f-b444-6639b4dd9008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:29.539454 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63027adf-5d94-4f4f-b444-6639b4dd9008 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:29.549043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 575/1146] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:22:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:29.555750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d12f7-58bc-4d23-a9ef-c48c1f79f7ae admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:29.567579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d12f7-58bc-4d23-a9ef-c48c1f79f7ae admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:29.572789 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919367d-019d-4fc4-aca0-8f3d624a1970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:29.573668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919367d-019d-4fc4-aca0-8f3d624a1970 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:29.573950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919367d-019d-4fc4-aca0-8f3d624a1970 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:29.574288 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919367d-019d-4fc4-aca0-8f3d624a1970 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:29.585407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919367d-019d-4fc4-aca0-8f3d624a1970 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:29.587316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919367d-019d-4fc4-aca0-8f3d624a1970 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:29.607862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-2919367d-019d-4fc4-aca0-8f3d624a1970 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:22:29.610277 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 572/1147] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:29.616601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63027adf-5d94-4f4f-b444-6639b4dd9008 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:29.628131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63027adf-5d94-4f4f-b444-6639b4dd9008 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:29.633804 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0d64e-dd96-4e99-a70d-8b21b0eefbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:29.634623 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0d64e-dd96-4e99-a70d-8b21b0eefbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:29.635007 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0d64e-dd96-4e99-a70d-8b21b0eefbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:29.635288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0d64e-dd96-4e99-a70d-8b21b0eefbc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:29.636043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0d64e-dd96-4e99-a70d-8b21b0eefbc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:29.636353 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0d64e-dd96-4e99-a70d-8b21b0eefbc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:29.638074 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0d64e-dd96-4e99-a70d-8b21b0eefbc0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:29.652008 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 576/1148] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:22:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:29.658906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919367d-019d-4fc4-aca0-8f3d624a1970 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:29.669246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919367d-019d-4fc4-aca0-8f3d624a1970 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:29.674047 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656238f-6472-4870-9a47-97080c840387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:29.674859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656238f-6472-4870-9a47-97080c840387 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:29.675219 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656238f-6472-4870-9a47-97080c840387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:29.675498 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656238f-6472-4870-9a47-97080c840387 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:29.683725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656238f-6472-4870-9a47-97080c840387 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:29.685969 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656238f-6472-4870-9a47-97080c840387 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:29.702701 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-e656238f-6472-4870-9a47-97080c840387 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 16 00:22:29.704100 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 573/1149] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:29 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:29.711270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0d64e-dd96-4e99-a70d-8b21b0eefbc0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:29.724075 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0d64e-dd96-4e99-a70d-8b21b0eefbc0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:29.733209 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24b7e1-ee6c-42e1-880d-622d06cb16ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:29.734296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24b7e1-ee6c-42e1-880d-622d06cb16ab admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:29.734590 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24b7e1-ee6c-42e1-880d-622d06cb16ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:29.734897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24b7e1-ee6c-42e1-880d-622d06cb16ab admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:29.735745 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24b7e1-ee6c-42e1-880d-622d06cb16ab admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:29.736061 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24b7e1-ee6c-42e1-880d-622d06cb16ab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:29.738644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24b7e1-ee6c-42e1-880d-622d06cb16ab admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:29.758445 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 577/1150] 10.222.0.50 () {56 vars in 1164 bytes} [Tue Nov 16 00:22:29 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:29.765504 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656238f-6472-4870-9a47-97080c840387 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:29.776407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656238f-6472-4870-9a47-97080c840387 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:29.782596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fb2a0-fe70-47fc-b21d-3b76c2f9f549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:29.783367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fb2a0-fe70-47fc-b21d-3b76c2f9f549 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:29.783726 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fb2a0-fe70-47fc-b21d-3b76c2f9f549 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:29.784080 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fb2a0-fe70-47fc-b21d-3b76c2f9f549 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:29.792494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fb2a0-fe70-47fc-b21d-3b76c2f9f549 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:29.794296 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fb2a0-fe70-47fc-b21d-3b76c2f9f549 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:29.806473 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 574/1151] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:22:29 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:22:29.814166 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24b7e1-ee6c-42e1-880d-622d06cb16ab admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:29.824583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24b7e1-ee6c-42e1-880d-622d06cb16ab admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:29.830078 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2b514-9090-4753-85ea-a434db7b073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:29.830964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b514-9090-4753-85ea-a434db7b073a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:29.831253 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b514-9090-4753-85ea-a434db7b073a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:29.831531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b514-9090-4753-85ea-a434db7b073a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:29.841884 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2b514-9090-4753-85ea-a434db7b073a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:29.844314 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2b514-9090-4753-85ea-a434db7b073a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:29.863029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-acc2b514-9090-4753-85ea-a434db7b073a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:22:29.864208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 578/1152] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:29.870692 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fb2a0-fe70-47fc-b21d-3b76c2f9f549 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:29.880258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fb2a0-fe70-47fc-b21d-3b76c2f9f549 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:29.885587 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61eca3-74af-4e32-ac9e-349c49bd42de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:29.886386 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61eca3-74af-4e32-ac9e-349c49bd42de admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:29.886782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61eca3-74af-4e32-ac9e-349c49bd42de admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:29.887147 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61eca3-74af-4e32-ac9e-349c49bd42de admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:29.888049 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61eca3-74af-4e32-ac9e-349c49bd42de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:29.888411 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61eca3-74af-4e32-ac9e-349c49bd42de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:29.891075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61eca3-74af-4e32-ac9e-349c49bd42de admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:29.903445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 575/1153] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:22:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:29.910428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2b514-9090-4753-85ea-a434db7b073a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:29.920106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2b514-9090-4753-85ea-a434db7b073a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:29.925039 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addc691-9c6c-41f8-acea-3c7b70c244be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:29.925827 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addc691-9c6c-41f8-acea-3c7b70c244be admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:29.926112 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addc691-9c6c-41f8-acea-3c7b70c244be admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:29.926454 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addc691-9c6c-41f8-acea-3c7b70c244be admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:29.934154 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addc691-9c6c-41f8-acea-3c7b70c244be admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:29.936281 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addc691-9c6c-41f8-acea-3c7b70c244be admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:29.949632 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-5addc691-9c6c-41f8-acea-3c7b70c244be admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:22:29.950868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 579/1154] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:22:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:22:29.958122 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61eca3-74af-4e32-ac9e-349c49bd42de admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:29.969343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61eca3-74af-4e32-ac9e-349c49bd42de admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:29.974496 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1a7ad-7cdb-4000-8483-6d7864e01dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:29.975197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1a7ad-7cdb-4000-8483-6d7864e01dbf admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:29.975507 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1a7ad-7cdb-4000-8483-6d7864e01dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:29.976524 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1a7ad-7cdb-4000-8483-6d7864e01dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:29.976524 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1a7ad-7cdb-4000-8483-6d7864e01dbf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:29.976889 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1a7ad-7cdb-4000-8483-6d7864e01dbf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:29.978891 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1a7ad-7cdb-4000-8483-6d7864e01dbf admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:29.992362 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 576/1155] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:22:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:30.000972 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addc691-9c6c-41f8-acea-3c7b70c244be admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:30.013073 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addc691-9c6c-41f8-acea-3c7b70c244be admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:30.018746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aeb362-b670-4a8c-936c-eea9539a8979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:30.019521 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aeb362-b670-4a8c-936c-eea9539a8979 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:30.019805 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aeb362-b670-4a8c-936c-eea9539a8979 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:30.020083 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aeb362-b670-4a8c-936c-eea9539a8979 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:30.020982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aeb362-b670-4a8c-936c-eea9539a8979 admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=678965f2159e4c33bf2465058f69ff02) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:30.021367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aeb362-b670-4a8c-936c-eea9539a8979 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:30.023340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aeb362-b670-4a8c-936c-eea9539a8979 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:30.029659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 580/1156] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:22:29 2021] GET /identity/v3/role_assignments?user.id=678965f2159e4c33bf2465058f69ff02&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=2813231cc8954b998440e4bf5ede2945 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:22:32.388838 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aafaeb-8469-4f77-8180-4d897cf8c2e8 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:32.389561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aafaeb-8469-4f77-8180-4d897cf8c2e8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:32.389561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aafaeb-8469-4f77-8180-4d897cf8c2e8 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:32.391442 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 577/1157] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:22:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:22:32.399438 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2b38-f276-478d-9bf0-96f7e52952ef None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:32.399903 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2b38-f276-478d-9bf0-96f7e52952ef None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:32.400012 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2b38-f276-478d-9bf0-96f7e52952ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:32.420106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-23ae2b38-f276-478d-9bf0-96f7e52952ef None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:22:32.422463 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-23ae2b38-f276-478d-9bf0-96f7e52952ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:22:32.433836 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 581/1158] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:22:32 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:22:32.460687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aafaeb-8469-4f77-8180-4d897cf8c2e8 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:32.474362 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aafaeb-8469-4f77-8180-4d897cf8c2e8 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:32.479013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19305aa6-d977-4305-9821-248f89168d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:32.479780 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19305aa6-d977-4305-9821-248f89168d1d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:32.480058 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19305aa6-d977-4305-9821-248f89168d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:32.480360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19305aa6-d977-4305-9821-248f89168d1d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:32.494126 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19305aa6-d977-4305-9821-248f89168d1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:22:32.502422 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-19305aa6-d977-4305-9821-248f89168d1d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:22:32.509547 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 578/1159] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:22:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:32.511525 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae2b38-f276-478d-9bf0-96f7e52952ef None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:32.522093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae2b38-f276-478d-9bf0-96f7e52952ef None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:32.527752 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff15826-a006-4e05-8a33-f52c471c0265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:32.528419 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff15826-a006-4e05-8a33-f52c471c0265 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:32.528710 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff15826-a006-4e05-8a33-f52c471c0265 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:32.529117 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff15826-a006-4e05-8a33-f52c471c0265 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:32.530739 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff15826-a006-4e05-8a33-f52c471c0265 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:32.531283 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff15826-a006-4e05-8a33-f52c471c0265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:32.533355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff15826-a006-4e05-8a33-f52c471c0265 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:32.544726 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 582/1160] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:22:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:32.552569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19305aa6-d977-4305-9821-248f89168d1d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:32.566128 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19305aa6-d977-4305-9821-248f89168d1d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:32.571234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0acdc-870f-475e-b9b3-3729c85b5a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:32.572136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0acdc-870f-475e-b9b3-3729c85b5a3e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:32.572423 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0acdc-870f-475e-b9b3-3729c85b5a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:32.572698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0acdc-870f-475e-b9b3-3729c85b5a3e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:32.583824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0acdc-870f-475e-b9b3-3729c85b5a3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:32.585759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0acdc-870f-475e-b9b3-3729c85b5a3e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:32.605935 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-d2a0acdc-870f-475e-b9b3-3729c85b5a3e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:22:32.607274 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 579/1161] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:32.614543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff15826-a006-4e05-8a33-f52c471c0265 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:32.626038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff15826-a006-4e05-8a33-f52c471c0265 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:32.632054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39a38a-ced4-4645-8253-813b5660ae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:32.632840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39a38a-ced4-4645-8253-813b5660ae88 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:32.633189 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39a38a-ced4-4645-8253-813b5660ae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:32.633514 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39a38a-ced4-4645-8253-813b5660ae88 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:32.634581 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39a38a-ced4-4645-8253-813b5660ae88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:32.634983 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39a38a-ced4-4645-8253-813b5660ae88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:32.636650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39a38a-ced4-4645-8253-813b5660ae88 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:32.653933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 583/1162] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:22:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:22:32.661425 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0acdc-870f-475e-b9b3-3729c85b5a3e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:32.673002 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0acdc-870f-475e-b9b3-3729c85b5a3e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:32.678418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848c950-2754-4a9a-a178-46165220f0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:32.679351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848c950-2754-4a9a-a178-46165220f0ee admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:32.679637 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848c950-2754-4a9a-a178-46165220f0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:32.679917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848c950-2754-4a9a-a178-46165220f0ee admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:32.687844 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848c950-2754-4a9a-a178-46165220f0ee admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:32.689883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848c950-2754-4a9a-a178-46165220f0ee admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:32.706397 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-9848c950-2754-4a9a-a178-46165220f0ee admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 16 00:22:32.707585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 580/1163] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:32 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:32.716821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39a38a-ced4-4645-8253-813b5660ae88 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:32.729426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39a38a-ced4-4645-8253-813b5660ae88 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:32.736364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5a9c4-52a3-4edf-a622-53de5e7da366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:32.736641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5a9c4-52a3-4edf-a622-53de5e7da366 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:32.736993 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5a9c4-52a3-4edf-a622-53de5e7da366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:32.737329 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5a9c4-52a3-4edf-a622-53de5e7da366 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:32.738395 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5a9c4-52a3-4edf-a622-53de5e7da366 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:32.738785 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5a9c4-52a3-4edf-a622-53de5e7da366 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:32.740982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5a9c4-52a3-4edf-a622-53de5e7da366 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:32.759853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 584/1164] 10.222.0.50 () {56 vars in 1164 bytes} [Tue Nov 16 00:22:32 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:22:32.767194 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848c950-2754-4a9a-a178-46165220f0ee admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:32.776719 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848c950-2754-4a9a-a178-46165220f0ee admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:32.782737 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1a27e-bb6e-4dd3-978b-f9125ebc893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:32.783544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1a27e-bb6e-4dd3-978b-f9125ebc893d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:32.783827 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1a27e-bb6e-4dd3-978b-f9125ebc893d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:32.784106 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1a27e-bb6e-4dd3-978b-f9125ebc893d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:32.794374 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1a27e-bb6e-4dd3-978b-f9125ebc893d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:32.797001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1a27e-bb6e-4dd3-978b-f9125ebc893d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:32.817388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-c5c1a27e-bb6e-4dd3-978b-f9125ebc893d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:22:32.818821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 581/1165] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:32.825501 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5a9c4-52a3-4edf-a622-53de5e7da366 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:32.836612 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5a9c4-52a3-4edf-a622-53de5e7da366 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:32.841666 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b442c-0c45-4c6f-bc1e-9054328515a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:32.843063 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b442c-0c45-4c6f-bc1e-9054328515a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:32.843715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b442c-0c45-4c6f-bc1e-9054328515a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:32.843999 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b442c-0c45-4c6f-bc1e-9054328515a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:32.844723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b442c-0c45-4c6f-bc1e-9054328515a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:32.845033 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b442c-0c45-4c6f-bc1e-9054328515a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:32.846920 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b442c-0c45-4c6f-bc1e-9054328515a8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:32.858959 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 585/1166] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:22:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:32.865258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1a27e-bb6e-4dd3-978b-f9125ebc893d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:32.875658 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1a27e-bb6e-4dd3-978b-f9125ebc893d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:32.880829 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133b9bb-fcb1-41b1-a622-64f23f442b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:32.881607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133b9bb-fcb1-41b1-a622-64f23f442b54 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:32.881891 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133b9bb-fcb1-41b1-a622-64f23f442b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:32.882168 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133b9bb-fcb1-41b1-a622-64f23f442b54 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:32.889688 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133b9bb-fcb1-41b1-a622-64f23f442b54 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:32.891846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133b9bb-fcb1-41b1-a622-64f23f442b54 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:32.906587 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-b133b9bb-fcb1-41b1-a622-64f23f442b54 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:22:32.907786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 582/1167] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:22:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:32.914207 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b442c-0c45-4c6f-bc1e-9054328515a8 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:32.925440 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b442c-0c45-4c6f-bc1e-9054328515a8 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:32.932029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64d75b-0e68-4325-8d24-02e85b450c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:32.934434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64d75b-0e68-4325-8d24-02e85b450c70 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:32.934773 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64d75b-0e68-4325-8d24-02e85b450c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:32.935103 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64d75b-0e68-4325-8d24-02e85b450c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:32.935981 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64d75b-0e68-4325-8d24-02e85b450c70 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:32.936355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64d75b-0e68-4325-8d24-02e85b450c70 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:32.938316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64d75b-0e68-4325-8d24-02e85b450c70 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:32.962916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 586/1168] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:22:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:32.964277 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133b9bb-fcb1-41b1-a622-64f23f442b54 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:32.977782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133b9bb-fcb1-41b1-a622-64f23f442b54 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:32.984148 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c49f3-83d6-4778-9856-186ccb3e37db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:32.985218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c49f3-83d6-4778-9856-186ccb3e37db admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:32.985396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c49f3-83d6-4778-9856-186ccb3e37db admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:32.985679 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c49f3-83d6-4778-9856-186ccb3e37db admin admin] PATH_INFO: `/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/678965f2159e4c33bf2465058f69ff02/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:32.988156 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c49f3-83d6-4778-9856-186ccb3e37db admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce43bc1cdb744a2b2c65dd4c50d6599, user_id=678965f2159e4c33bf2465058f69ff02, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:32.991343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c49f3-83d6-4778-9856-186ccb3e37db admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:33.007500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 583/1169] 10.222.0.50 () {58 vars in 1460 bytes} [Tue Nov 16 00:22:32 2021] PUT /identity/v3/projects/cce43bc1cdb744a2b2c65dd4c50d6599/users/678965f2159e4c33bf2465058f69ff02/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:22:35.192282 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5875-d48e-4687-a6b0-9f10e1f44f2e None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:35.192804 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5875-d48e-4687-a6b0-9f10e1f44f2e None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:35.192804 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5875-d48e-4687-a6b0-9f10e1f44f2e None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:35.194531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 587/1170] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:22:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:22:35.201376 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837f3f8-a6fb-4155-8c3d-8473b0732719 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:35.202341 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837f3f8-a6fb-4155-8c3d-8473b0732719 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:35.202485 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837f3f8-a6fb-4155-8c3d-8473b0732719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:35.219548 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-5837f3f8-a6fb-4155-8c3d-8473b0732719 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:22:35.220714 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-5837f3f8-a6fb-4155-8c3d-8473b0732719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:22:35.275611 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 584/1171] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:22:35 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:22:35.299826 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb5875-d48e-4687-a6b0-9f10e1f44f2e None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:35.312303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb5875-d48e-4687-a6b0-9f10e1f44f2e None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:35.316673 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00412ab7-8ec1-4ebd-83e6-d89c28de7415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:35.317443 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412ab7-8ec1-4ebd-83e6-d89c28de7415 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:35.317725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412ab7-8ec1-4ebd-83e6-d89c28de7415 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:35.318003 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412ab7-8ec1-4ebd-83e6-d89c28de7415 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:35.327989 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00412ab7-8ec1-4ebd-83e6-d89c28de7415 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 00:22:35.334626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-00412ab7-8ec1-4ebd-83e6-d89c28de7415 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 00:22:35.335782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 588/1172] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Nov 16 00:22:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:35.341839 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837f3f8-a6fb-4155-8c3d-8473b0732719 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:35.351290 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837f3f8-a6fb-4155-8c3d-8473b0732719 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:35.355778 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72206c-f977-48f5-8583-b2d3596d657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:35.356420 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72206c-f977-48f5-8583-b2d3596d657f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:35.356703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72206c-f977-48f5-8583-b2d3596d657f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:35.356978 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72206c-f977-48f5-8583-b2d3596d657f admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:35.357708 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72206c-f977-48f5-8583-b2d3596d657f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:35.358569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72206c-f977-48f5-8583-b2d3596d657f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:35.360325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72206c-f977-48f5-8583-b2d3596d657f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:35.368267 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 585/1173] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Nov 16 00:22:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:35.374794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00412ab7-8ec1-4ebd-83e6-d89c28de7415 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:35.384580 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00412ab7-8ec1-4ebd-83e6-d89c28de7415 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:35.389079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486af116-f046-46a7-8360-9e7ca345f600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:35.390174 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486af116-f046-46a7-8360-9e7ca345f600 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:35.390467 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486af116-f046-46a7-8360-9e7ca345f600 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:35.390745 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486af116-f046-46a7-8360-9e7ca345f600 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:35.400801 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486af116-f046-46a7-8360-9e7ca345f600 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:35.402651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486af116-f046-46a7-8360-9e7ca345f600 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:35.419042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-486af116-f046-46a7-8360-9e7ca345f600 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:22:35.420168 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 589/1174] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:35.426918 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72206c-f977-48f5-8583-b2d3596d657f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:35.436893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72206c-f977-48f5-8583-b2d3596d657f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:35.441432 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359c68f-fcc5-4635-88dc-35de93a21435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:35.442066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359c68f-fcc5-4635-88dc-35de93a21435 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:35.442398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359c68f-fcc5-4635-88dc-35de93a21435 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:35.442626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359c68f-fcc5-4635-88dc-35de93a21435 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:35.443372 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359c68f-fcc5-4635-88dc-35de93a21435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:35.443678 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359c68f-fcc5-4635-88dc-35de93a21435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:35.445239 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359c68f-fcc5-4635-88dc-35de93a21435 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:35.456578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 586/1175] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:22:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:22:35.462479 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486af116-f046-46a7-8360-9e7ca345f600 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:35.472068 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486af116-f046-46a7-8360-9e7ca345f600 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:35.476477 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855056f-4aa9-4afb-8c29-80137ecc6fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:35.477239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855056f-4aa9-4afb-8c29-80137ecc6fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:35.477517 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855056f-4aa9-4afb-8c29-80137ecc6fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:35.477788 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855056f-4aa9-4afb-8c29-80137ecc6fd4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:35.485536 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855056f-4aa9-4afb-8c29-80137ecc6fd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:35.487546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855056f-4aa9-4afb-8c29-80137ecc6fd4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:35.501618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-7855056f-4aa9-4afb-8c29-80137ecc6fd4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 16 00:22:35.502700 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 590/1176] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:35 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 00:22:35.508674 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359c68f-fcc5-4635-88dc-35de93a21435 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:35.518120 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359c68f-fcc5-4635-88dc-35de93a21435 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:35.522660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2934a96-6fe8-4f22-a35c-85d6a6fb5b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:35.523352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2934a96-6fe8-4f22-a35c-85d6a6fb5b4f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:35.523642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2934a96-6fe8-4f22-a35c-85d6a6fb5b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:35.523924 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2934a96-6fe8-4f22-a35c-85d6a6fb5b4f admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:35.524751 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2934a96-6fe8-4f22-a35c-85d6a6fb5b4f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:35.525063 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2934a96-6fe8-4f22-a35c-85d6a6fb5b4f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:35.526905 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2934a96-6fe8-4f22-a35c-85d6a6fb5b4f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:35.543732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 587/1177] 10.222.0.50 () {56 vars in 1164 bytes} [Tue Nov 16 00:22:35 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:35.550294 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855056f-4aa9-4afb-8c29-80137ecc6fd4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:35.559499 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855056f-4aa9-4afb-8c29-80137ecc6fd4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:35.564569 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e5221-c639-47e6-ab2c-cb05dacdbc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:35.565183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e5221-c639-47e6-ab2c-cb05dacdbc78 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:35.565463 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e5221-c639-47e6-ab2c-cb05dacdbc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:35.565736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e5221-c639-47e6-ab2c-cb05dacdbc78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:35.573173 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e5221-c639-47e6-ab2c-cb05dacdbc78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:35.574902 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e5221-c639-47e6-ab2c-cb05dacdbc78 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:35.583524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 591/1178] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Nov 16 00:22:35 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:22:35.589306 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2934a96-6fe8-4f22-a35c-85d6a6fb5b4f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:35.598804 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2934a96-6fe8-4f22-a35c-85d6a6fb5b4f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:35.603345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03a87-22b6-467f-a70a-c5609510bdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:35.604102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03a87-22b6-467f-a70a-c5609510bdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:35.604391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03a87-22b6-467f-a70a-c5609510bdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:35.604669 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03a87-22b6-467f-a70a-c5609510bdf8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:35.615071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03a87-22b6-467f-a70a-c5609510bdf8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:35.616882 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03a87-22b6-467f-a70a-c5609510bdf8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:35.633579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-24a03a87-22b6-467f-a70a-c5609510bdf8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 00:22:35.634686 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 588/1179] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Nov 16 00:22:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:35.640493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e5221-c639-47e6-ab2c-cb05dacdbc78 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:35.648865 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e5221-c639-47e6-ab2c-cb05dacdbc78 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:35.653338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a3efd-b751-4eba-9213-f190fbd530c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:35.653955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a3efd-b751-4eba-9213-f190fbd530c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:35.654243 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a3efd-b751-4eba-9213-f190fbd530c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:35.654515 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a3efd-b751-4eba-9213-f190fbd530c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:35.655763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a3efd-b751-4eba-9213-f190fbd530c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:35.656060 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a3efd-b751-4eba-9213-f190fbd530c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:35.657599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a3efd-b751-4eba-9213-f190fbd530c7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:35.668407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 592/1180] 10.222.0.50 () {56 vars in 1130 bytes} [Tue Nov 16 00:22:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:35.674912 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03a87-22b6-467f-a70a-c5609510bdf8 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:35.684196 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03a87-22b6-467f-a70a-c5609510bdf8 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:35.688895 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e753d3f-a8fa-4ef5-86e4-1f592afaf266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:35.689645 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753d3f-a8fa-4ef5-86e4-1f592afaf266 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:35.689932 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753d3f-a8fa-4ef5-86e4-1f592afaf266 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:35.690212 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753d3f-a8fa-4ef5-86e4-1f592afaf266 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:35.696975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e753d3f-a8fa-4ef5-86e4-1f592afaf266 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:35.698853 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e753d3f-a8fa-4ef5-86e4-1f592afaf266 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:35.711644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING keystone.server.flask.application [None req-1e753d3f-a8fa-4ef5-86e4-1f592afaf266 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 00:22:35.712753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 589/1181] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Nov 16 00:22:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:35.719173 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a3efd-b751-4eba-9213-f190fbd530c7 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:35.728519 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a3efd-b751-4eba-9213-f190fbd530c7 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:35.733634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d357e97-ad49-43dc-8250-d0924a019087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:35.734256 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d357e97-ad49-43dc-8250-d0924a019087 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:35.734536 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d357e97-ad49-43dc-8250-d0924a019087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:35.734810 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d357e97-ad49-43dc-8250-d0924a019087 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:35.735602 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d357e97-ad49-43dc-8250-d0924a019087 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:35.735911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d357e97-ad49-43dc-8250-d0924a019087 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:35.737702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d357e97-ad49-43dc-8250-d0924a019087 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:35.749508 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 593/1182] 10.222.0.50 () {56 vars in 1169 bytes} [Tue Nov 16 00:22:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:35.755604 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e753d3f-a8fa-4ef5-86e4-1f592afaf266 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:35.766393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e753d3f-a8fa-4ef5-86e4-1f592afaf266 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:35.770961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd14f33-f129-4613-b83b-6b5b2c3d87ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:35.771584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14f33-f129-4613-b83b-6b5b2c3d87ea admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:35.771871 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14f33-f129-4613-b83b-6b5b2c3d87ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:35.772149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14f33-f129-4613-b83b-6b5b2c3d87ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:35.772963 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd14f33-f129-4613-b83b-6b5b2c3d87ea admin admin] RBAC: Adding query filter params (role.id=2813231cc8954b998440e4bf5ede2945, scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599, user.id=678965f2159e4c33bf2465058f69ff02) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:35.773277 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd14f33-f129-4613-b83b-6b5b2c3d87ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:35.775122 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd14f33-f129-4613-b83b-6b5b2c3d87ea admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:35.781360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 590/1183] 10.222.0.50 () {56 vars in 1395 bytes} [Tue Nov 16 00:22:35 2021] GET /identity/v3/role_assignments?user.id=678965f2159e4c33bf2465058f69ff02&scope.project.id=cce43bc1cdb744a2b2c65dd4c50d6599&role.id=2813231cc8954b998440e4bf5ede2945 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:37.984058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a50d-777b-4e49-842b-d2903d544606 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:37.984598 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a50d-777b-4e49-842b-d2903d544606 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:37.984760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a50d-777b-4e49-842b-d2903d544606 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:37.986790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 594/1184] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:22:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:22:37.995263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b11a9-e52b-4021-91a7-33f21cf93ca5 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:37.995834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b11a9-e52b-4021-91a7-33f21cf93ca5 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:37.995936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b11a9-e52b-4021-91a7-33f21cf93ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:38.015981 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7f2b11a9-e52b-4021-91a7-33f21cf93ca5 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:22:38.017149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7f2b11a9-e52b-4021-91a7-33f21cf93ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:22:38.024710 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 591/1185] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:22:37 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:22:38.049112 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2a50d-777b-4e49-842b-d2903d544606 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:38.061133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2a50d-777b-4e49-842b-d2903d544606 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:38.065599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfa4e1-4194-4f9d-a056-c43ec8e5d588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:38.066374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfa4e1-4194-4f9d-a056-c43ec8e5d588 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:38.066656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfa4e1-4194-4f9d-a056-c43ec8e5d588 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:38.066970 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfa4e1-4194-4f9d-a056-c43ec8e5d588 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:38.067620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfa4e1-4194-4f9d-a056-c43ec8e5d588 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:38.069202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfa4e1-4194-4f9d-a056-c43ec8e5d588 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:38.080117 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-b9cfa4e1-4194-4f9d-a056-c43ec8e5d588 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 16 00:22:38.081217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 595/1186] 10.222.0.50 () {56 vars in 1138 bytes} [Tue Nov 16 00:22:38 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:38.087579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b11a9-e52b-4021-91a7-33f21cf93ca5 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:38.097189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b11a9-e52b-4021-91a7-33f21cf93ca5 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:38.101666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71343ae-3f63-4cfd-9a2f-0314cbb26e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:38.102308 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71343ae-3f63-4cfd-9a2f-0314cbb26e0a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:38.102600 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71343ae-3f63-4cfd-9a2f-0314cbb26e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:38.102913 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71343ae-3f63-4cfd-9a2f-0314cbb26e0a admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:38.103648 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71343ae-3f63-4cfd-9a2f-0314cbb26e0a admin admin] RBAC: Adding query filter params (name=placement) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:38.103959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71343ae-3f63-4cfd-9a2f-0314cbb26e0a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:38.105535 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71343ae-3f63-4cfd-9a2f-0314cbb26e0a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:38.111188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 592/1187] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Nov 16 00:22:38 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:38.117070 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfa4e1-4194-4f9d-a056-c43ec8e5d588 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:38.126231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfa4e1-4194-4f9d-a056-c43ec8e5d588 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:38.130682 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadfb8a-b255-44c7-8e0a-1ebb6589c979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:38.131335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadfb8a-b255-44c7-8e0a-1ebb6589c979 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:38.131619 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadfb8a-b255-44c7-8e0a-1ebb6589c979 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:38.131897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadfb8a-b255-44c7-8e0a-1ebb6589c979 admin admin] PATH_INFO: `/v3/services` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:38.132584 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadfb8a-b255-44c7-8e0a-1ebb6589c979 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:38.132895 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadfb8a-b255-44c7-8e0a-1ebb6589c979 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:38.134430 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadfb8a-b255-44c7-8e0a-1ebb6589c979 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:38.138560 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 596/1188] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Nov 16 00:22:38 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:40.315869 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118f78b-0908-441e-ade8-e471f21f2376 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:40.316391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118f78b-0908-441e-ade8-e471f21f2376 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:40.316483 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118f78b-0908-441e-ade8-e471f21f2376 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:40.318205 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 593/1189] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:22:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:22:40.325299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebbc51-bdcb-45ea-b029-1f2084bc5d41 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:40.325703 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebbc51-bdcb-45ea-b029-1f2084bc5d41 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:40.325853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebbc51-bdcb-45ea-b029-1f2084bc5d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:40.345186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-83ebbc51-bdcb-45ea-b029-1f2084bc5d41 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:22:40.346614 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-83ebbc51-bdcb-45ea-b029-1f2084bc5d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:22:40.354102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 597/1190] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:22:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:22:40.377417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118f78b-0908-441e-ade8-e471f21f2376 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:40.389725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118f78b-0908-441e-ade8-e471f21f2376 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:40.394065 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6615c-e5f7-4fc4-a4de-8742dfbb788a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:40.394707 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6615c-e5f7-4fc4-a4de-8742dfbb788a admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:40.395028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6615c-e5f7-4fc4-a4de-8742dfbb788a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:40.395309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6615c-e5f7-4fc4-a4de-8742dfbb788a admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:40.396029 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6615c-e5f7-4fc4-a4de-8742dfbb788a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:40.397616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6615c-e5f7-4fc4-a4de-8742dfbb788a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:40.411148 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 594/1191] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Nov 16 00:22:40 2021] POST /identity/v3/services => generated 246 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:22:42.591355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8adacd-1442-47e7-a13e-4ecb0a10e814 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:42.591918 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8adacd-1442-47e7-a13e-4ecb0a10e814 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:42.592532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8adacd-1442-47e7-a13e-4ecb0a10e814 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:42.594327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 598/1192] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:22:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:22:42.601602 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807d4df-3411-40ea-95a4-d192c617d5a7 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:42.602001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807d4df-3411-40ea-95a4-d192c617d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:42.602168 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807d4df-3411-40ea-95a4-d192c617d5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:42.620197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0807d4df-3411-40ea-95a4-d192c617d5a7 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:22:42.621398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0807d4df-3411-40ea-95a4-d192c617d5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:22:42.637752 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 595/1193] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:22:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:22:42.662560 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8adacd-1442-47e7-a13e-4ecb0a10e814 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:42.674653 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8adacd-1442-47e7-a13e-4ecb0a10e814 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:42.679032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4169b-cb50-451d-bbce-ce33ac6af56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:42.679802 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4169b-cb50-451d-bbce-ce33ac6af56c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:42.680084 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4169b-cb50-451d-bbce-ce33ac6af56c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:42.680359 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4169b-cb50-451d-bbce-ce33ac6af56c admin admin] PATH_INFO: `/v3/services/placement` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:42.681002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4169b-cb50-451d-bbce-ce33ac6af56c admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:42.682584 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4169b-cb50-451d-bbce-ce33ac6af56c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:42.693507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-f5a4169b-cb50-451d-bbce-ce33ac6af56c admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 16 00:22:42.694595 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 599/1194] 10.222.0.50 () {56 vars in 1138 bytes} [Tue Nov 16 00:22:42 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:42.700791 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807d4df-3411-40ea-95a4-d192c617d5a7 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:42.710202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807d4df-3411-40ea-95a4-d192c617d5a7 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:42.714751 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baf2c5-53fe-4737-8121-a520cea27768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:42.715431 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baf2c5-53fe-4737-8121-a520cea27768 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:42.715718 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baf2c5-53fe-4737-8121-a520cea27768 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:42.715998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baf2c5-53fe-4737-8121-a520cea27768 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:42.716703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baf2c5-53fe-4737-8121-a520cea27768 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:42.717658 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baf2c5-53fe-4737-8121-a520cea27768 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:42.719254 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baf2c5-53fe-4737-8121-a520cea27768 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:42.724472 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 596/1195] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Nov 16 00:22:42 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:42.730478 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4169b-cb50-451d-bbce-ce33ac6af56c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:42.740066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4169b-cb50-451d-bbce-ce33ac6af56c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:42.744529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d07e5-10bb-48c2-baca-c834a123ca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:42.745151 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d07e5-10bb-48c2-baca-c834a123ca05 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:42.745434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d07e5-10bb-48c2-baca-c834a123ca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:42.745711 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d07e5-10bb-48c2-baca-c834a123ca05 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:42.746486 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d07e5-10bb-48c2-baca-c834a123ca05 admin admin] RBAC: Adding query filter params (interface=public, service_id=316869a6c40a4a22822dcf47f220df56, region_id=RegionOne) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:42.746797 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d07e5-10bb-48c2-baca-c834a123ca05 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:42.748892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d07e5-10bb-48c2-baca-c834a123ca05 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:42.753677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 600/1196] 10.222.0.50 () {56 vars in 1272 bytes} [Tue Nov 16 00:22:42 2021] GET /identity/v3/endpoints?service_id=316869a6c40a4a22822dcf47f220df56&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:22:42.759585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baf2c5-53fe-4737-8121-a520cea27768 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:42.769502 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baf2c5-53fe-4737-8121-a520cea27768 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:42.774047 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1060d-164a-4092-80f1-38e7ea5997dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:42.774679 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1060d-164a-4092-80f1-38e7ea5997dc admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:42.774999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1060d-164a-4092-80f1-38e7ea5997dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:42.775282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1060d-164a-4092-80f1-38e7ea5997dc admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:42.775948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1060d-164a-4092-80f1-38e7ea5997dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:42.777513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1060d-164a-4092-80f1-38e7ea5997dc admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:42.785027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 597/1197] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Nov 16 00:22:42 2021] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:22:44.971738 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac928c-c675-42ee-a56f-9eb342c74375 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:44.972397 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac928c-c675-42ee-a56f-9eb342c74375 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:44.972397 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac928c-c675-42ee-a56f-9eb342c74375 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:44.974044 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 601/1198] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:22:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:22:44.981388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91d34f-9225-45ae-8fd8-4c448f6826da None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:44.981803 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91d34f-9225-45ae-8fd8-4c448f6826da None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:44.981949 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91d34f-9225-45ae-8fd8-4c448f6826da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:45.000485 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-ce91d34f-9225-45ae-8fd8-4c448f6826da None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:22:45.001752 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ce91d34f-9225-45ae-8fd8-4c448f6826da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:22:45.011116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 598/1199] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:22:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:22:45.036709 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac928c-c675-42ee-a56f-9eb342c74375 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:45.049183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac928c-c675-42ee-a56f-9eb342c74375 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:45.053455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a4d13-3750-4eea-a0fe-f13b709ddc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:45.054227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a4d13-3750-4eea-a0fe-f13b709ddc4b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:45.054509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a4d13-3750-4eea-a0fe-f13b709ddc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:45.054782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a4d13-3750-4eea-a0fe-f13b709ddc4b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:45.055459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a4d13-3750-4eea-a0fe-f13b709ddc4b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:45.057027 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a4d13-3750-4eea-a0fe-f13b709ddc4b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:45.068390 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING keystone.server.flask.application [None req-007a4d13-3750-4eea-a0fe-f13b709ddc4b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 16 00:22:45.069485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 602/1200] 10.222.0.50 () {56 vars in 1138 bytes} [Tue Nov 16 00:22:45 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 00:22:45.075861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91d34f-9225-45ae-8fd8-4c448f6826da None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:45.085349 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91d34f-9225-45ae-8fd8-4c448f6826da None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:45.089868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab7755-99e0-4fbf-9cdf-320d82221fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:45.090518 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab7755-99e0-4fbf-9cdf-320d82221fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:45.090803 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab7755-99e0-4fbf-9cdf-320d82221fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:45.091116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab7755-99e0-4fbf-9cdf-320d82221fb6 admin admin] PATH_INFO: `/v3/services` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:45.091920 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab7755-99e0-4fbf-9cdf-320d82221fb6 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:22:45.092245 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab7755-99e0-4fbf-9cdf-320d82221fb6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:45.093838 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab7755-99e0-4fbf-9cdf-320d82221fb6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:45.099081 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 599/1201] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Nov 16 00:22:45 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:22:45.104864 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a4d13-3750-4eea-a0fe-f13b709ddc4b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:22:45.121694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a4d13-3750-4eea-a0fe-f13b709ddc4b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:22:45.127328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7d284-b6f2-4a67-a154-101c19e2c31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:22:45.127959 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d284-b6f2-4a67-a154-101c19e2c31c admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:22:45.128242 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d284-b6f2-4a67-a154-101c19e2c31c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:22:45.128520 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d284-b6f2-4a67-a154-101c19e2c31c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:22:45.129251 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7d284-b6f2-4a67-a154-101c19e2c31c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:22:45.130812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7d284-b6f2-4a67-a154-101c19e2c31c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:22:45.152072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 603/1202] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Nov 16 00:22:45 2021] POST /identity/v3/endpoints => generated 331 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:23:49.194570 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d3cba-d5d5-4085-b933-6ef4beac8b0d None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:49.195174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d3cba-d5d5-4085-b933-6ef4beac8b0d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:49.195258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d3cba-d5d5-4085-b933-6ef4beac8b0d None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:49.197300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 600/1203] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:23:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:23:49.206058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aec346-720d-434f-8d48-d661b3e4a394 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:49.207074 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aec346-720d-434f-8d48-d661b3e4a394 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:49.207413 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aec346-720d-434f-8d48-d661b3e4a394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:49.308994 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c3aec346-720d-434f-8d48-d661b3e4a394 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:23:49.310228 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c3aec346-720d-434f-8d48-d661b3e4a394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:23:49.467523 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 604/1204] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:23:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:23:49.478080 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d3cba-d5d5-4085-b933-6ef4beac8b0d None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:23:49.480941 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9a6d3cba-d5d5-4085-b933-6ef4beac8b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:23:49.630070 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d3cba-d5d5-4085-b933-6ef4beac8b0d None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:23:49.741873 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53cfdf-96fd-4bc8-bee3-47186bf8b2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:23:49.742798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53cfdf-96fd-4bc8-bee3-47186bf8b2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:49.743251 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53cfdf-96fd-4bc8-bee3-47186bf8b2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:49.743680 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53cfdf-96fd-4bc8-bee3-47186bf8b2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:49.744551 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53cfdf-96fd-4bc8-bee3-47186bf8b2f9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:23:49.748053 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53cfdf-96fd-4bc8-bee3-47186bf8b2f9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:23:49.787052 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 601/1205] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Nov 16 00:23:49 2021] GET /identity/v3/projects => generated 2553 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:23:52.044910 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededf841-1e37-4098-bed5-ec424975c64d None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:52.045433 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededf841-1e37-4098-bed5-ec424975c64d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:52.045544 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededf841-1e37-4098-bed5-ec424975c64d None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:52.047296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 605/1206] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:23:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:23:52.054363 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc3ff-3f62-404a-ad5d-2d824f7cf2e9 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:52.054770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc3ff-3f62-404a-ad5d-2d824f7cf2e9 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:52.054957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc3ff-3f62-404a-ad5d-2d824f7cf2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:52.123629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-1b0dc3ff-3f62-404a-ad5d-2d824f7cf2e9 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:23:52.124763 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1b0dc3ff-3f62-404a-ad5d-2d824f7cf2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:23:52.219553 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 602/1207] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:23:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:23:52.270766 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08b4bc-807c-40eb-898f-d1f9ae2d3299 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:52.271092 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08b4bc-807c-40eb-898f-d1f9ae2d3299 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:52.271379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08b4bc-807c-40eb-898f-d1f9ae2d3299 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:52.273208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 606/1208] 10.222.0.50 () {54 vars in 963 bytes} [Tue Nov 16 00:23:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:23:52.279283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da4072-7067-4618-934a-841729ffcdfc None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:52.279576 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da4072-7067-4618-934a-841729ffcdfc None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:52.279857 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da4072-7067-4618-934a-841729ffcdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:52.351638 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-01da4072-7067-4618-934a-841729ffcdfc None None] MFA Rules not processed for user `7893cca0610b40abb9c45414f3690df0`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:23:52.352842 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-01da4072-7067-4618-934a-841729ffcdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:23:52.424421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 603/1209] 10.222.0.50 () {58 vars in 1060 bytes} [Tue Nov 16 00:23:52 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:23:52.434119 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08b4bc-807c-40eb-898f-d1f9ae2d3299 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:23:52.435692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6b08b4bc-807c-40eb-898f-d1f9ae2d3299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:23:52.534550 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08b4bc-807c-40eb-898f-d1f9ae2d3299 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:23:52.605487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d07bd-3aeb-4c82-9f54-9611936bce24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:23:52.606125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d07bd-3aeb-4c82-9f54-9611936bce24 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:52.606407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d07bd-3aeb-4c82-9f54-9611936bce24 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:52.606680 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d07bd-3aeb-4c82-9f54-9611936bce24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:52.608299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-317d07bd-3aeb-4c82-9f54-9611936bce24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:23:52.710161 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d07bd-3aeb-4c82-9f54-9611936bce24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:23:52.711549 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d07bd-3aeb-4c82-9f54-9611936bce24 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:23:52.730511 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 607/1210] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:23:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:23:55.193649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cd1a2-4c78-421c-9d73-e750e7a4a478 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:55.194153 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cd1a2-4c78-421c-9d73-e750e7a4a478 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:55.194153 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cd1a2-4c78-421c-9d73-e750e7a4a478 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:55.195957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 604/1211] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:23:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:23:55.203988 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2674e2a-e745-44ca-a60e-1831fd79ee45 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:55.204383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2674e2a-e745-44ca-a60e-1831fd79ee45 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:55.204534 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2674e2a-e745-44ca-a60e-1831fd79ee45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:55.267896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-f2674e2a-e745-44ca-a60e-1831fd79ee45 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:23:55.269085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-f2674e2a-e745-44ca-a60e-1831fd79ee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:23:55.359371 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 608/1212] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:23:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:23:55.398575 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cd1a2-4c78-421c-9d73-e750e7a4a478 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:23:55.400146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7c6cd1a2-4c78-421c-9d73-e750e7a4a478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:23:55.509373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cd1a2-4c78-421c-9d73-e750e7a4a478 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:23:55.579245 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ae3e8-67b3-450b-8408-dea2346f6d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:23:55.579886 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ae3e8-67b3-450b-8408-dea2346f6d58 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:55.580172 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ae3e8-67b3-450b-8408-dea2346f6d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:55.580448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ae3e8-67b3-450b-8408-dea2346f6d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:55.582062 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7f4ae3e8-67b3-450b-8408-dea2346f6d58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:23:55.685861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ae3e8-67b3-450b-8408-dea2346f6d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:23:55.687328 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ae3e8-67b3-450b-8408-dea2346f6d58 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:23:55.705030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 605/1213] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:23:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:23:58.200079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedfb59-fa33-44ea-9280-87b808543211 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:58.200579 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedfb59-fa33-44ea-9280-87b808543211 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:58.200579 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedfb59-fa33-44ea-9280-87b808543211 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:58.202311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 609/1214] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:23:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:23:58.209657 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01981-6343-40d8-b738-83c694af0dc9 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:58.210037 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01981-6343-40d8-b738-83c694af0dc9 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:58.210282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01981-6343-40d8-b738-83c694af0dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:58.273690 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-d7e01981-6343-40d8-b738-83c694af0dc9 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:23:58.274929 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d7e01981-6343-40d8-b738-83c694af0dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:23:58.366493 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 606/1215] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:23:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:23:58.405345 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedfb59-fa33-44ea-9280-87b808543211 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:23:58.406894 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9eedfb59-fa33-44ea-9280-87b808543211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:23:58.524250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedfb59-fa33-44ea-9280-87b808543211 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:23:58.611288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded18da-0cbb-43c0-841c-304a8ad16d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:23:58.612126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded18da-0cbb-43c0-841c-304a8ad16d59 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:58.612401 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded18da-0cbb-43c0-841c-304a8ad16d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:58.612672 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded18da-0cbb-43c0-841c-304a8ad16d59 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:58.622653 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded18da-0cbb-43c0-841c-304a8ad16d59 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:23:58.624731 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded18da-0cbb-43c0-841c-304a8ad16d59 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:23:58.626391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 610/1216] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:23:58 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:23:58.655458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c255f38-7df9-442e-bd56-c08d0eaf1c10 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:58.655778 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c255f38-7df9-442e-bd56-c08d0eaf1c10 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:58.656059 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c255f38-7df9-442e-bd56-c08d0eaf1c10 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:58.657856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 607/1217] 10.222.0.50 () {54 vars in 963 bytes} [Tue Nov 16 00:23:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:23:58.664125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d63457-32a1-4b58-af82-0ea95cc4ff65 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:58.664447 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d63457-32a1-4b58-af82-0ea95cc4ff65 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:58.664729 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d63457-32a1-4b58-af82-0ea95cc4ff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:58.737901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-36d63457-32a1-4b58-af82-0ea95cc4ff65 None None] MFA Rules not processed for user `7893cca0610b40abb9c45414f3690df0`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:23:58.739103 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-36d63457-32a1-4b58-af82-0ea95cc4ff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:23:58.811864 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 611/1218] 10.222.0.50 () {58 vars in 1060 bytes} [Tue Nov 16 00:23:58 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:23:58.820908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c255f38-7df9-442e-bd56-c08d0eaf1c10 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:23:58.822424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6c255f38-7df9-442e-bd56-c08d0eaf1c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:23:58.920929 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c255f38-7df9-442e-bd56-c08d0eaf1c10 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:23:58.993417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d892a-f639-4867-99a0-82f213a7a40b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:23:58.994066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d892a-f639-4867-99a0-82f213a7a40b service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:23:58.994353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d892a-f639-4867-99a0-82f213a7a40b service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:23:58.994715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d892a-f639-4867-99a0-82f213a7a40b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:23:58.996360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-cf7d892a-f639-4867-99a0-82f213a7a40b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:23:59.103770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d892a-f639-4867-99a0-82f213a7a40b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:23:59.105962 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d892a-f639-4867-99a0-82f213a7a40b service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:23:59.126877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 608/1219] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:23:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:24:02.221697 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a9bb-9dee-4a11-8705-b2c552e4da5b None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:02.222178 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a9bb-9dee-4a11-8705-b2c552e4da5b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:02.222281 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a9bb-9dee-4a11-8705-b2c552e4da5b None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:02.224111 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 612/1220] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:02.231968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f043b-1ba3-450e-9f7e-253953eb9c0a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:02.232399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f043b-1ba3-450e-9f7e-253953eb9c0a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:02.232533 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f043b-1ba3-450e-9f7e-253953eb9c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:02.294850 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-628f043b-1ba3-450e-9f7e-253953eb9c0a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:02.296089 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-628f043b-1ba3-450e-9f7e-253953eb9c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:02.389890 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 609/1221] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:02.424131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0a9bb-9dee-4a11-8705-b2c552e4da5b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:02.425655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-74d0a9bb-9dee-4a11-8705-b2c552e4da5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:02.544697 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0a9bb-9dee-4a11-8705-b2c552e4da5b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:02.632643 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb590c-4390-4693-ab33-1664b05d7c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:02.633486 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb590c-4390-4693-ab33-1664b05d7c7e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:02.633766 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb590c-4390-4693-ab33-1664b05d7c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:02.634032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb590c-4390-4693-ab33-1664b05d7c7e admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:02.643633 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb590c-4390-4693-ab33-1664b05d7c7e admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:02.645692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb590c-4390-4693-ab33-1664b05d7c7e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:02.647384 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 613/1222] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:24:02 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:24:02.660036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f043b-1ba3-450e-9f7e-253953eb9c0a None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:02.661257 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-628f043b-1ba3-450e-9f7e-253953eb9c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:02.746536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f043b-1ba3-450e-9f7e-253953eb9c0a None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:02.815472 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2ab67-a01f-4de8-ae22-1684f7a4417b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:02.816046 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ab67-a01f-4de8-ae22-1684f7a4417b service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:02.816334 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ab67-a01f-4de8-ae22-1684f7a4417b service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:02.816614 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2ab67-a01f-4de8-ae22-1684f7a4417b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:02.818199 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-cef2ab67-a01f-4de8-ae22-1684f7a4417b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:02.921225 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2ab67-a01f-4de8-ae22-1684f7a4417b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:02.922666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2ab67-a01f-4de8-ae22-1684f7a4417b service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:02.940184 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 610/1223] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:24:05.777314 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780785-f25b-4091-a7b6-b050ff504276 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:05.777879 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780785-f25b-4091-a7b6-b050ff504276 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:05.777879 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780785-f25b-4091-a7b6-b050ff504276 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:05.779898 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 614/1224] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:05.786909 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6a294-ddc8-4947-85fb-82238d1683ed None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:05.787364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6a294-ddc8-4947-85fb-82238d1683ed None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:05.787499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6a294-ddc8-4947-85fb-82238d1683ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:05.850563 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-9ed6a294-ddc8-4947-85fb-82238d1683ed None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:05.851676 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9ed6a294-ddc8-4947-85fb-82238d1683ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:05.944875 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 611/1225] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:05.984876 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb780785-f25b-4091-a7b6-b050ff504276 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:05.986480 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-bb780785-f25b-4091-a7b6-b050ff504276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:06.085811 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb780785-f25b-4091-a7b6-b050ff504276 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:06.158311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7395e-7b8f-4489-b855-ac6f536ad878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:06.158889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7395e-7b8f-4489-b855-ac6f536ad878 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:06.159176 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7395e-7b8f-4489-b855-ac6f536ad878 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:06.159449 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7395e-7b8f-4489-b855-ac6f536ad878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:06.161042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-44f7395e-7b8f-4489-b855-ac6f536ad878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:06.269763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7395e-7b8f-4489-b855-ac6f536ad878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:06.271270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7395e-7b8f-4489-b855-ac6f536ad878 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:06.289945 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 615/1226] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:24:08.533060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d4b2-52f1-4072-933e-869aa3a64780 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:08.533597 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d4b2-52f1-4072-933e-869aa3a64780 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:08.533703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d4b2-52f1-4072-933e-869aa3a64780 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:08.535497 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 612/1227] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:08.543368 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0d8fe-2709-4bc3-a1b8-27a5598e9c7b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:08.543824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0d8fe-2709-4bc3-a1b8-27a5598e9c7b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:08.543924 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0d8fe-2709-4bc3-a1b8-27a5598e9c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:08.608474 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-eec0d8fe-2709-4bc3-a1b8-27a5598e9c7b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:08.609671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-eec0d8fe-2709-4bc3-a1b8-27a5598e9c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:08.702035 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 616/1228] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:08.739139 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016d4b2-52f1-4072-933e-869aa3a64780 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:08.740650 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-3016d4b2-52f1-4072-933e-869aa3a64780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:08.840790 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016d4b2-52f1-4072-933e-869aa3a64780 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:08.914284 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133afdb-cb9d-47e9-bd34-68d5bbeedc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:08.914981 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133afdb-cb9d-47e9-bd34-68d5bbeedc43 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:08.915265 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133afdb-cb9d-47e9-bd34-68d5bbeedc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:08.915540 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133afdb-cb9d-47e9-bd34-68d5bbeedc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:08.917289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f133afdb-cb9d-47e9-bd34-68d5bbeedc43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:09.026561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133afdb-cb9d-47e9-bd34-68d5bbeedc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:09.028036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133afdb-cb9d-47e9-bd34-68d5bbeedc43 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:09.045376 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 613/1229] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:24:11.264106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324da24f-088f-4b97-ae72-3c0d4815665d None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:11.264623 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324da24f-088f-4b97-ae72-3c0d4815665d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:11.264728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324da24f-088f-4b97-ae72-3c0d4815665d None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:11.266431 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 617/1230] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:11.273574 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2f01d-45ba-4bb3-be57-d7958c6fc8d3 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:11.273989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2f01d-45ba-4bb3-be57-d7958c6fc8d3 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:11.274126 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2f01d-45ba-4bb3-be57-d7958c6fc8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:11.337142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-e3f2f01d-45ba-4bb3-be57-d7958c6fc8d3 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:11.339012 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e3f2f01d-45ba-4bb3-be57-d7958c6fc8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:11.430289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 614/1231] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:11.464346 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324da24f-088f-4b97-ae72-3c0d4815665d None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:11.465888 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-324da24f-088f-4b97-ae72-3c0d4815665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:11.590760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324da24f-088f-4b97-ae72-3c0d4815665d None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:11.680391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894317db-701a-4082-a0ee-90026772d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:11.681254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894317db-701a-4082-a0ee-90026772d191 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:11.682069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894317db-701a-4082-a0ee-90026772d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:11.682494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894317db-701a-4082-a0ee-90026772d191 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:11.692381 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894317db-701a-4082-a0ee-90026772d191 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:11.694456 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894317db-701a-4082-a0ee-90026772d191 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:11.696227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 618/1232] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:24:11 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:24:11.709142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2f01d-45ba-4bb3-be57-d7958c6fc8d3 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:11.710376 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e3f2f01d-45ba-4bb3-be57-d7958c6fc8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:11.797572 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2f01d-45ba-4bb3-be57-d7958c6fc8d3 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:11.905321 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3e9a0-264f-45d7-86ce-4083e78f01a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:11.906360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3e9a0-264f-45d7-86ce-4083e78f01a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:11.906862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3e9a0-264f-45d7-86ce-4083e78f01a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:11.907360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3e9a0-264f-45d7-86ce-4083e78f01a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:11.910289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f7c3e9a0-264f-45d7-86ce-4083e78f01a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:12.039595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3e9a0-264f-45d7-86ce-4083e78f01a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:12.040961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3e9a0-264f-45d7-86ce-4083e78f01a9 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:12.061321 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 615/1233] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:24:14.483568 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e03819-74e1-4d6f-b4c9-fa7f1d0d9ea4 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:14.484084 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e03819-74e1-4d6f-b4c9-fa7f1d0d9ea4 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:14.484084 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e03819-74e1-4d6f-b4c9-fa7f1d0d9ea4 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:14.485818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 619/1234] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:14.492805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14d154-0fbb-4a3e-b32d-e1b65da8ee8f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:14.493217 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14d154-0fbb-4a3e-b32d-e1b65da8ee8f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:14.493363 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14d154-0fbb-4a3e-b32d-e1b65da8ee8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:14.559478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-ef14d154-0fbb-4a3e-b32d-e1b65da8ee8f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:14.560698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ef14d154-0fbb-4a3e-b32d-e1b65da8ee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:14.661501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 616/1235] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:14.707812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e03819-74e1-4d6f-b4c9-fa7f1d0d9ea4 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:14.709361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-f9e03819-74e1-4d6f-b4c9-fa7f1d0d9ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:14.827569 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e03819-74e1-4d6f-b4c9-fa7f1d0d9ea4 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:14.902596 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2126d19-d728-4a0f-8aac-76fe94efb9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:14.903288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126d19-d728-4a0f-8aac-76fe94efb9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:14.903578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126d19-d728-4a0f-8aac-76fe94efb9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:14.903857 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126d19-d728-4a0f-8aac-76fe94efb9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:14.905498 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e2126d19-d728-4a0f-8aac-76fe94efb9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:15.018009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2126d19-d728-4a0f-8aac-76fe94efb9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:15.019886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2126d19-d728-4a0f-8aac-76fe94efb9e7 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:15.043402 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 620/1236] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:24:17.254735 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228f437-381b-48e6-b82f-df2d527fff73 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:17.255291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228f437-381b-48e6-b82f-df2d527fff73 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:17.255291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228f437-381b-48e6-b82f-df2d527fff73 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:17.257029 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 617/1237] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:17.264186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ddfb2-10c6-4c64-af27-67953f7edd93 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:17.264598 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ddfb2-10c6-4c64-af27-67953f7edd93 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:17.264757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ddfb2-10c6-4c64-af27-67953f7edd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:17.328547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-012ddfb2-10c6-4c64-af27-67953f7edd93 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:17.329739 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-012ddfb2-10c6-4c64-af27-67953f7edd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:17.436889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 621/1238] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:17.479939 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228f437-381b-48e6-b82f-df2d527fff73 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:17.481470 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4228f437-381b-48e6-b82f-df2d527fff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:17.579786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228f437-381b-48e6-b82f-df2d527fff73 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:17.652308 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bd42e-6a19-4515-8498-e293cc072c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:17.652952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bd42e-6a19-4515-8498-e293cc072c5b service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:17.653236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bd42e-6a19-4515-8498-e293cc072c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:17.653510 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bd42e-6a19-4515-8498-e293cc072c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:17.655158 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-401bd42e-6a19-4515-8498-e293cc072c5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:17.767136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bd42e-6a19-4515-8498-e293cc072c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:17.768749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bd42e-6a19-4515-8498-e293cc072c5b service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:17.786529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 618/1239] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:24:20.447708 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c191939-1625-41a4-9b97-9d630f5b847c None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:20.448261 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c191939-1625-41a4-9b97-9d630f5b847c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:20.448369 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c191939-1625-41a4-9b97-9d630f5b847c None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:20.450101 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 622/1240] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:20.457290 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76aba-39b5-4972-a17a-7140f9bc9c0b None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:20.457675 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76aba-39b5-4972-a17a-7140f9bc9c0b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:20.457855 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76aba-39b5-4972-a17a-7140f9bc9c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:20.529282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-dfa76aba-39b5-4972-a17a-7140f9bc9c0b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:20.530492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-dfa76aba-39b5-4972-a17a-7140f9bc9c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:20.631507 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 619/1241] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:20.669828 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c191939-1625-41a4-9b97-9d630f5b847c None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:20.671994 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8c191939-1625-41a4-9b97-9d630f5b847c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:20.762621 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c191939-1625-41a4-9b97-9d630f5b847c None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:20.766278 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a711aed-bdd4-47d3-8c06-ca203c651eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:20.766960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a711aed-bdd4-47d3-8c06-ca203c651eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:20.767249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a711aed-bdd4-47d3-8c06-ca203c651eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:20.767526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a711aed-bdd4-47d3-8c06-ca203c651eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:20.776858 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a711aed-bdd4-47d3-8c06-ca203c651eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:20.778280 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a711aed-bdd4-47d3-8c06-ca203c651eb3 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:20.787372 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 623/1242] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:24:24.973079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e86b9a-77ba-427a-884c-172e76a4f773 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:24.973627 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e86b9a-77ba-427a-884c-172e76a4f773 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:24.973627 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e86b9a-77ba-427a-884c-172e76a4f773 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:24.975399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 620/1243] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:24.983545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0b170-0cc7-43ae-9ccd-82d947cfcdd7 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:24.983973 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0b170-0cc7-43ae-9ccd-82d947cfcdd7 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:24.984239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0b170-0cc7-43ae-9ccd-82d947cfcdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:25.001631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-1ec0b170-0cc7-43ae-9ccd-82d947cfcdd7 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:25.002875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-1ec0b170-0cc7-43ae-9ccd-82d947cfcdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:25.011142 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 624/1244] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:25.052242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e86b9a-77ba-427a-884c-172e76a4f773 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:25.054041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-68e86b9a-77ba-427a-884c-172e76a4f773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:25.067323 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e86b9a-77ba-427a-884c-172e76a4f773 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:25.070914 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93e3e6-e3a0-4324-b4e3-91d06a7fbd63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:25.071586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e3e6-e3a0-4324-b4e3-91d06a7fbd63 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:25.071870 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e3e6-e3a0-4324-b4e3-91d06a7fbd63 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:25.072235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e3e6-e3a0-4324-b4e3-91d06a7fbd63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:25.081125 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93e3e6-e3a0-4324-b4e3-91d06a7fbd63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:25.082572 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93e3e6-e3a0-4324-b4e3-91d06a7fbd63 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:25.092568 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 621/1245] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:24:27.907145 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81655211-f0cf-4ae6-9fb3-fcd1b771e3c5 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:27.907692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81655211-f0cf-4ae6-9fb3-fcd1b771e3c5 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:27.907692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81655211-f0cf-4ae6-9fb3-fcd1b771e3c5 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:27.909496 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 625/1246] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:27.917579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300af14-f1ef-4f3b-9499-386d7f8a363d None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:27.918098 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300af14-f1ef-4f3b-9499-386d7f8a363d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:27.918189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300af14-f1ef-4f3b-9499-386d7f8a363d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:27.937212 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-e300af14-f1ef-4f3b-9499-386d7f8a363d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:27.938401 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e300af14-f1ef-4f3b-9499-386d7f8a363d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:27.947144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 622/1247] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:24:27.988945 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81655211-f0cf-4ae6-9fb3-fcd1b771e3c5 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:28.002047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81655211-f0cf-4ae6-9fb3-fcd1b771e3c5 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:28.006316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6baaf-3d1f-41de-8c84-804b50e43f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:28.007094 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6baaf-3d1f-41de-8c84-804b50e43f74 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:28.007386 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6baaf-3d1f-41de-8c84-804b50e43f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:28.007694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6baaf-3d1f-41de-8c84-804b50e43f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:28.019332 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6baaf-3d1f-41de-8c84-804b50e43f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:28.020938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6baaf-3d1f-41de-8c84-804b50e43f74 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:28.030795 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 626/1248] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:24:32.447783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54021267-fd25-4526-8d8a-452074886dc8 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:32.448399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54021267-fd25-4526-8d8a-452074886dc8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:32.448399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54021267-fd25-4526-8d8a-452074886dc8 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:32.450581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 623/1249] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:32.458388 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589a023-24de-4610-a058-d6cf98cd23f6 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:32.458800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589a023-24de-4610-a058-d6cf98cd23f6 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:32.459070 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589a023-24de-4610-a058-d6cf98cd23f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:32.479250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-f589a023-24de-4610-a058-d6cf98cd23f6 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:32.480442 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-f589a023-24de-4610-a058-d6cf98cd23f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:32.488212 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 627/1250] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:32.528271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54021267-fd25-4526-8d8a-452074886dc8 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:32.538936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54021267-fd25-4526-8d8a-452074886dc8 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:32.543698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2f077-38c3-4b6b-9209-16e2a64c56cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:32.544435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2f077-38c3-4b6b-9209-16e2a64c56cb service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:32.544809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2f077-38c3-4b6b-9209-16e2a64c56cb service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:32.545177 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2f077-38c3-4b6b-9209-16e2a64c56cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:32.555571 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2f077-38c3-4b6b-9209-16e2a64c56cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:32.557289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2f077-38c3-4b6b-9209-16e2a64c56cb service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:32.566553 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 624/1251] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:24:37.809092 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3e406-77ba-452a-a6b7-bbc421b5226a None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:37.810047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3e406-77ba-452a-a6b7-bbc421b5226a None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:37.810537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3e406-77ba-452a-a6b7-bbc421b5226a None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:37.813504 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 628/1252] 10.222.0.50 () {54 vars in 921 bytes} [Tue Nov 16 00:24:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:37.818999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35be0a-bc16-48a2-913b-d92b52786c07 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:37.819467 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35be0a-bc16-48a2-913b-d92b52786c07 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:37.819596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35be0a-bc16-48a2-913b-d92b52786c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:37.890255 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-2c35be0a-bc16-48a2-913b-d92b52786c07 None None] MFA Rules not processed for user `678965f2159e4c33bf2465058f69ff02`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:37.891808 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2c35be0a-bc16-48a2-913b-d92b52786c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:37.982412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 625/1253] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Nov 16 00:24:37 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:24:42.371686 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbf915-c3ce-4fe9-b9b5-5bc413b29473 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:42.372219 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbf915-c3ce-4fe9-b9b5-5bc413b29473 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:42.372316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbf915-c3ce-4fe9-b9b5-5bc413b29473 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:42.374172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 629/1254] 10.222.0.50 () {54 vars in 921 bytes} [Tue Nov 16 00:24:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:42.379747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838744f8-dbc9-4f8d-a162-2cafce916b98 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:42.380218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838744f8-dbc9-4f8d-a162-2cafce916b98 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:42.380311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838744f8-dbc9-4f8d-a162-2cafce916b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:42.399206 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-838744f8-dbc9-4f8d-a162-2cafce916b98 None None] MFA Rules not processed for user `678965f2159e4c33bf2465058f69ff02`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:42.400411 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-838744f8-dbc9-4f8d-a162-2cafce916b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:42.409120 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 626/1255] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Nov 16 00:24:42 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:43.869722 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0358-cdb4-4ad9-a87c-d796b5345fd1 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:43.870262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0358-cdb4-4ad9-a87c-d796b5345fd1 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:43.870262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0358-cdb4-4ad9-a87c-d796b5345fd1 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:43.872087 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 630/1256] 10.222.0.50 () {54 vars in 921 bytes} [Tue Nov 16 00:24:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:43.877316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8fab7-b9a0-4160-b123-db3cbdb70c99 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:43.877762 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8fab7-b9a0-4160-b123-db3cbdb70c99 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:43.877886 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8fab7-b9a0-4160-b123-db3cbdb70c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:43.896403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-3ce8fab7-b9a0-4160-b123-db3cbdb70c99 None None] MFA Rules not processed for user `678965f2159e4c33bf2465058f69ff02`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:43.897552 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-3ce8fab7-b9a0-4160-b123-db3cbdb70c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:43.906603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 627/1257] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Nov 16 00:24:43 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:47.830169 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e9800-4bce-4bc5-9874-f777c46a08a2 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:47.830732 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e9800-4bce-4bc5-9874-f777c46a08a2 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:47.831047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e9800-4bce-4bc5-9874-f777c46a08a2 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:47.833075 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 631/1258] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:47.841229 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb8b08-108c-48e9-a5cb-21bd4b1f4e1c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:47.841753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb8b08-108c-48e9-a5cb-21bd4b1f4e1c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:47.841831 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb8b08-108c-48e9-a5cb-21bd4b1f4e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:47.860989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-bfdb8b08-108c-48e9-a5cb-21bd4b1f4e1c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:47.862186 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-bfdb8b08-108c-48e9-a5cb-21bd4b1f4e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:47.870183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 628/1259] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:47.920015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7831-48ab-4993-aa84-dd432dc94ae1 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:47.920305 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7831-48ab-4993-aa84-dd432dc94ae1 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:47.920585 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7831-48ab-4993-aa84-dd432dc94ae1 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:47.922475 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 632/1260] 10.222.0.50 () {54 vars in 959 bytes} [Tue Nov 16 00:24:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:47.930481 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfebbe-2bd2-4d41-89e7-c641998a22f2 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:47.931050 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfebbe-2bd2-4d41-89e7-c641998a22f2 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:47.931425 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfebbe-2bd2-4d41-89e7-c641998a22f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:47.985654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-b3bfebbe-2bd2-4d41-89e7-c641998a22f2 None None] MFA Rules not processed for user `442cc0e13dcb49f0a4a870c06e0edf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:47.986427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-b3bfebbe-2bd2-4d41-89e7-c641998a22f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:48.069663 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 629/1261] 10.222.0.50 () {58 vars in 1056 bytes} [Tue Nov 16 00:24:47 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:48.078173 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb7831-48ab-4993-aa84-dd432dc94ae1 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:48.092934 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb7831-48ab-4993-aa84-dd432dc94ae1 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:48.098708 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3784d1a-ffa3-4dd0-9b43-02abce2be528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:48.099483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3784d1a-ffa3-4dd0-9b43-02abce2be528 service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:48.099865 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3784d1a-ffa3-4dd0-9b43-02abce2be528 service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:48.100277 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3784d1a-ffa3-4dd0-9b43-02abce2be528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:48.109260 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3784d1a-ffa3-4dd0-9b43-02abce2be528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:48.110981 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3784d1a-ffa3-4dd0-9b43-02abce2be528 service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:48.120698 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 633/1262] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:24:50.540828 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9c811-3861-4bd4-81fa-7d56bb89469f None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:50.541381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9c811-3861-4bd4-81fa-7d56bb89469f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:50.541381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9c811-3861-4bd4-81fa-7d56bb89469f None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:50.543208 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 630/1263] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:50.551214 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bd4a9-9635-441a-bcb8-19113ce95151 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:50.552232 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bd4a9-9635-441a-bcb8-19113ce95151 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:50.552668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bd4a9-9635-441a-bcb8-19113ce95151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:50.574178 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-e24bd4a9-9635-441a-bcb8-19113ce95151 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:50.575777 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e24bd4a9-9635-441a-bcb8-19113ce95151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:50.584699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 634/1264] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:50.633418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9c811-3861-4bd4-81fa-7d56bb89469f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:50.647884 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9c811-3861-4bd4-81fa-7d56bb89469f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:50.653701 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a64dee-4172-47ba-8e2e-3029742d77d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:50.654337 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a64dee-4172-47ba-8e2e-3029742d77d5 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:50.654624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a64dee-4172-47ba-8e2e-3029742d77d5 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:50.654940 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a64dee-4172-47ba-8e2e-3029742d77d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:50.663255 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a64dee-4172-47ba-8e2e-3029742d77d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:50.665085 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a64dee-4172-47ba-8e2e-3029742d77d5 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:50.674859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 631/1265] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:24:53.201658 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b94709-e90a-4f51-8914-69ce724db1bc None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:53.202156 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b94709-e90a-4f51-8914-69ce724db1bc None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:53.202156 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b94709-e90a-4f51-8914-69ce724db1bc None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:53.204490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 635/1266] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:53.213102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403fb8f-0c38-4282-a98a-6129d1dcb9e4 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:53.213548 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403fb8f-0c38-4282-a98a-6129d1dcb9e4 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:53.213713 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403fb8f-0c38-4282-a98a-6129d1dcb9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:53.232235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-c403fb8f-0c38-4282-a98a-6129d1dcb9e4 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:53.233415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-c403fb8f-0c38-4282-a98a-6129d1dcb9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:53.241189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 632/1267] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:24:53.288021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512984aa-5c73-455c-97d4-058b375818c0 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:53.288301 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512984aa-5c73-455c-97d4-058b375818c0 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:53.288601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512984aa-5c73-455c-97d4-058b375818c0 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:53.291097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 636/1268] 10.222.0.50 () {54 vars in 959 bytes} [Tue Nov 16 00:24:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:53.296585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32ac43-4ed3-4aa7-8604-9c8b1e0bbdc6 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:53.297158 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32ac43-4ed3-4aa7-8604-9c8b1e0bbdc6 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:53.297557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32ac43-4ed3-4aa7-8604-9c8b1e0bbdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:53.316073 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-9c32ac43-4ed3-4aa7-8604-9c8b1e0bbdc6 None None] MFA Rules not processed for user `442cc0e13dcb49f0a4a870c06e0edf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:53.317257 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9c32ac43-4ed3-4aa7-8604-9c8b1e0bbdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:53.326571 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 633/1269] 10.222.0.50 () {58 vars in 1056 bytes} [Tue Nov 16 00:24:53 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:24:53.334649 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512984aa-5c73-455c-97d4-058b375818c0 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:53.349081 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512984aa-5c73-455c-97d4-058b375818c0 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:53.355123 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0aca39-9293-463f-a8ae-317d0160533b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:53.355750 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0aca39-9293-463f-a8ae-317d0160533b service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:53.356030 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0aca39-9293-463f-a8ae-317d0160533b service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:53.356312 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0aca39-9293-463f-a8ae-317d0160533b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:53.364247 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0aca39-9293-463f-a8ae-317d0160533b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:53.365805 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0aca39-9293-463f-a8ae-317d0160533b service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:53.375485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 637/1270] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:24:55.662484 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645daed-12e6-46c7-9bc2-76e621a94386 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:55.663023 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645daed-12e6-46c7-9bc2-76e621a94386 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:55.663136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645daed-12e6-46c7-9bc2-76e621a94386 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:55.665725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 634/1271] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:55.673251 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01f1d0-e568-46ee-96b9-5eb20269d858 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:55.673682 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01f1d0-e568-46ee-96b9-5eb20269d858 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:55.673808 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01f1d0-e568-46ee-96b9-5eb20269d858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:55.691572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-3f01f1d0-e568-46ee-96b9-5eb20269d858 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:55.692776 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3f01f1d0-e568-46ee-96b9-5eb20269d858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:55.700928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 638/1272] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:55.748642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645daed-12e6-46c7-9bc2-76e621a94386 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:55.763646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645daed-12e6-46c7-9bc2-76e621a94386 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:55.769362 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d2ae1-e400-43d1-8951-8dd6f3ae59d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:55.770163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2ae1-e400-43d1-8951-8dd6f3ae59d3 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:55.770574 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2ae1-e400-43d1-8951-8dd6f3ae59d3 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:55.770993 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2ae1-e400-43d1-8951-8dd6f3ae59d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:55.781605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d2ae1-e400-43d1-8951-8dd6f3ae59d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:55.783461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d2ae1-e400-43d1-8951-8dd6f3ae59d3 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:55.796281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 635/1273] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:24:55.876390 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111f717-5b70-4250-baaf-ad96c7205afc None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:55.876678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111f717-5b70-4250-baaf-ad96c7205afc None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:55.877131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111f717-5b70-4250-baaf-ad96c7205afc None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:55.879187 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 639/1274] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:55.888599 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498ad94-3ca2-4f3c-a4f3-90c420bc4397 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:55.889076 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498ad94-3ca2-4f3c-a4f3-90c420bc4397 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:55.889463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498ad94-3ca2-4f3c-a4f3-90c420bc4397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:55.909704 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f498ad94-3ca2-4f3c-a4f3-90c420bc4397 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:55.911134 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f498ad94-3ca2-4f3c-a4f3-90c420bc4397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:55.920468 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 636/1275] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:24:55.978634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa49beb-0557-4aa8-a935-223a1aa51f72 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:55.979020 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa49beb-0557-4aa8-a935-223a1aa51f72 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:55.979304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa49beb-0557-4aa8-a935-223a1aa51f72 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:55.981359 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 640/1276] 10.222.0.50 () {54 vars in 962 bytes} [Tue Nov 16 00:24:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:55.988839 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1b958-9a8a-4978-bb61-cb22a37f1101 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:55.989175 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1b958-9a8a-4978-bb61-cb22a37f1101 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:55.989410 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1b958-9a8a-4978-bb61-cb22a37f1101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:56.046390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f0f1b958-9a8a-4978-bb61-cb22a37f1101 None None] MFA Rules not processed for user `292b73337e674cdfa9c05fe67040cf94`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:56.047698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f0f1b958-9a8a-4978-bb61-cb22a37f1101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:56.116296 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 637/1277] 10.222.0.50 () {58 vars in 1059 bytes} [Tue Nov 16 00:24:55 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:56.125289 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa49beb-0557-4aa8-a935-223a1aa51f72 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:56.136047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa49beb-0557-4aa8-a935-223a1aa51f72 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:56.139935 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb451512-d87a-4cb0-91ef-4c28a3add929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:56.140805 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451512-d87a-4cb0-91ef-4c28a3add929 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:56.141292 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451512-d87a-4cb0-91ef-4c28a3add929 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:56.141750 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451512-d87a-4cb0-91ef-4c28a3add929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:56.151547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb451512-d87a-4cb0-91ef-4c28a3add929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:56.153367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb451512-d87a-4cb0-91ef-4c28a3add929 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:56.163253 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 641/1278] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:24:58.054040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd4a8f-9887-485f-91c2-2064c051c508 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:58.054584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd4a8f-9887-485f-91c2-2064c051c508 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:58.054802 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd4a8f-9887-485f-91c2-2064c051c508 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:58.056644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 638/1279] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:24:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:24:58.064195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8f08a-9b51-4ab0-a336-8dac8111bf19 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:58.064616 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8f08a-9b51-4ab0-a336-8dac8111bf19 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:58.064754 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8f08a-9b51-4ab0-a336-8dac8111bf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:58.082766 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-86a8f08a-9b51-4ab0-a336-8dac8111bf19 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:24:58.084132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-86a8f08a-9b51-4ab0-a336-8dac8111bf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:24:58.093489 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 642/1280] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:24:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:24:58.140703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd4a8f-9887-485f-91c2-2064c051c508 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:24:58.156596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd4a8f-9887-485f-91c2-2064c051c508 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:24:58.163360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e696e92-dbf5-4e01-b3c1-788203f84201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:24:58.164900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e696e92-dbf5-4e01-b3c1-788203f84201 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:24:58.165119 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e696e92-dbf5-4e01-b3c1-788203f84201 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:24:58.165408 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e696e92-dbf5-4e01-b3c1-788203f84201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:24:58.174322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e696e92-dbf5-4e01-b3c1-788203f84201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:24:58.176026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e696e92-dbf5-4e01-b3c1-788203f84201 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:24:58.185804 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 639/1281] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:24:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:25:00.475630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c381b26-fa49-4692-8f91-737b8f56657b None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:00.477160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c381b26-fa49-4692-8f91-737b8f56657b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:00.477745 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c381b26-fa49-4692-8f91-737b8f56657b None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:00.479794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 643/1282] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:00.487308 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c709af1-5f94-4163-835b-a63b865547c6 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:00.487772 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c709af1-5f94-4163-835b-a63b865547c6 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:00.487853 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c709af1-5f94-4163-835b-a63b865547c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:00.506397 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-5c709af1-5f94-4163-835b-a63b865547c6 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:00.507740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-5c709af1-5f94-4163-835b-a63b865547c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:00.515749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 640/1283] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:00.561923 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c381b26-fa49-4692-8f91-737b8f56657b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:00.577331 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c381b26-fa49-4692-8f91-737b8f56657b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:00.583112 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411acd6b-a0be-4661-8e59-0406ab0365df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:00.584015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411acd6b-a0be-4661-8e59-0406ab0365df service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:00.584485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411acd6b-a0be-4661-8e59-0406ab0365df service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:00.584960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411acd6b-a0be-4661-8e59-0406ab0365df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:00.593732 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411acd6b-a0be-4661-8e59-0406ab0365df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:00.595913 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411acd6b-a0be-4661-8e59-0406ab0365df service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:00.606518 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 644/1284] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:25:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:25:02.832629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b283b01-428f-41a2-bebb-b0ce0440bc00 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:02.833206 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b283b01-428f-41a2-bebb-b0ce0440bc00 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:02.833206 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b283b01-428f-41a2-bebb-b0ce0440bc00 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:02.835006 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 641/1285] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:02.842345 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7794fb-e7ec-4ac2-a155-2e1cfcbc3766 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:02.842801 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7794fb-e7ec-4ac2-a155-2e1cfcbc3766 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:02.842952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7794fb-e7ec-4ac2-a155-2e1cfcbc3766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:02.862237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-bd7794fb-e7ec-4ac2-a155-2e1cfcbc3766 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:02.863459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-bd7794fb-e7ec-4ac2-a155-2e1cfcbc3766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:02.872085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 645/1286] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:02.915893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b283b01-428f-41a2-bebb-b0ce0440bc00 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:02.933089 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b283b01-428f-41a2-bebb-b0ce0440bc00 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:02.938894 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05f817-5da3-45c1-881f-e41af6276b9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:02.939550 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05f817-5da3-45c1-881f-e41af6276b9d service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:02.939865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05f817-5da3-45c1-881f-e41af6276b9d service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:02.940284 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05f817-5da3-45c1-881f-e41af6276b9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:02.954058 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05f817-5da3-45c1-881f-e41af6276b9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:02.955819 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05f817-5da3-45c1-881f-e41af6276b9d service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:02.967041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 642/1287] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:25:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:25:05.203498 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47102810-e127-49ad-b836-a192fd251657 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:05.204201 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47102810-e127-49ad-b836-a192fd251657 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:05.204201 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47102810-e127-49ad-b836-a192fd251657 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:05.206672 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 646/1288] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:05.215150 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac9e1a-70b9-4ea1-9130-0881e43a27ee None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:05.215601 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac9e1a-70b9-4ea1-9130-0881e43a27ee None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:05.215741 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac9e1a-70b9-4ea1-9130-0881e43a27ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:05.234000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-86ac9e1a-70b9-4ea1-9130-0881e43a27ee None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:05.235271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-86ac9e1a-70b9-4ea1-9130-0881e43a27ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:05.243336 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 643/1289] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:05.293323 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47102810-e127-49ad-b836-a192fd251657 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:05.308060 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47102810-e127-49ad-b836-a192fd251657 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:05.313828 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7f158-e268-443d-b41c-863fa27c9765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:05.314496 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7f158-e268-443d-b41c-863fa27c9765 service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:05.314791 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7f158-e268-443d-b41c-863fa27c9765 service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:05.315171 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7f158-e268-443d-b41c-863fa27c9765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:05.323870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7f158-e268-443d-b41c-863fa27c9765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:05.325510 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7f158-e268-443d-b41c-863fa27c9765 service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:05.335811 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 647/1290] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:25:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:25:07.604229 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895ba3a-34d0-4764-af4b-94359854f8ef None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:07.604911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895ba3a-34d0-4764-af4b-94359854f8ef None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:07.604911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895ba3a-34d0-4764-af4b-94359854f8ef None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:07.606709 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 644/1291] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:07.614211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fecd5-566d-444d-ab51-1d83262cd43f None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:07.614646 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fecd5-566d-444d-ab51-1d83262cd43f None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:07.614886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fecd5-566d-444d-ab51-1d83262cd43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:07.633853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-360fecd5-566d-444d-ab51-1d83262cd43f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:07.635071 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-360fecd5-566d-444d-ab51-1d83262cd43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:07.643026 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 648/1292] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:07.701800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895ba3a-34d0-4764-af4b-94359854f8ef None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:07.717146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895ba3a-34d0-4764-af4b-94359854f8ef None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:07.723319 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d9f96-ebc4-4c7a-be41-9378ea07c914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:07.723988 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d9f96-ebc4-4c7a-be41-9378ea07c914 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:07.724287 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d9f96-ebc4-4c7a-be41-9378ea07c914 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:07.724575 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d9f96-ebc4-4c7a-be41-9378ea07c914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:07.734103 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d9f96-ebc4-4c7a-be41-9378ea07c914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:07.735800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d9f96-ebc4-4c7a-be41-9378ea07c914 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:07.745764 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 645/1293] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:25:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:25:09.983670 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a08aa2-5c16-4b25-9adf-118b5f2b2568 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:09.984210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a08aa2-5c16-4b25-9adf-118b5f2b2568 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:09.984210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a08aa2-5c16-4b25-9adf-118b5f2b2568 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:09.986035 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 649/1294] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:09.993856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a6056-1592-4ed1-9d44-8b601fad6628 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:09.994276 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a6056-1592-4ed1-9d44-8b601fad6628 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:09.994412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a6056-1592-4ed1-9d44-8b601fad6628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:10.014348 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-1f3a6056-1592-4ed1-9d44-8b601fad6628 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:10.015555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1f3a6056-1592-4ed1-9d44-8b601fad6628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:10.023200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 646/1295] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:10.068543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a08aa2-5c16-4b25-9adf-118b5f2b2568 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:10.083610 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a08aa2-5c16-4b25-9adf-118b5f2b2568 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:10.089600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef08b71-3b6f-4855-934d-c37cf1e21c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:10.090250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08b71-3b6f-4855-934d-c37cf1e21c07 service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:10.090540 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08b71-3b6f-4855-934d-c37cf1e21c07 service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:10.090823 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08b71-3b6f-4855-934d-c37cf1e21c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:10.099512 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef08b71-3b6f-4855-934d-c37cf1e21c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:10.101098 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef08b71-3b6f-4855-934d-c37cf1e21c07 service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:10.110447 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 650/1296] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:25:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:25:11.196118 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b55bce-0310-41c0-a453-542e9dac3b45 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:11.196661 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b55bce-0310-41c0-a453-542e9dac3b45 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:11.197647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b55bce-0310-41c0-a453-542e9dac3b45 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:11.199680 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 647/1297] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:11.207432 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54327f-021e-4ff0-a0f8-28e26de2b147 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:11.207922 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54327f-021e-4ff0-a0f8-28e26de2b147 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:11.208217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54327f-021e-4ff0-a0f8-28e26de2b147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:11.234825 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-bf54327f-021e-4ff0-a0f8-28e26de2b147 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:11.236355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-bf54327f-021e-4ff0-a0f8-28e26de2b147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:11.247488 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 651/1298] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:11.306491 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbfbaf-bad9-437a-80cc-1ce8e491dcaf None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:11.306781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbfbaf-bad9-437a-80cc-1ce8e491dcaf None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:11.307095 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbfbaf-bad9-437a-80cc-1ce8e491dcaf None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:11.308946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 648/1299] 10.222.0.50 () {54 vars in 956 bytes} [Tue Nov 16 00:25:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:11.314930 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f4294-9602-4f9c-801f-3762d7523b27 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:11.315234 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f4294-9602-4f9c-801f-3762d7523b27 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:11.315528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f4294-9602-4f9c-801f-3762d7523b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:11.363539 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-b32f4294-9602-4f9c-801f-3762d7523b27 None None] MFA Rules not processed for user `8cab78404d3c4980a4b99da09edab426`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:11.364768 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b32f4294-9602-4f9c-801f-3762d7523b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:11.423514 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 652/1300] 10.222.0.50 () {58 vars in 1053 bytes} [Tue Nov 16 00:25:11 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:11.432048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbfbaf-bad9-437a-80cc-1ce8e491dcaf None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:11.442418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbfbaf-bad9-437a-80cc-1ce8e491dcaf None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:11.446671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df83f1d-300b-4244-ab05-13f861ffebfb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cab78404d3c4980a4b99da09edab426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:11.447277 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83f1d-300b-4244-ab05-13f861ffebfb service glance] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:11.447567 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83f1d-300b-4244-ab05-13f861ffebfb service glance] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:11.447851 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83f1d-300b-4244-ab05-13f861ffebfb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:11.456512 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df83f1d-300b-4244-ab05-13f861ffebfb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:11.457936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df83f1d-300b-4244-ab05-13f861ffebfb service glance] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:11.467377 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 649/1301] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:25:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:25:11.908270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee645ea9-af92-46b3-a463-fe930b65337e None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:11.908568 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee645ea9-af92-46b3-a463-fe930b65337e None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:11.908851 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee645ea9-af92-46b3-a463-fe930b65337e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:11.957403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-ee645ea9-af92-46b3-a463-fe930b65337e None None] MFA Rules not processed for user `f6af4c462c6347ff8abbcc8770874b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:11.958625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ee645ea9-af92-46b3-a463-fe930b65337e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:12.023467 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 653/1302] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Nov 16 00:25:11 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:12.065055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a447feb-6b7f-4c68-9cd3-5c1eaa88a9fc None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:12.065350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a447feb-6b7f-4c68-9cd3-5c1eaa88a9fc None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:12.065662 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a447feb-6b7f-4c68-9cd3-5c1eaa88a9fc None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:12.067569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 650/1303] 10.222.0.50 () {54 vars in 942 bytes} [Tue Nov 16 00:25:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:12.074351 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957c661-b19d-42e3-810c-6f9720e83b34 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:12.074731 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957c661-b19d-42e3-810c-6f9720e83b34 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:12.075120 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957c661-b19d-42e3-810c-6f9720e83b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:12.123154 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-d957c661-b19d-42e3-810c-6f9720e83b34 None None] MFA Rules not processed for user `0ac32c6730654a889472a3bad95374bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:12.124354 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d957c661-b19d-42e3-810c-6f9720e83b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:12.194394 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 654/1304] 10.222.0.50 () {58 vars in 1039 bytes} [Tue Nov 16 00:25:12 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:12.204187 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a447feb-6b7f-4c68-9cd3-5c1eaa88a9fc None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:12.218524 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a447feb-6b7f-4c68-9cd3-5c1eaa88a9fc None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:12.223824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c11fe-010d-4140-b25c-83f960cebf80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac32c6730654a889472a3bad95374bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:12.224476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c11fe-010d-4140-b25c-83f960cebf80 service swift] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:12.224761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c11fe-010d-4140-b25c-83f960cebf80 service swift] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:12.225041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c11fe-010d-4140-b25c-83f960cebf80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:12.235280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c11fe-010d-4140-b25c-83f960cebf80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:12.236916 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c11fe-010d-4140-b25c-83f960cebf80 service swift] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:12.246302 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 651/1305] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Nov 16 00:25:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 00:25:12.339140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a95f07-d81a-4b19-8993-aece29249a2d None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:12.339698 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a95f07-d81a-4b19-8993-aece29249a2d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:12.339985 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a95f07-d81a-4b19-8993-aece29249a2d None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:12.341908 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 655/1306] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:25:12.350451 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c35cb-e591-4d38-a9f4-cf3966189bd4 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:12.350739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c35cb-e591-4d38-a9f4-cf3966189bd4 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:12.351045 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c35cb-e591-4d38-a9f4-cf3966189bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:12.371824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-958c35cb-e591-4d38-a9f4-cf3966189bd4 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:12.373064 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-958c35cb-e591-4d38-a9f4-cf3966189bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:12.383024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 652/1307] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:12.432736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a95f07-d81a-4b19-8993-aece29249a2d None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:12.449099 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a95f07-d81a-4b19-8993-aece29249a2d None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:12.456516 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff745e-91f3-4a0c-8269-916f26bc643f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:12.457364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff745e-91f3-4a0c-8269-916f26bc643f service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:12.457655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff745e-91f3-4a0c-8269-916f26bc643f service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:12.457938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff745e-91f3-4a0c-8269-916f26bc643f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:12.467860 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff745e-91f3-4a0c-8269-916f26bc643f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:12.469490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff745e-91f3-4a0c-8269-916f26bc643f service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:12.480489 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 656/1308] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:25:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:25:14.765422 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9291c5-273d-437f-aa49-c782cea59b9a None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:14.765960 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9291c5-273d-437f-aa49-c782cea59b9a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:14.765960 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9291c5-273d-437f-aa49-c782cea59b9a None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:14.767775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 653/1309] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:14.775268 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0416127-fd0c-48e3-801d-8d128af3b18c None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:14.775720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0416127-fd0c-48e3-801d-8d128af3b18c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:14.775866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0416127-fd0c-48e3-801d-8d128af3b18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:14.796868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-e0416127-fd0c-48e3-801d-8d128af3b18c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:14.798071 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e0416127-fd0c-48e3-801d-8d128af3b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:14.806982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 657/1310] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:14.854538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9291c5-273d-437f-aa49-c782cea59b9a None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:14.869856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9291c5-273d-437f-aa49-c782cea59b9a None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:14.876188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84196470-4640-4eeb-84ef-ac1b2f86027c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:14.876830 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196470-4640-4eeb-84ef-ac1b2f86027c service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:14.877109 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196470-4640-4eeb-84ef-ac1b2f86027c service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:14.877398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196470-4640-4eeb-84ef-ac1b2f86027c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:14.887048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84196470-4640-4eeb-84ef-ac1b2f86027c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:14.888643 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84196470-4640-4eeb-84ef-ac1b2f86027c service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:14.908978 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 654/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:25:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:25:29.300958 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4736b4-516c-443f-8c37-f51db5ca56a1 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:29.301530 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4736b4-516c-443f-8c37-f51db5ca56a1 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:29.301530 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4736b4-516c-443f-8c37-f51db5ca56a1 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:29.303337 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 658/1312] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:29.311289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99103fa7-6454-4a4c-b015-918a8178d6d9 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:29.311734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99103fa7-6454-4a4c-b015-918a8178d6d9 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:29.311844 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99103fa7-6454-4a4c-b015-918a8178d6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:29.329013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-99103fa7-6454-4a4c-b015-918a8178d6d9 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:29.330760 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-99103fa7-6454-4a4c-b015-918a8178d6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:29.339768 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 655/1313] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:29.364901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4736b4-516c-443f-8c37-f51db5ca56a1 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:29.377526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4736b4-516c-443f-8c37-f51db5ca56a1 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:29.382068 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4de6ec-b3e4-4c16-88e2-daa26e11ef9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:29.382749 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4de6ec-b3e4-4c16-88e2-daa26e11ef9f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:29.383062 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4de6ec-b3e4-4c16-88e2-daa26e11ef9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:29.383365 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4de6ec-b3e4-4c16-88e2-daa26e11ef9f admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:29.384096 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4de6ec-b3e4-4c16-88e2-daa26e11ef9f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:29.385937 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4de6ec-b3e4-4c16-88e2-daa26e11ef9f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:29.405011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 659/1314] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Nov 16 00:25:29 2021] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:25:31.532965 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee93f5-e859-4848-8800-989176cd0388 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:31.533545 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee93f5-e859-4848-8800-989176cd0388 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:31.533545 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee93f5-e859-4848-8800-989176cd0388 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:31.535351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 656/1315] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:31.542644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a93eb-8a43-4496-ab46-b15d84ff8a45 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:31.543101 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a93eb-8a43-4496-ab46-b15d84ff8a45 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:31.543300 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a93eb-8a43-4496-ab46-b15d84ff8a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:31.561029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-937a93eb-8a43-4496-ab46-b15d84ff8a45 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:31.562250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-937a93eb-8a43-4496-ab46-b15d84ff8a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:31.570907 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 660/1316] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:31.593853 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee93f5-e859-4848-8800-989176cd0388 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:31.606333 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee93f5-e859-4848-8800-989176cd0388 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:31.610700 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db48311-fe09-421f-bf38-5c3ce09513e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:31.611559 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db48311-fe09-421f-bf38-5c3ce09513e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:31.611839 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db48311-fe09-421f-bf38-5c3ce09513e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:31.612114 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db48311-fe09-421f-bf38-5c3ce09513e6 admin admin] PATH_INFO: `/v3/projects/7aec0bf3f5ba404495a1eab25f1fe71c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:31.613285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db48311-fe09-421f-bf38-5c3ce09513e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=7aec0bf3f5ba404495a1eab25f1fe71c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:31.615090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db48311-fe09-421f-bf38-5c3ce09513e6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:31.617542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 657/1317] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:25:31 2021] GET /identity/v3/projects/7aec0bf3f5ba404495a1eab25f1fe71c => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:31.623952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a93eb-8a43-4496-ab46-b15d84ff8a45 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:31.633625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a93eb-8a43-4496-ab46-b15d84ff8a45 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:31.638192 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c2a55-4552-4e76-b214-148391440e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:31.638827 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c2a55-4552-4e76-b214-148391440e7f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:31.639138 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c2a55-4552-4e76-b214-148391440e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:31.639415 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c2a55-4552-4e76-b214-148391440e7f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:31.640175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c2a55-4552-4e76-b214-148391440e7f admin admin] RBAC: Adding query filter params (scope.project.id=7aec0bf3f5ba404495a1eab25f1fe71c) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:25:31.640482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c2a55-4552-4e76-b214-148391440e7f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:31.642309 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c2a55-4552-4e76-b214-148391440e7f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:31.649173 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 661/1318] 10.222.0.50 () {56 vars in 1231 bytes} [Tue Nov 16 00:25:31 2021] GET /identity/v3/role_assignments?scope.project.id=7aec0bf3f5ba404495a1eab25f1fe71c => generated 879 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:31.655347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db48311-fe09-421f-bf38-5c3ce09513e6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:31.664998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db48311-fe09-421f-bf38-5c3ce09513e6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:31.669596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d690ff-cf6a-46c6-bb6b-689ecdd4f294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:31.670435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d690ff-cf6a-46c6-bb6b-689ecdd4f294 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:31.670725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d690ff-cf6a-46c6-bb6b-689ecdd4f294 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:31.671053 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d690ff-cf6a-46c6-bb6b-689ecdd4f294 admin admin] PATH_INFO: `/v3/users/9ebf9643a2de4a8a9500c2ccce871c70` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:31.672251 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d690ff-cf6a-46c6-bb6b-689ecdd4f294 admin admin] RBAC: Authorizing `identity:get_user(user_id=9ebf9643a2de4a8a9500c2ccce871c70)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:31.674035 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d690ff-cf6a-46c6-bb6b-689ecdd4f294 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:31.675649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 658/1319] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:25:31 2021] GET /identity/v3/users/9ebf9643a2de4a8a9500c2ccce871c70 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:33.875128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8e31e-5a79-427d-a2d0-a394853114d6 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:33.875663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8e31e-5a79-427d-a2d0-a394853114d6 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:33.875663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8e31e-5a79-427d-a2d0-a394853114d6 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:33.877487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 662/1320] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:33.884591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb6ae3-4897-4889-94a6-11b6356b290f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:33.884983 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb6ae3-4897-4889-94a6-11b6356b290f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:33.885150 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb6ae3-4897-4889-94a6-11b6356b290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:33.903787 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-a6fb6ae3-4897-4889-94a6-11b6356b290f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:33.904992 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a6fb6ae3-4897-4889-94a6-11b6356b290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:33.912840 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 659/1321] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:33.937222 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8e31e-5a79-427d-a2d0-a394853114d6 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:33.949674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8e31e-5a79-427d-a2d0-a394853114d6 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:33.954063 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e422ff-ea5d-4e87-82ce-1ad59c901ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:33.954936 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e422ff-ea5d-4e87-82ce-1ad59c901ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:33.955222 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e422ff-ea5d-4e87-82ce-1ad59c901ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:33.955496 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e422ff-ea5d-4e87-82ce-1ad59c901ef2 admin admin] PATH_INFO: `/v3/projects/7ee20201e21947beb712da1e7df970d8` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:33.967551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e422ff-ea5d-4e87-82ce-1ad59c901ef2 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ee20201e21947beb712da1e7df970d8)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:33.969894 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e422ff-ea5d-4e87-82ce-1ad59c901ef2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:33.971650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 663/1322] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:25:33 2021] GET /identity/v3/projects/7ee20201e21947beb712da1e7df970d8 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:33.979206 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb6ae3-4897-4889-94a6-11b6356b290f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:33.988630 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb6ae3-4897-4889-94a6-11b6356b290f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:33.993865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0ddaf-ebae-43b1-b03c-00bd10b12ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:33.994515 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0ddaf-ebae-43b1-b03c-00bd10b12ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:33.994809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0ddaf-ebae-43b1-b03c-00bd10b12ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:33.995132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0ddaf-ebae-43b1-b03c-00bd10b12ee0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:33.995903 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0ddaf-ebae-43b1-b03c-00bd10b12ee0 admin admin] RBAC: Adding query filter params (scope.project.id=7ee20201e21947beb712da1e7df970d8) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:25:33.996212 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0ddaf-ebae-43b1-b03c-00bd10b12ee0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:33.998066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0ddaf-ebae-43b1-b03c-00bd10b12ee0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:34.004824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 660/1323] 10.222.0.50 () {56 vars in 1231 bytes} [Tue Nov 16 00:25:33 2021] GET /identity/v3/role_assignments?scope.project.id=7ee20201e21947beb712da1e7df970d8 => generated 877 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:25:34.011151 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e422ff-ea5d-4e87-82ce-1ad59c901ef2 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:34.020797 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e422ff-ea5d-4e87-82ce-1ad59c901ef2 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:34.026313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ee36f-e68a-4106-8af1-d9a656bbebf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:34.027192 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ee36f-e68a-4106-8af1-d9a656bbebf4 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:34.027472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ee36f-e68a-4106-8af1-d9a656bbebf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:34.027746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ee36f-e68a-4106-8af1-d9a656bbebf4 admin admin] PATH_INFO: `/v3/users/ce9cac1643b14f3298cffb6dcc550925` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:34.041792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ee36f-e68a-4106-8af1-d9a656bbebf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=ce9cac1643b14f3298cffb6dcc550925)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:34.043961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ee36f-e68a-4106-8af1-d9a656bbebf4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:34.045554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 664/1324] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:25:34 2021] GET /identity/v3/users/ce9cac1643b14f3298cffb6dcc550925 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:34.051588 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0ddaf-ebae-43b1-b03c-00bd10b12ee0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:34.061250 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0ddaf-ebae-43b1-b03c-00bd10b12ee0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:34.065741 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869895d9-c3f0-45db-8624-c7ee5e8ef514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:34.066581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869895d9-c3f0-45db-8624-c7ee5e8ef514 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:34.066891 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869895d9-c3f0-45db-8624-c7ee5e8ef514 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:34.067169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869895d9-c3f0-45db-8624-c7ee5e8ef514 admin admin] PATH_INFO: `/v3/users/c874f064718e4994b8c09d46e3f6e91a` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:34.080612 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869895d9-c3f0-45db-8624-c7ee5e8ef514 admin admin] RBAC: Authorizing `identity:get_user(user_id=c874f064718e4994b8c09d46e3f6e91a)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:34.082750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869895d9-c3f0-45db-8624-c7ee5e8ef514 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:34.084398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 661/1325] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:25:34 2021] GET /identity/v3/users/c874f064718e4994b8c09d46e3f6e91a => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:36.315994 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94e89e-515f-4659-bbc0-b921eeb1da9a None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:36.316492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94e89e-515f-4659-bbc0-b921eeb1da9a None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:36.316586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94e89e-515f-4659-bbc0-b921eeb1da9a None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:36.318386 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 665/1326] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:36.326209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b4e3-577e-42ab-97e3-642e9f34b92f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:36.326623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b4e3-577e-42ab-97e3-642e9f34b92f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:36.326802 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b4e3-577e-42ab-97e3-642e9f34b92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:36.344236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-6524b4e3-577e-42ab-97e3-642e9f34b92f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:36.345677 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6524b4e3-577e-42ab-97e3-642e9f34b92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:36.353501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 662/1327] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:36.377340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94e89e-515f-4659-bbc0-b921eeb1da9a None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:36.390217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94e89e-515f-4659-bbc0-b921eeb1da9a None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:36.394619 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d57093-231b-4430-9a84-1156d4a89611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:36.395532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57093-231b-4430-9a84-1156d4a89611 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:36.395814 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57093-231b-4430-9a84-1156d4a89611 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:36.396095 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57093-231b-4430-9a84-1156d4a89611 admin admin] PATH_INFO: `/v3/projects/84c0a45d51a245899960f92d5de86861` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:36.406486 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d57093-231b-4430-9a84-1156d4a89611 admin admin] RBAC: Authorizing `identity:get_project(project_id=84c0a45d51a245899960f92d5de86861)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:36.408565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d57093-231b-4430-9a84-1156d4a89611 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:36.410291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 666/1328] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:25:36 2021] GET /identity/v3/projects/84c0a45d51a245899960f92d5de86861 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:36.417213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524b4e3-577e-42ab-97e3-642e9f34b92f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:36.426250 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524b4e3-577e-42ab-97e3-642e9f34b92f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:36.431750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da3689-6d23-4ba6-8bf6-abc42de82a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:36.432394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da3689-6d23-4ba6-8bf6-abc42de82a8e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:36.432681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da3689-6d23-4ba6-8bf6-abc42de82a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:36.432961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da3689-6d23-4ba6-8bf6-abc42de82a8e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:36.433735 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da3689-6d23-4ba6-8bf6-abc42de82a8e admin admin] RBAC: Adding query filter params (scope.project.id=84c0a45d51a245899960f92d5de86861) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:25:36.434166 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da3689-6d23-4ba6-8bf6-abc42de82a8e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:36.436101 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da3689-6d23-4ba6-8bf6-abc42de82a8e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:36.441519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 663/1329] 10.222.0.50 () {56 vars in 1231 bytes} [Tue Nov 16 00:25:36 2021] GET /identity/v3/role_assignments?scope.project.id=84c0a45d51a245899960f92d5de86861 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:36.447544 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d57093-231b-4430-9a84-1156d4a89611 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:36.457057 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d57093-231b-4430-9a84-1156d4a89611 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:36.461744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23643cb8-f888-443c-869f-8d909a9b4060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:36.462585 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23643cb8-f888-443c-869f-8d909a9b4060 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:36.462912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23643cb8-f888-443c-869f-8d909a9b4060 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:36.463194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23643cb8-f888-443c-869f-8d909a9b4060 admin admin] PATH_INFO: `/v3/users/3d1c037c181944bd8755142c048f806a` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:36.477620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23643cb8-f888-443c-869f-8d909a9b4060 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d1c037c181944bd8755142c048f806a)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:36.479821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23643cb8-f888-443c-869f-8d909a9b4060 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:36.481444 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 667/1330] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:25:36 2021] GET /identity/v3/users/3d1c037c181944bd8755142c048f806a => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:25:38.690233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6b0f1-ac39-456c-a462-4cfc25a3a513 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:38.690739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6b0f1-ac39-456c-a462-4cfc25a3a513 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:38.690739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6b0f1-ac39-456c-a462-4cfc25a3a513 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:38.692517 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 664/1331] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:38.700590 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d1898-904d-4f50-8d80-8b47b41826c8 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:38.701023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d1898-904d-4f50-8d80-8b47b41826c8 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:38.701157 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d1898-904d-4f50-8d80-8b47b41826c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:38.718787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-ec4d1898-904d-4f50-8d80-8b47b41826c8 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:38.720277 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ec4d1898-904d-4f50-8d80-8b47b41826c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:38.727935 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 668/1332] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:38.751644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6b0f1-ac39-456c-a462-4cfc25a3a513 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:38.764312 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6b0f1-ac39-456c-a462-4cfc25a3a513 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:38.768685 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02906b3c-de5c-4d8b-83e4-de56d9a67a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:38.769517 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02906b3c-de5c-4d8b-83e4-de56d9a67a46 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:38.769799 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02906b3c-de5c-4d8b-83e4-de56d9a67a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:38.770074 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02906b3c-de5c-4d8b-83e4-de56d9a67a46 admin admin] PATH_INFO: `/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:38.780650 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02906b3c-de5c-4d8b-83e4-de56d9a67a46 admin admin] RBAC: Authorizing `identity:get_project(project_id=db3488c6af544a1aa2bc5fdd48f927ea)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:38.782725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02906b3c-de5c-4d8b-83e4-de56d9a67a46 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:38.784419 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 665/1333] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:25:38 2021] GET /identity/v3/projects/db3488c6af544a1aa2bc5fdd48f927ea => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:38.790992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d1898-904d-4f50-8d80-8b47b41826c8 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:38.800163 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d1898-904d-4f50-8d80-8b47b41826c8 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:38.805497 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347d8e7-2dfa-4ad6-a23c-78ae065f078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:38.806137 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347d8e7-2dfa-4ad6-a23c-78ae065f078e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:38.806416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347d8e7-2dfa-4ad6-a23c-78ae065f078e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:38.806686 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347d8e7-2dfa-4ad6-a23c-78ae065f078e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:38.807486 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347d8e7-2dfa-4ad6-a23c-78ae065f078e admin admin] RBAC: Adding query filter params (scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:25:38.807793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347d8e7-2dfa-4ad6-a23c-78ae065f078e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:38.809638 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347d8e7-2dfa-4ad6-a23c-78ae065f078e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:38.816199 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 669/1334] 10.222.0.50 () {56 vars in 1231 bytes} [Tue Nov 16 00:25:38 2021] GET /identity/v3/role_assignments?scope.project.id=db3488c6af544a1aa2bc5fdd48f927ea => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:25:38.822991 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02906b3c-de5c-4d8b-83e4-de56d9a67a46 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:38.832246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02906b3c-de5c-4d8b-83e4-de56d9a67a46 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:38.836864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593f682-08ca-4803-899f-3f64af9207b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:38.837692 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593f682-08ca-4803-899f-3f64af9207b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:38.837976 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593f682-08ca-4803-899f-3f64af9207b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:38.838250 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593f682-08ca-4803-899f-3f64af9207b0 admin admin] PATH_INFO: `/v3/users/9ebf9643a2de4a8a9500c2ccce871c70` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:38.839439 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593f682-08ca-4803-899f-3f64af9207b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=9ebf9643a2de4a8a9500c2ccce871c70)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:38.841204 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593f682-08ca-4803-899f-3f64af9207b0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:38.842740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 666/1335] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:25:38 2021] GET /identity/v3/users/9ebf9643a2de4a8a9500c2ccce871c70 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:38.848917 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347d8e7-2dfa-4ad6-a23c-78ae065f078e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:38.858601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347d8e7-2dfa-4ad6-a23c-78ae065f078e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:38.863077 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c639a4-e769-4d42-b9df-fc6c16a28ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:38.863910 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c639a4-e769-4d42-b9df-fc6c16a28ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:38.864187 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c639a4-e769-4d42-b9df-fc6c16a28ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:38.864458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c639a4-e769-4d42-b9df-fc6c16a28ad7 admin admin] PATH_INFO: `/v3/users/b2a5428b2da04a328371dd74e3789090` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:38.878298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c639a4-e769-4d42-b9df-fc6c16a28ad7 admin admin] RBAC: Authorizing `identity:get_user(user_id=b2a5428b2da04a328371dd74e3789090)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:38.880426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c639a4-e769-4d42-b9df-fc6c16a28ad7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:38.883102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 670/1336] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:25:38 2021] GET /identity/v3/users/b2a5428b2da04a328371dd74e3789090 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:41.109746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cc6fa-9a63-4b66-9132-33cc18aca535 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:41.110300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cc6fa-9a63-4b66-9132-33cc18aca535 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:41.110300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cc6fa-9a63-4b66-9132-33cc18aca535 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:41.112089 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 667/1337] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:41.119117 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d9574-b0ce-4e18-8349-55054992965c None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:41.119545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d9574-b0ce-4e18-8349-55054992965c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:41.119682 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d9574-b0ce-4e18-8349-55054992965c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:41.136667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-642d9574-b0ce-4e18-8349-55054992965c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:41.137847 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-642d9574-b0ce-4e18-8349-55054992965c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:41.145445 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 671/1338] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:41.169532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cc6fa-9a63-4b66-9132-33cc18aca535 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:41.181683 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cc6fa-9a63-4b66-9132-33cc18aca535 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:41.186036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114cb1f-4912-4c00-a92a-dd31250bf6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:41.186898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114cb1f-4912-4c00-a92a-dd31250bf6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:41.187185 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114cb1f-4912-4c00-a92a-dd31250bf6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:41.187457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114cb1f-4912-4c00-a92a-dd31250bf6e8 admin admin] PATH_INFO: `/v3/projects/dc0ea87d14e741a29f7ed0df7614186c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:41.198053 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114cb1f-4912-4c00-a92a-dd31250bf6e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=dc0ea87d14e741a29f7ed0df7614186c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:41.200157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114cb1f-4912-4c00-a92a-dd31250bf6e8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:41.201817 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 668/1339] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:25:41 2021] GET /identity/v3/projects/dc0ea87d14e741a29f7ed0df7614186c => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:41.208205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d9574-b0ce-4e18-8349-55054992965c None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:41.217658 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d9574-b0ce-4e18-8349-55054992965c None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:41.222420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7056a-6c7e-4739-910f-9e841ff4be57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:41.223095 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7056a-6c7e-4739-910f-9e841ff4be57 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:41.223377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7056a-6c7e-4739-910f-9e841ff4be57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:41.223653 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7056a-6c7e-4739-910f-9e841ff4be57 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:41.224415 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7056a-6c7e-4739-910f-9e841ff4be57 admin admin] RBAC: Adding query filter params (scope.project.id=dc0ea87d14e741a29f7ed0df7614186c) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:25:41.224720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7056a-6c7e-4739-910f-9e841ff4be57 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:41.227355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7056a-6c7e-4739-910f-9e841ff4be57 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:41.233823 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 672/1340] 10.222.0.50 () {56 vars in 1231 bytes} [Tue Nov 16 00:25:41 2021] GET /identity/v3/role_assignments?scope.project.id=dc0ea87d14e741a29f7ed0df7614186c => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:25:41.239927 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114cb1f-4912-4c00-a92a-dd31250bf6e8 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:41.249476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114cb1f-4912-4c00-a92a-dd31250bf6e8 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:41.253936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaafa5-7724-4634-9a2f-ad9766f22d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:41.254777 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaafa5-7724-4634-9a2f-ad9766f22d73 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:41.255096 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaafa5-7724-4634-9a2f-ad9766f22d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:41.255377 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaafa5-7724-4634-9a2f-ad9766f22d73 admin admin] PATH_INFO: `/v3/users/42d5ad4a80f84d0fb97ac588a47759bf` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:41.268510 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaafa5-7724-4634-9a2f-ad9766f22d73 admin admin] RBAC: Authorizing `identity:get_user(user_id=42d5ad4a80f84d0fb97ac588a47759bf)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:41.270632 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaafa5-7724-4634-9a2f-ad9766f22d73 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:41.272828 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 669/1341] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:25:41 2021] GET /identity/v3/users/42d5ad4a80f84d0fb97ac588a47759bf => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:41.278893 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7056a-6c7e-4739-910f-9e841ff4be57 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:41.289003 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7056a-6c7e-4739-910f-9e841ff4be57 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:41.293589 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e09bbb-e0d5-489d-8636-b521ec34c2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:41.294464 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e09bbb-e0d5-489d-8636-b521ec34c2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:41.294748 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e09bbb-e0d5-489d-8636-b521ec34c2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:41.295068 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e09bbb-e0d5-489d-8636-b521ec34c2a4 admin admin] PATH_INFO: `/v3/users/9ebf9643a2de4a8a9500c2ccce871c70` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:41.296237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e09bbb-e0d5-489d-8636-b521ec34c2a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=9ebf9643a2de4a8a9500c2ccce871c70)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:41.298025 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e09bbb-e0d5-489d-8636-b521ec34c2a4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:41.299630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 673/1342] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:25:41 2021] GET /identity/v3/users/9ebf9643a2de4a8a9500c2ccce871c70 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:43.512421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7ecaa-4c06-431c-ba46-301d6fa1a77b None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:43.513031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7ecaa-4c06-431c-ba46-301d6fa1a77b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:43.513031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7ecaa-4c06-431c-ba46-301d6fa1a77b None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:43.514855 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 670/1343] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:43.521855 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6049ab-9251-4819-81ee-bcfa951a2196 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:43.522311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6049ab-9251-4819-81ee-bcfa951a2196 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:43.522599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6049ab-9251-4819-81ee-bcfa951a2196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:43.539990 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-7d6049ab-9251-4819-81ee-bcfa951a2196 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:43.541170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7d6049ab-9251-4819-81ee-bcfa951a2196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:43.548795 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 674/1344] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:43.574628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7ecaa-4c06-431c-ba46-301d6fa1a77b None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:43.587573 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7ecaa-4c06-431c-ba46-301d6fa1a77b None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:43.592002 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24b39c-00ce-4e67-ad0b-ad425b91e2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:43.592841 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24b39c-00ce-4e67-ad0b-ad425b91e2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:43.593127 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24b39c-00ce-4e67-ad0b-ad425b91e2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:43.593406 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24b39c-00ce-4e67-ad0b-ad425b91e2e3 admin admin] PATH_INFO: `/v3/projects/ea483834386d454d980698fc75c492f7` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:43.604656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24b39c-00ce-4e67-ad0b-ad425b91e2e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=ea483834386d454d980698fc75c492f7)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:43.606738 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24b39c-00ce-4e67-ad0b-ad425b91e2e3 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:43.608444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 671/1345] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:25:43 2021] GET /identity/v3/projects/ea483834386d454d980698fc75c492f7 => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:43.614790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6049ab-9251-4819-81ee-bcfa951a2196 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:43.624408 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6049ab-9251-4819-81ee-bcfa951a2196 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:43.628975 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f759ac-05a2-46ef-b2ee-a629bf96f4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:43.629612 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f759ac-05a2-46ef-b2ee-a629bf96f4eb admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:43.629898 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f759ac-05a2-46ef-b2ee-a629bf96f4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:43.630172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f759ac-05a2-46ef-b2ee-a629bf96f4eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:43.630970 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f759ac-05a2-46ef-b2ee-a629bf96f4eb admin admin] RBAC: Adding query filter params (scope.project.id=ea483834386d454d980698fc75c492f7) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:25:43.631278 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f759ac-05a2-46ef-b2ee-a629bf96f4eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:43.633359 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f759ac-05a2-46ef-b2ee-a629bf96f4eb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:43.638810 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 675/1346] 10.222.0.50 () {56 vars in 1231 bytes} [Tue Nov 16 00:25:43 2021] GET /identity/v3/role_assignments?scope.project.id=ea483834386d454d980698fc75c492f7 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:43.644860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24b39c-00ce-4e67-ad0b-ad425b91e2e3 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:43.654466 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24b39c-00ce-4e67-ad0b-ad425b91e2e3 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:43.659095 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46340ff5-220e-456e-bd3a-872b72348e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:43.659939 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46340ff5-220e-456e-bd3a-872b72348e77 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:43.660222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46340ff5-220e-456e-bd3a-872b72348e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:43.660498 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46340ff5-220e-456e-bd3a-872b72348e77 admin admin] PATH_INFO: `/v3/users/b2a5428b2da04a328371dd74e3789090` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:43.661676 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46340ff5-220e-456e-bd3a-872b72348e77 admin admin] RBAC: Authorizing `identity:get_user(user_id=b2a5428b2da04a328371dd74e3789090)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:43.664350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46340ff5-220e-456e-bd3a-872b72348e77 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:43.665913 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 672/1347] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:25:43 2021] GET /identity/v3/users/b2a5428b2da04a328371dd74e3789090 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:25:45.846210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92963a00-3a1d-4e8b-a1b7-c15bcc3c0d8b None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:45.846776 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92963a00-3a1d-4e8b-a1b7-c15bcc3c0d8b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:45.846776 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92963a00-3a1d-4e8b-a1b7-c15bcc3c0d8b None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:45.848586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 676/1348] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:45.855992 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433885aa-3830-4da6-92f4-4586aad207a8 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:45.856430 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433885aa-3830-4da6-92f4-4586aad207a8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:45.856584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433885aa-3830-4da6-92f4-4586aad207a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:45.874235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-433885aa-3830-4da6-92f4-4586aad207a8 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:45.875467 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-433885aa-3830-4da6-92f4-4586aad207a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:45.883704 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 673/1349] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:45.907423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92963a00-3a1d-4e8b-a1b7-c15bcc3c0d8b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:45.920036 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92963a00-3a1d-4e8b-a1b7-c15bcc3c0d8b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:45.924579 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f2e6c-a02a-4ef2-9a1f-1679e7e1ec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:45.925445 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2e6c-a02a-4ef2-9a1f-1679e7e1ec7a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:45.925724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2e6c-a02a-4ef2-9a1f-1679e7e1ec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:45.926000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2e6c-a02a-4ef2-9a1f-1679e7e1ec7a admin admin] PATH_INFO: `/v3/projects/f31f08c0e40f46f09e2d0d61590b966e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:45.936803 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f2e6c-a02a-4ef2-9a1f-1679e7e1ec7a admin admin] RBAC: Authorizing `identity:get_project(project_id=f31f08c0e40f46f09e2d0d61590b966e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:45.938856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f2e6c-a02a-4ef2-9a1f-1679e7e1ec7a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:45.940598 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 677/1350] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Nov 16 00:25:45 2021] GET /identity/v3/projects/f31f08c0e40f46f09e2d0d61590b966e => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:45.947857 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433885aa-3830-4da6-92f4-4586aad207a8 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:45.956825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433885aa-3830-4da6-92f4-4586aad207a8 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:45.962103 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b22ec5-4fa3-4db0-a995-4f0b9557b961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:45.962746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b22ec5-4fa3-4db0-a995-4f0b9557b961 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:45.963068 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b22ec5-4fa3-4db0-a995-4f0b9557b961 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:45.963350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b22ec5-4fa3-4db0-a995-4f0b9557b961 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:45.964164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b22ec5-4fa3-4db0-a995-4f0b9557b961 admin admin] RBAC: Adding query filter params (scope.project.id=f31f08c0e40f46f09e2d0d61590b966e) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:25:45.964424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b22ec5-4fa3-4db0-a995-4f0b9557b961 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:45.966268 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b22ec5-4fa3-4db0-a995-4f0b9557b961 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:45.972230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 674/1351] 10.222.0.50 () {56 vars in 1231 bytes} [Tue Nov 16 00:25:45 2021] GET /identity/v3/role_assignments?scope.project.id=f31f08c0e40f46f09e2d0d61590b966e => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:45.978965 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f2e6c-a02a-4ef2-9a1f-1679e7e1ec7a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:45.988872 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f2e6c-a02a-4ef2-9a1f-1679e7e1ec7a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:45.995569 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4328017-6b7a-4458-8836-d502c18fd15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:45.996490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4328017-6b7a-4458-8836-d502c18fd15d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:45.996768 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4328017-6b7a-4458-8836-d502c18fd15d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:45.997043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4328017-6b7a-4458-8836-d502c18fd15d admin admin] PATH_INFO: `/v3/users/5e23af7b9b744afa8c6fde6cbed5da87` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:46.014461 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4328017-6b7a-4458-8836-d502c18fd15d admin admin] RBAC: Authorizing `identity:get_user(user_id=5e23af7b9b744afa8c6fde6cbed5da87)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:46.016638 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4328017-6b7a-4458-8836-d502c18fd15d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:46.018321 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 678/1352] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Nov 16 00:25:45 2021] GET /identity/v3/users/5e23af7b9b744afa8c6fde6cbed5da87 => generated 311 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:25:51.264950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93de60d-81ea-4c72-8938-0c26605f1f4a None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:51.265524 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93de60d-81ea-4c72-8938-0c26605f1f4a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:51.265524 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93de60d-81ea-4c72-8938-0c26605f1f4a None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:51.267309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 675/1353] 10.222.0.50 () {54 vars in 918 bytes} [Tue Nov 16 00:25:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:51.273909 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a5de7-df72-45d0-b502-fe746d81b1ca None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:51.274324 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a5de7-df72-45d0-b502-fe746d81b1ca None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:51.274471 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a5de7-df72-45d0-b502-fe746d81b1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:51.292495 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-536a5de7-df72-45d0-b502-fe746d81b1ca None None] MFA Rules not processed for user `678965f2159e4c33bf2465058f69ff02`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:51.293696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-536a5de7-df72-45d0-b502-fe746d81b1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:51.303270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 679/1354] 10.222.0.50 () {58 vars in 1015 bytes} [Tue Nov 16 00:25:51 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:51.319219 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d491-228b-49bb-9278-108d6e2e78c7 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:51.319219 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d491-228b-49bb-9278-108d6e2e78c7 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:51.319823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d491-228b-49bb-9278-108d6e2e78c7 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:51.321446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 676/1355] 10.222.0.50 () {54 vars in 918 bytes} [Tue Nov 16 00:25:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:51.326734 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e7fd-cba6-4199-90b4-adc2fc389756 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:51.327052 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e7fd-cba6-4199-90b4-adc2fc389756 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:51.327331 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e7fd-cba6-4199-90b4-adc2fc389756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:51.345702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-7dd1e7fd-cba6-4199-90b4-adc2fc389756 None None] MFA Rules not processed for user `442cc0e13dcb49f0a4a870c06e0edf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:51.346882 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7dd1e7fd-cba6-4199-90b4-adc2fc389756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:51.356291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 680/1356] 10.222.0.50 () {58 vars in 1015 bytes} [Tue Nov 16 00:25:51 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:25:54.187296 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f5ed3-8a43-40fe-b6d8-1d197e529921 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:54.187809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f5ed3-8a43-40fe-b6d8-1d197e529921 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:54.187809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f5ed3-8a43-40fe-b6d8-1d197e529921 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:54.189553 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 677/1357] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:25:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:54.196770 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44868a-4d4e-4fc0-b027-f3cb095c6e5d None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:54.197191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44868a-4d4e-4fc0-b027-f3cb095c6e5d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:54.197336 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44868a-4d4e-4fc0-b027-f3cb095c6e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:54.215093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-ba44868a-4d4e-4fc0-b027-f3cb095c6e5d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:54.216271 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ba44868a-4d4e-4fc0-b027-f3cb095c6e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:54.224231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 681/1358] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:25:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:54.267846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f5ed3-8a43-40fe-b6d8-1d197e529921 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:54.281866 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f5ed3-8a43-40fe-b6d8-1d197e529921 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:54.287917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423e170-d91c-4145-9ed8-19d16ba8f9cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:54.288620 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e170-d91c-4145-9ed8-19d16ba8f9cc service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:54.288907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e170-d91c-4145-9ed8-19d16ba8f9cc service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:54.289187 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e170-d91c-4145-9ed8-19d16ba8f9cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:54.297173 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423e170-d91c-4145-9ed8-19d16ba8f9cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:54.298753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423e170-d91c-4145-9ed8-19d16ba8f9cc service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:54.315044 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 678/1359] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:25:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:25:55.737971 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0dfeb-93ef-43ca-a779-2308cf1b6a03 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:55.738563 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0dfeb-93ef-43ca-a779-2308cf1b6a03 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:55.738563 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0dfeb-93ef-43ca-a779-2308cf1b6a03 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:55.741516 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 682/1360] 10.222.0.50 () {54 vars in 911 bytes} [Tue Nov 16 00:25:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:55.746592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75680af-7b82-4dbe-982f-c47098e0b172 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:55.747030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75680af-7b82-4dbe-982f-c47098e0b172 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:55.747184 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75680af-7b82-4dbe-982f-c47098e0b172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:55.764555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-c75680af-7b82-4dbe-982f-c47098e0b172 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:55.765749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-c75680af-7b82-4dbe-982f-c47098e0b172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:55.773599 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 679/1361] 10.222.0.50 () {58 vars in 1008 bytes} [Tue Nov 16 00:25:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:55.923955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0dfeb-93ef-43ca-a779-2308cf1b6a03 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:55.939276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0dfeb-93ef-43ca-a779-2308cf1b6a03 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:55.945348 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92735f89-661f-4be8-8d90-8b70db731d3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:55.945981 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735f89-661f-4be8-8d90-8b70db731d3c service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:55.946261 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735f89-661f-4be8-8d90-8b70db731d3c service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:55.946533 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735f89-661f-4be8-8d90-8b70db731d3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:55.954519 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92735f89-661f-4be8-8d90-8b70db731d3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:55.956133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92735f89-661f-4be8-8d90-8b70db731d3c service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:55.966428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 683/1362] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:25:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:25:57.380222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283df381-e3bd-4235-a0d1-e33954640930 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:57.380790 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283df381-e3bd-4235-a0d1-e33954640930 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:57.380790 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283df381-e3bd-4235-a0d1-e33954640930 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:57.383112 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 680/1363] 10.222.0.50 () {54 vars in 911 bytes} [Tue Nov 16 00:25:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:57.388701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305c69c-05d4-4a25-bc9e-e68d6590def1 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:57.389146 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305c69c-05d4-4a25-bc9e-e68d6590def1 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:57.389292 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305c69c-05d4-4a25-bc9e-e68d6590def1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:57.407308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-a305c69c-05d4-4a25-bc9e-e68d6590def1 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:57.408486 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a305c69c-05d4-4a25-bc9e-e68d6590def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:57.417509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 684/1364] 10.222.0.50 () {58 vars in 1008 bytes} [Tue Nov 16 00:25:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:57.570705 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283df381-e3bd-4235-a0d1-e33954640930 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:57.585644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283df381-e3bd-4235-a0d1-e33954640930 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:57.591132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe544a-9c07-4a84-91dd-7e769b2b0412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:57.591829 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe544a-9c07-4a84-91dd-7e769b2b0412 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:57.592099 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe544a-9c07-4a84-91dd-7e769b2b0412 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:57.592373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe544a-9c07-4a84-91dd-7e769b2b0412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:57.601438 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe544a-9c07-4a84-91dd-7e769b2b0412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:57.603032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe544a-9c07-4a84-91dd-7e769b2b0412 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:57.612111 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 681/1365] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:25:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:25:59.042740 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c174-a223-46a1-a00a-79cb97bcaab9 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:59.043337 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c174-a223-46a1-a00a-79cb97bcaab9 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:59.043337 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c174-a223-46a1-a00a-79cb97bcaab9 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:59.045121 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 685/1366] 10.222.0.50 () {54 vars in 911 bytes} [Tue Nov 16 00:25:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:25:59.050605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6abed3-eea7-4f46-8d46-fb8e17dcae9a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:59.051137 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6abed3-eea7-4f46-8d46-fb8e17dcae9a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:59.051248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6abed3-eea7-4f46-8d46-fb8e17dcae9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:59.069478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0d6abed3-eea7-4f46-8d46-fb8e17dcae9a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:25:59.070654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0d6abed3-eea7-4f46-8d46-fb8e17dcae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:25:59.078238 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 682/1367] 10.222.0.50 () {58 vars in 1008 bytes} [Tue Nov 16 00:25:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:25:59.231523 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4c174-a223-46a1-a00a-79cb97bcaab9 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:25:59.245350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4c174-a223-46a1-a00a-79cb97bcaab9 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:25:59.250635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a226fb9-fc84-4af7-8bdd-5495e1f90876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:25:59.251314 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a226fb9-fc84-4af7-8bdd-5495e1f90876 service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:25:59.251595 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a226fb9-fc84-4af7-8bdd-5495e1f90876 service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:25:59.251872 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a226fb9-fc84-4af7-8bdd-5495e1f90876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:25:59.260101 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a226fb9-fc84-4af7-8bdd-5495e1f90876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:25:59.261705 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a226fb9-fc84-4af7-8bdd-5495e1f90876 service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:25:59.270726 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 686/1368] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:25:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:00.677716 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf9f34-2bd6-4c2c-99f6-45398607b733 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:00.678523 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf9f34-2bd6-4c2c-99f6-45398607b733 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:00.678523 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf9f34-2bd6-4c2c-99f6-45398607b733 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:00.680033 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 683/1369] 10.222.0.50 () {54 vars in 911 bytes} [Tue Nov 16 00:26:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:00.685666 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a1403-0363-42d5-ae6d-65bdb02d8efa None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:00.686066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a1403-0363-42d5-ae6d-65bdb02d8efa None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:00.686230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a1403-0363-42d5-ae6d-65bdb02d8efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:00.704793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-657a1403-0363-42d5-ae6d-65bdb02d8efa None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:00.705986 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-657a1403-0363-42d5-ae6d-65bdb02d8efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:00.714389 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 687/1370] 10.222.0.50 () {58 vars in 1008 bytes} [Tue Nov 16 00:26:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:00.869419 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf9f34-2bd6-4c2c-99f6-45398607b733 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:00.884251 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf9f34-2bd6-4c2c-99f6-45398607b733 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:00.889487 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbd506-fb54-47be-8af3-32b0e5e57739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:00.890110 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbd506-fb54-47be-8af3-32b0e5e57739 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:00.890393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbd506-fb54-47be-8af3-32b0e5e57739 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:00.890667 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbd506-fb54-47be-8af3-32b0e5e57739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:00.899115 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbd506-fb54-47be-8af3-32b0e5e57739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:00.900708 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbd506-fb54-47be-8af3-32b0e5e57739 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:00.909764 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 684/1371] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:02.264832 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3da44-3e64-4cc9-b562-407303209dcd None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:02.265377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3da44-3e64-4cc9-b562-407303209dcd None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:02.265377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3da44-3e64-4cc9-b562-407303209dcd None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:02.267244 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 688/1372] 10.222.0.50 () {54 vars in 911 bytes} [Tue Nov 16 00:26:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:02.273967 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d8d32-2196-4f7d-987d-33f8490fabc5 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:02.274393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d8d32-2196-4f7d-987d-33f8490fabc5 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:02.274525 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d8d32-2196-4f7d-987d-33f8490fabc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:02.292830 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-ec0d8d32-2196-4f7d-987d-33f8490fabc5 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:02.294008 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ec0d8d32-2196-4f7d-987d-33f8490fabc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:02.301762 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 685/1373] 10.222.0.50 () {58 vars in 1008 bytes} [Tue Nov 16 00:26:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:02.471114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3da44-3e64-4cc9-b562-407303209dcd None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:02.485618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3da44-3e64-4cc9-b562-407303209dcd None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:02.491193 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c3c2d-dbe1-4686-8fe3-a69966a0447a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:02.491826 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c3c2d-dbe1-4686-8fe3-a69966a0447a service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:02.492109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c3c2d-dbe1-4686-8fe3-a69966a0447a service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:02.492835 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c3c2d-dbe1-4686-8fe3-a69966a0447a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:02.500830 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c3c2d-dbe1-4686-8fe3-a69966a0447a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:02.502419 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c3c2d-dbe1-4686-8fe3-a69966a0447a service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:02.512345 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 689/1374] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:03.843400 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb2dc8-ef01-43d0-9839-97d67cb49f06 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:03.843988 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb2dc8-ef01-43d0-9839-97d67cb49f06 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:03.843988 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb2dc8-ef01-43d0-9839-97d67cb49f06 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:03.846026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 686/1375] 10.222.0.50 () {54 vars in 911 bytes} [Tue Nov 16 00:26:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:03.851620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7bb25-3da1-464b-a8f0-3cb27b968248 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:03.852021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7bb25-3da1-464b-a8f0-3cb27b968248 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:03.852188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7bb25-3da1-464b-a8f0-3cb27b968248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:03.869585 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-cbf7bb25-3da1-464b-a8f0-3cb27b968248 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:03.870765 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-cbf7bb25-3da1-464b-a8f0-3cb27b968248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:03.878395 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 690/1376] 10.222.0.50 () {58 vars in 1008 bytes} [Tue Nov 16 00:26:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:04.035325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb2dc8-ef01-43d0-9839-97d67cb49f06 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:04.053497 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb2dc8-ef01-43d0-9839-97d67cb49f06 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:04.059807 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7245f8a-2693-4e08-826f-8427dcc96d94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:04.060446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245f8a-2693-4e08-826f-8427dcc96d94 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:04.060729 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245f8a-2693-4e08-826f-8427dcc96d94 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:04.061007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245f8a-2693-4e08-826f-8427dcc96d94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:04.069056 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7245f8a-2693-4e08-826f-8427dcc96d94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:04.071205 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7245f8a-2693-4e08-826f-8427dcc96d94 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:04.080180 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 687/1377] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:05.439948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31605c40-e54a-48c7-b25d-1921a9cab02b None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:05.440552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31605c40-e54a-48c7-b25d-1921a9cab02b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:05.440552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31605c40-e54a-48c7-b25d-1921a9cab02b None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:05.442329 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 691/1378] 10.222.0.50 () {54 vars in 911 bytes} [Tue Nov 16 00:26:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:05.448207 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b655-4f33-426e-8514-cbf686b7affe None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:05.448610 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b655-4f33-426e-8514-cbf686b7affe None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:05.448768 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67b655-4f33-426e-8514-cbf686b7affe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:05.467241 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-4c67b655-4f33-426e-8514-cbf686b7affe None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:05.468426 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4c67b655-4f33-426e-8514-cbf686b7affe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:05.477288 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 688/1379] 10.222.0.50 () {58 vars in 1008 bytes} [Tue Nov 16 00:26:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:05.631183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31605c40-e54a-48c7-b25d-1921a9cab02b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:05.645196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31605c40-e54a-48c7-b25d-1921a9cab02b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:05.650662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9b35f-290e-448b-afd0-add174019b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:05.651326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b35f-290e-448b-afd0-add174019b22 service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:05.651610 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b35f-290e-448b-afd0-add174019b22 service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:05.651883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b35f-290e-448b-afd0-add174019b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:05.659681 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9b35f-290e-448b-afd0-add174019b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:05.661238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9b35f-290e-448b-afd0-add174019b22 service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:05.671258 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 692/1380] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:07.038500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa0ef8-3f31-4380-b7ea-8a1d9388642d None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:07.039077 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa0ef8-3f31-4380-b7ea-8a1d9388642d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:07.039276 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa0ef8-3f31-4380-b7ea-8a1d9388642d None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:07.040959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 689/1381] 10.222.0.50 () {54 vars in 911 bytes} [Tue Nov 16 00:26:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:07.046587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d067d5-9186-40f4-ac51-76663f4cbfd2 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:07.047039 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d067d5-9186-40f4-ac51-76663f4cbfd2 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:07.047187 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d067d5-9186-40f4-ac51-76663f4cbfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:07.065426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c4d067d5-9186-40f4-ac51-76663f4cbfd2 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:07.066630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c4d067d5-9186-40f4-ac51-76663f4cbfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:07.074796 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 693/1382] 10.222.0.50 () {58 vars in 1008 bytes} [Tue Nov 16 00:26:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:07.227805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa0ef8-3f31-4380-b7ea-8a1d9388642d None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:07.241942 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa0ef8-3f31-4380-b7ea-8a1d9388642d None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:07.247342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda5b38-144a-4626-8f6b-e68960538039 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:07.247975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda5b38-144a-4626-8f6b-e68960538039 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:07.248262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda5b38-144a-4626-8f6b-e68960538039 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:07.248540 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda5b38-144a-4626-8f6b-e68960538039 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:07.256403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda5b38-144a-4626-8f6b-e68960538039 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:07.258206 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda5b38-144a-4626-8f6b-e68960538039 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:07.267353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 690/1383] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:09.345927 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd73f6c-5d88-480e-9a7c-c71ad951e759 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:09.346524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd73f6c-5d88-480e-9a7c-c71ad951e759 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:09.346625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd73f6c-5d88-480e-9a7c-c71ad951e759 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:09.348605 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 694/1384] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:09.356695 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2968f2-1e8c-4e69-8778-6f6bcdc64f65 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:09.357152 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2968f2-1e8c-4e69-8778-6f6bcdc64f65 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:09.357329 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2968f2-1e8c-4e69-8778-6f6bcdc64f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:09.375461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-aa2968f2-1e8c-4e69-8778-6f6bcdc64f65 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:09.376679 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-aa2968f2-1e8c-4e69-8778-6f6bcdc64f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:09.384713 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 691/1385] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:09.432477 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd73f6c-5d88-480e-9a7c-c71ad951e759 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:09.443014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd73f6c-5d88-480e-9a7c-c71ad951e759 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:09.446806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce93a98-83bf-48ff-8000-993e1a0d595c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:09.447479 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce93a98-83bf-48ff-8000-993e1a0d595c service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:09.447769 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce93a98-83bf-48ff-8000-993e1a0d595c service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:09.448052 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce93a98-83bf-48ff-8000-993e1a0d595c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:09.456787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce93a98-83bf-48ff-8000-993e1a0d595c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:09.458227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce93a98-83bf-48ff-8000-993e1a0d595c service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:09.467927 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 695/1386] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:11.807577 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc86bf-b859-4d0e-bd6b-d5d0a5e06151 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:11.808167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc86bf-b859-4d0e-bd6b-d5d0a5e06151 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:11.808167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc86bf-b859-4d0e-bd6b-d5d0a5e06151 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:11.809953 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 692/1387] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:11.817351 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6aec2-a099-4f3b-b6b8-5ba6fe8b9b90 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:11.817798 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6aec2-a099-4f3b-b6b8-5ba6fe8b9b90 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:11.817901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6aec2-a099-4f3b-b6b8-5ba6fe8b9b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:11.836061 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-1da6aec2-a099-4f3b-b6b8-5ba6fe8b9b90 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:11.837246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-1da6aec2-a099-4f3b-b6b8-5ba6fe8b9b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:11.845446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 696/1388] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:11.885849 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc86bf-b859-4d0e-bd6b-d5d0a5e06151 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:11.896864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc86bf-b859-4d0e-bd6b-d5d0a5e06151 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:11.900468 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d84b0-e81d-4bb1-bfde-d7e565b8cd68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:11.901105 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d84b0-e81d-4bb1-bfde-d7e565b8cd68 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:11.901393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d84b0-e81d-4bb1-bfde-d7e565b8cd68 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:11.901672 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d84b0-e81d-4bb1-bfde-d7e565b8cd68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:11.910325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d84b0-e81d-4bb1-bfde-d7e565b8cd68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:11.911806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d84b0-e81d-4bb1-bfde-d7e565b8cd68 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:11.921126 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 693/1389] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:14.365605 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f7330-896a-44ff-9b76-c6ffe66f97a0 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:14.366752 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f7330-896a-44ff-9b76-c6ffe66f97a0 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:14.367043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f7330-896a-44ff-9b76-c6ffe66f97a0 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:14.368877 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 697/1390] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:14.376025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6375a25-16dc-41db-a8c0-c82e3db7e71a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:14.376440 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6375a25-16dc-41db-a8c0-c82e3db7e71a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:14.376581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6375a25-16dc-41db-a8c0-c82e3db7e71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:14.394320 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-e6375a25-16dc-41db-a8c0-c82e3db7e71a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:14.395553 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e6375a25-16dc-41db-a8c0-c82e3db7e71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:14.403462 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 694/1391] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:14.443284 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f7330-896a-44ff-9b76-c6ffe66f97a0 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:14.454018 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f7330-896a-44ff-9b76-c6ffe66f97a0 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:14.457534 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373503f-c7e9-4698-9ec6-04f3157d35ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:14.458159 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373503f-c7e9-4698-9ec6-04f3157d35ad service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:14.458441 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373503f-c7e9-4698-9ec6-04f3157d35ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:14.458717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373503f-c7e9-4698-9ec6-04f3157d35ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:14.467723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373503f-c7e9-4698-9ec6-04f3157d35ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:14.469139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373503f-c7e9-4698-9ec6-04f3157d35ad service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:14.479364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 698/1392] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:16.769955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b44e5-5777-4481-aa49-4d7466d3f421 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:16.770506 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b44e5-5777-4481-aa49-4d7466d3f421 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:16.770506 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b44e5-5777-4481-aa49-4d7466d3f421 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:16.772948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 695/1393] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:16.780020 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a795c1-6960-48d6-85c2-961ee27d9ce9 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:16.780450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a795c1-6960-48d6-85c2-961ee27d9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:16.780593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a795c1-6960-48d6-85c2-961ee27d9ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:16.798202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-62a795c1-6960-48d6-85c2-961ee27d9ce9 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:16.799406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-62a795c1-6960-48d6-85c2-961ee27d9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:16.807148 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 699/1394] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:16.850352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b44e5-5777-4481-aa49-4d7466d3f421 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:16.860882 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b44e5-5777-4481-aa49-4d7466d3f421 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:16.864397 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508eeeb-6435-43ea-901c-09a88e65095c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:16.865031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508eeeb-6435-43ea-901c-09a88e65095c service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:16.865318 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508eeeb-6435-43ea-901c-09a88e65095c service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:16.865597 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508eeeb-6435-43ea-901c-09a88e65095c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:16.874398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508eeeb-6435-43ea-901c-09a88e65095c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:16.875872 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508eeeb-6435-43ea-901c-09a88e65095c service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:16.885576 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 696/1395] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:19.184331 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fc97f-3b28-46ba-83c5-502119052d27 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:19.186372 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fc97f-3b28-46ba-83c5-502119052d27 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:19.186372 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fc97f-3b28-46ba-83c5-502119052d27 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:19.186968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 700/1396] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:19.194928 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfca9b0-4c73-47fb-a292-532f544c0fe6 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:19.195396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfca9b0-4c73-47fb-a292-532f544c0fe6 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:19.195499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfca9b0-4c73-47fb-a292-532f544c0fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:19.216246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-dcfca9b0-4c73-47fb-a292-532f544c0fe6 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:19.219149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-dcfca9b0-4c73-47fb-a292-532f544c0fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:19.226290 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 697/1397] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:19.266352 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fc97f-3b28-46ba-83c5-502119052d27 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:19.277544 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fc97f-3b28-46ba-83c5-502119052d27 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:19.281043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba84d10-2708-4cf5-b3ff-e2b093f25c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:19.281677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84d10-2708-4cf5-b3ff-e2b093f25c4f service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:19.281961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84d10-2708-4cf5-b3ff-e2b093f25c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:19.282234 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84d10-2708-4cf5-b3ff-e2b093f25c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:19.291420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba84d10-2708-4cf5-b3ff-e2b093f25c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:19.292842 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba84d10-2708-4cf5-b3ff-e2b093f25c4f service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:19.301862 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 701/1398] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:21.532649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e32d-3e8a-4d68-a9f5-19f9479ae0e7 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:21.533189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e32d-3e8a-4d68-a9f5-19f9479ae0e7 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:21.533189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e32d-3e8a-4d68-a9f5-19f9479ae0e7 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:21.535015 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 698/1399] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:21.542999 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00871b51-38e0-43e8-a140-a1be78177947 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:21.543421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00871b51-38e0-43e8-a140-a1be78177947 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:21.543555 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00871b51-38e0-43e8-a140-a1be78177947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:21.560839 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-00871b51-38e0-43e8-a140-a1be78177947 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:21.562044 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-00871b51-38e0-43e8-a140-a1be78177947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:21.569653 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 702/1400] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:21.609723 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92e32d-3e8a-4d68-a9f5-19f9479ae0e7 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:21.620301 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92e32d-3e8a-4d68-a9f5-19f9479ae0e7 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:21.623828 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4d879-f729-4a0d-bac7-6db2016afbae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:21.624454 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4d879-f729-4a0d-bac7-6db2016afbae service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:21.624738 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4d879-f729-4a0d-bac7-6db2016afbae service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:21.625017 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4d879-f729-4a0d-bac7-6db2016afbae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:21.634400 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4d879-f729-4a0d-bac7-6db2016afbae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:21.636142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4d879-f729-4a0d-bac7-6db2016afbae service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:21.645260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 699/1401] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:23.883059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48028888-de72-43b8-9395-e343522248c3 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:23.883637 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48028888-de72-43b8-9395-e343522248c3 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:23.883637 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48028888-de72-43b8-9395-e343522248c3 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:23.885388 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 703/1402] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:23.892462 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96336c45-5f1a-4adc-bd20-4fcb82e95815 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:23.892919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96336c45-5f1a-4adc-bd20-4fcb82e95815 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:23.893052 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96336c45-5f1a-4adc-bd20-4fcb82e95815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:23.910505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-96336c45-5f1a-4adc-bd20-4fcb82e95815 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:23.911738 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-96336c45-5f1a-4adc-bd20-4fcb82e95815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:23.919580 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 700/1403] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:23.958778 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48028888-de72-43b8-9395-e343522248c3 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:23.969274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48028888-de72-43b8-9395-e343522248c3 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:23.973032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699efc48-5761-4248-9034-2c0f07dc84eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:23.973666 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699efc48-5761-4248-9034-2c0f07dc84eb service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:23.973950 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699efc48-5761-4248-9034-2c0f07dc84eb service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:23.974227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699efc48-5761-4248-9034-2c0f07dc84eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:23.983968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699efc48-5761-4248-9034-2c0f07dc84eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:23.985425 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699efc48-5761-4248-9034-2c0f07dc84eb service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:23.995131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 704/1404] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:26.243308 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4043-1671-49d8-85ba-d12f53cd0bbd None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:26.243849 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4043-1671-49d8-85ba-d12f53cd0bbd None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:26.243849 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4043-1671-49d8-85ba-d12f53cd0bbd None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:26.245552 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 701/1405] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:26.252947 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb1d80-c54e-40c1-b3fb-6b4db998d24b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:26.253365 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb1d80-c54e-40c1-b3fb-6b4db998d24b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:26.253514 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb1d80-c54e-40c1-b3fb-6b4db998d24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:26.270977 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-12eb1d80-c54e-40c1-b3fb-6b4db998d24b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:26.272729 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-12eb1d80-c54e-40c1-b3fb-6b4db998d24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:26.280630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 705/1406] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:26.319810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff4043-1671-49d8-85ba-d12f53cd0bbd None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:26.330488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff4043-1671-49d8-85ba-d12f53cd0bbd None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:26.334441 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcfa9d-7d4f-49bb-88c0-bda417a0a44f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:26.335716 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcfa9d-7d4f-49bb-88c0-bda417a0a44f service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:26.336003 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcfa9d-7d4f-49bb-88c0-bda417a0a44f service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:26.336280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcfa9d-7d4f-49bb-88c0-bda417a0a44f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:26.345393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcfa9d-7d4f-49bb-88c0-bda417a0a44f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:26.347143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcfa9d-7d4f-49bb-88c0-bda417a0a44f service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:26.356972 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 702/1407] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:28.547367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dfc1f-8e59-4723-ac44-029a99e5df06 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:28.547932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dfc1f-8e59-4723-ac44-029a99e5df06 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:28.547932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dfc1f-8e59-4723-ac44-029a99e5df06 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:28.549724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 706/1408] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:28.557513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966225d-2d98-490c-b199-d25bf2cd1d52 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:28.557982 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966225d-2d98-490c-b199-d25bf2cd1d52 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:28.558091 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966225d-2d98-490c-b199-d25bf2cd1d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:28.579868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7966225d-2d98-490c-b199-d25bf2cd1d52 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:28.580991 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7966225d-2d98-490c-b199-d25bf2cd1d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:28.588833 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 703/1409] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:26:28.627804 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dfc1f-8e59-4723-ac44-029a99e5df06 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:28.638209 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dfc1f-8e59-4723-ac44-029a99e5df06 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:28.641683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150fab4-d13b-4516-98b1-8ebe3d30e5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:28.642311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150fab4-d13b-4516-98b1-8ebe3d30e5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:28.642594 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150fab4-d13b-4516-98b1-8ebe3d30e5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:28.642897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150fab4-d13b-4516-98b1-8ebe3d30e5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:28.651565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150fab4-d13b-4516-98b1-8ebe3d30e5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:28.652982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150fab4-d13b-4516-98b1-8ebe3d30e5b4 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:28.661937 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 707/1410] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:30.847017 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0309d-97c6-494b-8d89-b2756ca88220 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:30.847577 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0309d-97c6-494b-8d89-b2756ca88220 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:30.847577 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0309d-97c6-494b-8d89-b2756ca88220 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:30.849354 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 704/1411] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:30.856905 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93063-b186-48cd-a36b-10d17c9e8809 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:30.857350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93063-b186-48cd-a36b-10d17c9e8809 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:30.857464 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93063-b186-48cd-a36b-10d17c9e8809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:30.875640 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-0df93063-b186-48cd-a36b-10d17c9e8809 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:30.876835 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0df93063-b186-48cd-a36b-10d17c9e8809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:30.884600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 708/1412] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:30.926337 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0309d-97c6-494b-8d89-b2756ca88220 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:30.943393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0309d-97c6-494b-8d89-b2756ca88220 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:30.947096 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede00fd8-39ae-4e65-b4af-d110207ba188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:30.947750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede00fd8-39ae-4e65-b4af-d110207ba188 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:30.948032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede00fd8-39ae-4e65-b4af-d110207ba188 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:30.948313 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede00fd8-39ae-4e65-b4af-d110207ba188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:30.958050 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede00fd8-39ae-4e65-b4af-d110207ba188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:30.959521 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede00fd8-39ae-4e65-b4af-d110207ba188 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:30.968731 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 705/1413] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:47.779227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3661ec-cb00-4901-b2f0-b12304ba6f8d None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:47.779800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3661ec-cb00-4901-b2f0-b12304ba6f8d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:47.779800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3661ec-cb00-4901-b2f0-b12304ba6f8d None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:47.781565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 709/1414] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:47.787429 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea59da-7e2b-48a2-8c9c-cf19a728ad50 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:47.787918 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea59da-7e2b-48a2-8c9c-cf19a728ad50 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:47.788120 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea59da-7e2b-48a2-8c9c-cf19a728ad50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:47.805946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-ceea59da-7e2b-48a2-8c9c-cf19a728ad50 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:47.807171 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ceea59da-7e2b-48a2-8c9c-cf19a728ad50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:47.814806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 706/1415] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:26:47.863226 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450cca3-db26-4189-8b2f-1f9d9812ff30 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:47.863516 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450cca3-db26-4189-8b2f-1f9d9812ff30 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:47.863799 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450cca3-db26-4189-8b2f-1f9d9812ff30 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:47.865551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 710/1416] 10.222.0.50 () {54 vars in 956 bytes} [Tue Nov 16 00:26:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:47.871253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3825277-d972-4ffb-8b71-36881e1ae49b None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:47.871569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3825277-d972-4ffb-8b71-36881e1ae49b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:47.871857 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3825277-d972-4ffb-8b71-36881e1ae49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:47.890175 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f3825277-d972-4ffb-8b71-36881e1ae49b None None] MFA Rules not processed for user `8cab78404d3c4980a4b99da09edab426`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:47.891397 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f3825277-d972-4ffb-8b71-36881e1ae49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:47.897708 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 707/1417] 10.222.0.50 () {58 vars in 1053 bytes} [Tue Nov 16 00:26:47 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:47.905002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450cca3-db26-4189-8b2f-1f9d9812ff30 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:47.915466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450cca3-db26-4189-8b2f-1f9d9812ff30 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:47.918961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c5464-e92a-4812-b11b-e7605dd2e23e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cab78404d3c4980a4b99da09edab426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:47.919589 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5464-e92a-4812-b11b-e7605dd2e23e service glance] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:47.919873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5464-e92a-4812-b11b-e7605dd2e23e service glance] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:47.920147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5464-e92a-4812-b11b-e7605dd2e23e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:47.930114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c5464-e92a-4812-b11b-e7605dd2e23e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:47.931579 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c5464-e92a-4812-b11b-e7605dd2e23e service glance] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:47.940912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 711/1418] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:50.189556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6be20-c05e-4030-9f2a-ca5b46c1e170 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:50.190066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6be20-c05e-4030-9f2a-ca5b46c1e170 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:50.190066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6be20-c05e-4030-9f2a-ca5b46c1e170 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:50.191843 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 708/1419] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:50.198938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05ad0c-ce8e-4819-939c-5754cd74dead None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:50.199397 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05ad0c-ce8e-4819-939c-5754cd74dead None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:50.199507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05ad0c-ce8e-4819-939c-5754cd74dead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:50.217494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-5e05ad0c-ce8e-4819-939c-5754cd74dead None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:50.218673 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-5e05ad0c-ce8e-4819-939c-5754cd74dead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:50.227404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 712/1420] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:50.250509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6be20-c05e-4030-9f2a-ca5b46c1e170 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:50.262721 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6be20-c05e-4030-9f2a-ca5b46c1e170 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:50.267221 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16234f-bbf2-4f33-ab7e-79703625d99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:50.267857 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16234f-bbf2-4f33-ab7e-79703625d99d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:50.268142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16234f-bbf2-4f33-ab7e-79703625d99d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:50.268418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16234f-bbf2-4f33-ab7e-79703625d99d admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:50.269142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16234f-bbf2-4f33-ab7e-79703625d99d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:50.271025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16234f-bbf2-4f33-ab7e-79703625d99d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:50.284729 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 709/1421] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Nov 16 00:26:50 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:26:52.519497 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b6f24-f61e-47e1-8d43-e4059452a68d None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:52.520026 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b6f24-f61e-47e1-8d43-e4059452a68d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:52.520026 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b6f24-f61e-47e1-8d43-e4059452a68d None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:52.522343 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 713/1422] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:52.529836 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c394a-0686-4211-bd32-5bd77cdf4c6f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:52.530369 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c394a-0686-4211-bd32-5bd77cdf4c6f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:52.530479 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c394a-0686-4211-bd32-5bd77cdf4c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:52.548554 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-619c394a-0686-4211-bd32-5bd77cdf4c6f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:52.549756 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-619c394a-0686-4211-bd32-5bd77cdf4c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:52.557585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 710/1423] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:52.601987 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b6f24-f61e-47e1-8d43-e4059452a68d None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:52.616060 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b6f24-f61e-47e1-8d43-e4059452a68d None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:52.621550 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793a8f3-6cdd-4b0a-bde1-81b1a185303e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:52.622183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793a8f3-6cdd-4b0a-bde1-81b1a185303e service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:52.622470 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793a8f3-6cdd-4b0a-bde1-81b1a185303e service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:52.622749 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793a8f3-6cdd-4b0a-bde1-81b1a185303e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:52.630676 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793a8f3-6cdd-4b0a-bde1-81b1a185303e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:52.632870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793a8f3-6cdd-4b0a-bde1-81b1a185303e service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:52.642019 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 714/1424] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:54.994739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c768-77b6-47d8-b1a8-69023d820b9c None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:54.995288 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c768-77b6-47d8-b1a8-69023d820b9c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:54.995409 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c768-77b6-47d8-b1a8-69023d820b9c None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:54.997179 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 711/1425] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:55.004755 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e7627-979a-40b5-9141-0a89c73a06e2 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:55.005158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e7627-979a-40b5-9141-0a89c73a06e2 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:55.005315 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e7627-979a-40b5-9141-0a89c73a06e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:55.023914 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-168e7627-979a-40b5-9141-0a89c73a06e2 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:55.025114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-168e7627-979a-40b5-9141-0a89c73a06e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:55.032885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 715/1426] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:55.071267 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5c768-77b6-47d8-b1a8-69023d820b9c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:55.081904 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5c768-77b6-47d8-b1a8-69023d820b9c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:55.086562 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910cb78-a88d-4690-bf0f-830a8a623917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:55.087231 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910cb78-a88d-4690-bf0f-830a8a623917 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:55.087516 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910cb78-a88d-4690-bf0f-830a8a623917 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:55.087797 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910cb78-a88d-4690-bf0f-830a8a623917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:55.096722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910cb78-a88d-4690-bf0f-830a8a623917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:55.098156 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910cb78-a88d-4690-bf0f-830a8a623917 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:55.108042 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 712/1427] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:26:57.333774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71932d6a-045e-4006-a400-818135bac945 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:57.334899 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71932d6a-045e-4006-a400-818135bac945 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:57.335029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71932d6a-045e-4006-a400-818135bac945 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:57.336774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 716/1428] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:57.343788 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12cbe8-0ba6-41ab-8eb4-8d132de539e7 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:57.344186 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12cbe8-0ba6-41ab-8eb4-8d132de539e7 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:57.344349 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12cbe8-0ba6-41ab-8eb4-8d132de539e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:57.362013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-8e12cbe8-0ba6-41ab-8eb4-8d132de539e7 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:57.363231 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8e12cbe8-0ba6-41ab-8eb4-8d132de539e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:57.371023 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 713/1429] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:57.410495 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71932d6a-045e-4006-a400-818135bac945 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:57.422037 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71932d6a-045e-4006-a400-818135bac945 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:57.425750 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3fbb4-91d7-473f-85ee-793d4f376fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:57.426425 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3fbb4-91d7-473f-85ee-793d4f376fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:57.427025 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3fbb4-91d7-473f-85ee-793d4f376fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:57.427306 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3fbb4-91d7-473f-85ee-793d4f376fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:57.437016 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3fbb4-91d7-473f-85ee-793d4f376fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:57.438490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3fbb4-91d7-473f-85ee-793d4f376fc4 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:57.448652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 717/1430] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:26:59.683633 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f7617-c62d-47d9-83f6-4cd001f6b537 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:59.684205 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f7617-c62d-47d9-83f6-4cd001f6b537 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:59.684205 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f7617-c62d-47d9-83f6-4cd001f6b537 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:59.685994 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 714/1431] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:26:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:26:59.692956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984356e-d3b9-4096-affb-d37a5d1f0abe None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:59.693373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984356e-d3b9-4096-affb-d37a5d1f0abe None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:59.693536 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984356e-d3b9-4096-affb-d37a5d1f0abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:59.711614 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-e984356e-d3b9-4096-affb-d37a5d1f0abe None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:26:59.712776 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e984356e-d3b9-4096-affb-d37a5d1f0abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:26:59.720515 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 718/1432] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:26:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:26:59.762698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f7617-c62d-47d9-83f6-4cd001f6b537 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:26:59.773854 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f7617-c62d-47d9-83f6-4cd001f6b537 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:26:59.777393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1378e4-f6a2-4122-9489-c2b069b0317e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:26:59.778025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1378e4-f6a2-4122-9489-c2b069b0317e service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:26:59.778314 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1378e4-f6a2-4122-9489-c2b069b0317e service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:26:59.778596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1378e4-f6a2-4122-9489-c2b069b0317e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:26:59.789055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1378e4-f6a2-4122-9489-c2b069b0317e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:26:59.790791 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1378e4-f6a2-4122-9489-c2b069b0317e service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:26:59.800416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 715/1433] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:26:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:27:02.213968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413f784-193a-452e-a520-f025f9da0cb4 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:27:02.214495 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413f784-193a-452e-a520-f025f9da0cb4 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:27:02.214495 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413f784-193a-452e-a520-f025f9da0cb4 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:27:02.216251 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 719/1434] 10.222.0.50 () {54 vars in 926 bytes} [Tue Nov 16 00:27:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:27:02.223781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81ff85-3c63-4483-9194-634804cf54c0 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:27:02.224249 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81ff85-3c63-4483-9194-634804cf54c0 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:27:02.224356 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81ff85-3c63-4483-9194-634804cf54c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:27:02.242564 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-dc81ff85-3c63-4483-9194-634804cf54c0 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:27:02.243797 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-dc81ff85-3c63-4483-9194-634804cf54c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:27:02.251471 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 716/1435] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Nov 16 00:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:27:02.291867 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413f784-193a-452e-a520-f025f9da0cb4 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:27:02.302164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413f784-193a-452e-a520-f025f9da0cb4 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:27:02.306219 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a895f-4fb5-4fa4-8137-f0417a87f69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:27:02.306866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a895f-4fb5-4fa4-8137-f0417a87f69d service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:27:02.307164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a895f-4fb5-4fa4-8137-f0417a87f69d service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:27:02.307439 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a895f-4fb5-4fa4-8137-f0417a87f69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:27:02.316148 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a895f-4fb5-4fa4-8137-f0417a87f69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:27:02.317593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a895f-4fb5-4fa4-8137-f0417a87f69d service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:27:02.327708 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 720/1436] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:27:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:28:14.757192 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dd0a3-09ef-49fb-aced-d9851b172dd2 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:14.757755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dd0a3-09ef-49fb-aced-d9851b172dd2 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:14.757755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dd0a3-09ef-49fb-aced-d9851b172dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:14.775659 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f60dd0a3-09ef-49fb-aced-d9851b172dd2 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:28:14.776830 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f60dd0a3-09ef-49fb-aced-d9851b172dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:28:14.784794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 717/1437] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:28:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:28:14.793307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51cfb1-dcf6-4f81-ade6-311adc483eea None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:14.793819 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51cfb1-dcf6-4f81-ade6-311adc483eea None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:14.793917 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51cfb1-dcf6-4f81-ade6-311adc483eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:14.811993 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-8c51cfb1-dcf6-4f81-ade6-311adc483eea None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:28:14.813159 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8c51cfb1-dcf6-4f81-ade6-311adc483eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:28:14.821088 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 721/1438] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:28:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:28:14.825496 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dd0a3-09ef-49fb-aced-d9851b172dd2 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:28:14.835605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dd0a3-09ef-49fb-aced-d9851b172dd2 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:28:14.840100 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040cad1-2b74-4d65-8304-7fb68c3b7201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:28:14.840746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040cad1-2b74-4d65-8304-7fb68c3b7201 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:14.841032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040cad1-2b74-4d65-8304-7fb68c3b7201 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:14.841311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040cad1-2b74-4d65-8304-7fb68c3b7201 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:14.842068 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040cad1-2b74-4d65-8304-7fb68c3b7201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:28:14.842377 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040cad1-2b74-4d65-8304-7fb68c3b7201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:28:14.844066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040cad1-2b74-4d65-8304-7fb68c3b7201 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:28:14.855963 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 718/1439] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:28:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:28:14.864377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51cfb1-dcf6-4f81-ade6-311adc483eea None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:28:14.873249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51cfb1-dcf6-4f81-ade6-311adc483eea None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:28:14.877873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc193ad-e44d-4386-9aca-9f18704d6646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:28:14.878517 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc193ad-e44d-4386-9aca-9f18704d6646 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:14.878800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc193ad-e44d-4386-9aca-9f18704d6646 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:14.879116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc193ad-e44d-4386-9aca-9f18704d6646 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:14.879845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc193ad-e44d-4386-9aca-9f18704d6646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:28:14.881748 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc193ad-e44d-4386-9aca-9f18704d6646 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:28:14.919190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 722/1440] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:28:14 2021] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:28:14.923502 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040cad1-2b74-4d65-8304-7fb68c3b7201 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:28:14.933632 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040cad1-2b74-4d65-8304-7fb68c3b7201 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:28:14.988614 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e5e4e-7825-4e49-adde-9d59a1ca6cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:28:14.989333 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e5e4e-7825-4e49-adde-9d59a1ca6cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:14.989616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e5e4e-7825-4e49-adde-9d59a1ca6cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:14.989902 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e5e4e-7825-4e49-adde-9d59a1ca6cd1 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:14.990593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e5e4e-7825-4e49-adde-9d59a1ca6cd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:28:14.992578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e5e4e-7825-4e49-adde-9d59a1ca6cd1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:28:15.011515 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 719/1441] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:28:14 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:28:15.015529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc193ad-e44d-4386-9aca-9f18704d6646 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:28:15.026359 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc193ad-e44d-4386-9aca-9f18704d6646 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:28:15.031191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d2cde-aa35-4289-8ff5-4c733b1012ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:28:15.031853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d2cde-aa35-4289-8ff5-4c733b1012ff admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:15.032149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d2cde-aa35-4289-8ff5-4c733b1012ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:15.032426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d2cde-aa35-4289-8ff5-4c733b1012ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:15.033147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d2cde-aa35-4289-8ff5-4c733b1012ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:28:15.034746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d2cde-aa35-4289-8ff5-4c733b1012ff admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:28:15.047792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 723/1442] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:28:15 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:28:15.051907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e5e4e-7825-4e49-adde-9d59a1ca6cd1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:28:15.061638 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e5e4e-7825-4e49-adde-9d59a1ca6cd1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:28:15.066139 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92b0a7-1cf6-4f49-a84e-022ce3e2e1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:28:15.066789 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92b0a7-1cf6-4f49-a84e-022ce3e2e1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:15.067620 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92b0a7-1cf6-4f49-a84e-022ce3e2e1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:15.067935 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92b0a7-1cf6-4f49-a84e-022ce3e2e1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:15.068685 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92b0a7-1cf6-4f49-a84e-022ce3e2e1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:28:15.070278 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92b0a7-1cf6-4f49-a84e-022ce3e2e1d9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:28:15.084015 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 720/1443] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:28:15 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:28:15.087915 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d2cde-aa35-4289-8ff5-4c733b1012ff admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:28:15.097474 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d2cde-aa35-4289-8ff5-4c733b1012ff admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:28:15.102362 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0c7ba-140a-4275-a91f-64ab581db341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:28:15.103261 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0c7ba-140a-4275-a91f-64ab581db341 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:15.103551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0c7ba-140a-4275-a91f-64ab581db341 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:15.103835 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0c7ba-140a-4275-a91f-64ab581db341 admin admin] PATH_INFO: `/v3/projects/9a2d92e6351d477f80e5aced420a29df/users/174867232ed34a358f62579b3a9233ef/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:15.117865 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0c7ba-140a-4275-a91f-64ab581db341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2d92e6351d477f80e5aced420a29df, user_id=174867232ed34a358f62579b3a9233ef, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:28:15.120552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0c7ba-140a-4275-a91f-64ab581db341 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:28:15.133513 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 724/1444] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:28:15 2021] PUT /identity/v3/projects/9a2d92e6351d477f80e5aced420a29df/users/174867232ed34a358f62579b3a9233ef/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:28:15.144617 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792e4ed-25b8-48f6-9411-c2c304639b9d None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:15.144913 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792e4ed-25b8-48f6-9411-c2c304639b9d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:15.145194 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792e4ed-25b8-48f6-9411-c2c304639b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:15.171127 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-9792e4ed-25b8-48f6-9411-c2c304639b9d None None] MFA Rules not processed for user `174867232ed34a358f62579b3a9233ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:28:15.172333 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9792e4ed-25b8-48f6-9411-c2c304639b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:28:15.233122 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 721/1445] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:28:15 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:28:15.245020 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0c7ba-140a-4275-a91f-64ab581db341 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:28:15.312296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0c7ba-140a-4275-a91f-64ab581db341 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:28:15.318135 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ae248-0fe4-40df-b871-c4483b8191c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:28:15.318779 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ae248-0fe4-40df-b871-c4483b8191c8 service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:15.319089 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ae248-0fe4-40df-b871-c4483b8191c8 service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:15.319364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ae248-0fe4-40df-b871-c4483b8191c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:15.326787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ae248-0fe4-40df-b871-c4483b8191c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:28:15.328383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ae248-0fe4-40df-b871-c4483b8191c8 service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:28:15.337241 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 725/1446] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:28:15 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:28:15.405164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15655fda-40db-4d41-820e-d3f61ab75457 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:15.405598 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15655fda-40db-4d41-820e-d3f61ab75457 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:15.405883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15655fda-40db-4d41-820e-d3f61ab75457 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:15.407628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 722/1447] 10.222.0.50 () {52 vars in 829 bytes} [Tue Nov 16 00:28:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:28:15.412011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ae248-0fe4-40df-b871-c4483b8191c8 service nova] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:28:15.471466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ae248-0fe4-40df-b871-c4483b8191c8 service nova] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:28:15.477398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:28:15.478255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:15.478543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:15.478818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] PATH_INFO: `/v3/users/174867232ed34a358f62579b3a9233ef` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:15.480023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=174867232ed34a358f62579b3a9233ef)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:28:15.481045 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:28:15.481045 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:28:15.481045 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:28:15.482237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:28:15.546107 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174867232ed34a358f62579b3a9233ef'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:28:15.558361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174867232ed34a358f62579b3a9233ef'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:28:15.559145 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174867232ed34a358f62579b3a9233ef'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:28:15.577821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174867232ed34a358f62579b3a9233ef'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:28:15.578407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174867232ed34a358f62579b3a9233ef'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:28:15.593786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 726/1448] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:28:15 2021] DELETE /identity/v3/users/174867232ed34a358f62579b3a9233ef => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:28:15.599090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3d5ab-41b5-4d3a-9cc9-90e0d561e9ac None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:15.599379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3d5ab-41b5-4d3a-9cc9-90e0d561e9ac None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:15.599657 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3d5ab-41b5-4d3a-9cc9-90e0d561e9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:15.616488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-abd3d5ab-41b5-4d3a-9cc9-90e0d561e9ac None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:28:15.617670 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-abd3d5ab-41b5-4d3a-9cc9-90e0d561e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:28:15.673079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 723/1449] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:28:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:28:15.682759 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:28:15.684251 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:28:15.738938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beca3aa-a161-41ca-a933-38eae99a0f5a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:28:15.743122 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06790b99-ad5b-4085-b8ef-324a8e4db90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:28:15.744239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790b99-ad5b-4085-b8ef-324a8e4db90f service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:15.744239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790b99-ad5b-4085-b8ef-324a8e4db90f service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:15.745721 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790b99-ad5b-4085-b8ef-324a8e4db90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:15.755880 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06790b99-ad5b-4085-b8ef-324a8e4db90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:28:15.757364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06790b99-ad5b-4085-b8ef-324a8e4db90f service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:28:15.766687 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 727/1450] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:28:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:28:16.084418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3d5ab-41b5-4d3a-9cc9-90e0d561e9ac None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:28:16.086012 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-abd3d5ab-41b5-4d3a-9cc9-90e0d561e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:28:16.097504 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3d5ab-41b5-4d3a-9cc9-90e0d561e9ac None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:28:16.102966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f2cb0-4d2e-4b27-81ea-5415092e127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:28:16.103925 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f2cb0-4d2e-4b27-81ea-5415092e127b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:28:16.104286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f2cb0-4d2e-4b27-81ea-5415092e127b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:28:16.104643 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f2cb0-4d2e-4b27-81ea-5415092e127b admin admin] PATH_INFO: `/v3/projects/9a2d92e6351d477f80e5aced420a29df` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:28:16.105973 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f2cb0-4d2e-4b27-81ea-5415092e127b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2d92e6351d477f80e5aced420a29df)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:28:16.107213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-617f2cb0-4d2e-4b27-81ea-5415092e127b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:28:16.107213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:28:16.107213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:28:16.108581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f2cb0-4d2e-4b27-81ea-5415092e127b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:28:16.167167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-617f2cb0-4d2e-4b27-81ea-5415092e127b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2d92e6351d477f80e5aced420a29df', 'request_id': 'req-617f2cb0-4d2e-4b27-81ea-5415092e127b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:28:16.180530 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-617f2cb0-4d2e-4b27-81ea-5415092e127b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2d92e6351d477f80e5aced420a29df', 'request_id': 'req-617f2cb0-4d2e-4b27-81ea-5415092e127b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:28:16.191400 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-617f2cb0-4d2e-4b27-81ea-5415092e127b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2d92e6351d477f80e5aced420a29df', 'request_id': 'req-617f2cb0-4d2e-4b27-81ea-5415092e127b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:28:16.202865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-617f2cb0-4d2e-4b27-81ea-5415092e127b admin admin] The token cache is being invalidate because project 9a2d92e6351d477f80e5aced420a29df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:28:16.203176 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-617f2cb0-4d2e-4b27-81ea-5415092e127b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:28:16.203894 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-617f2cb0-4d2e-4b27-81ea-5415092e127b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:28:16.205416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 724/1451] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:28:16 2021] DELETE /identity/v3/projects/9a2d92e6351d477f80e5aced420a29df => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:29:40.413504 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98396a-172f-4244-aa50-0ac8b23cae17 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:40.414122 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98396a-172f-4244-aa50-0ac8b23cae17 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:40.414122 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98396a-172f-4244-aa50-0ac8b23cae17 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:40.415961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 728/1452] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 16 00:29:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:29:40.421186 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445d664-ac9e-4cb2-9582-f4ea2496dd54 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:40.421628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445d664-ac9e-4cb2-9582-f4ea2496dd54 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:40.421738 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445d664-ac9e-4cb2-9582-f4ea2496dd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:40.440482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-4445d664-ac9e-4cb2-9582-f4ea2496dd54 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:29:40.441690 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4445d664-ac9e-4cb2-9582-f4ea2496dd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:29:40.498149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 725/1453] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 16 00:29:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:29:40.658235 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98396a-172f-4244-aa50-0ac8b23cae17 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:29:40.659951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-bb98396a-172f-4244-aa50-0ac8b23cae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:29:40.734419 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98396a-172f-4244-aa50-0ac8b23cae17 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:29:40.739772 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320c7eb-e0cd-45ae-a838-51d45196443e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:29:40.740428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c7eb-e0cd-45ae-a838-51d45196443e service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:40.740848 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c7eb-e0cd-45ae-a838-51d45196443e service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:40.741145 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c7eb-e0cd-45ae-a838-51d45196443e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:40.749221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320c7eb-e0cd-45ae-a838-51d45196443e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:29:40.750816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320c7eb-e0cd-45ae-a838-51d45196443e service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:29:40.760127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 729/1454] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:29:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:29:41.041501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b46fe1-8af4-4f78-947b-2ed222cc2659 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:41.041830 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b46fe1-8af4-4f78-947b-2ed222cc2659 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:41.042117 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b46fe1-8af4-4f78-947b-2ed222cc2659 None None] PATH_INFO: `/v3` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:41.043635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 726/1455] 10.222.0.54 () {54 vars in 925 bytes} [Tue Nov 16 00:29:41 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:29:41.050723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecc582-3659-4816-8c3c-a91a6a9d1eae None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:41.051045 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecc582-3659-4816-8c3c-a91a6a9d1eae None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:41.051323 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecc582-3659-4816-8c3c-a91a6a9d1eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:41.072467 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-51ecc582-3659-4816-8c3c-a91a6a9d1eae None None] MFA Rules not processed for user `678965f2159e4c33bf2465058f69ff02`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:29:41.073655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-51ecc582-3659-4816-8c3c-a91a6a9d1eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:29:41.134781 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 730/1456] 10.222.0.54 () {58 vars in 1015 bytes} [Tue Nov 16 00:29:41 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:29:42.132096 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bbd8b-0e2b-4d85-aad5-6c11a1421c66 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:42.132633 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bbd8b-0e2b-4d85-aad5-6c11a1421c66 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:42.132633 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bbd8b-0e2b-4d85-aad5-6c11a1421c66 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:42.134452 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 727/1457] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 16 00:29:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:29:42.139995 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773302-906d-4e76-9f46-cc65457cc653 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:42.140400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773302-906d-4e76-9f46-cc65457cc653 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:42.140558 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773302-906d-4e76-9f46-cc65457cc653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:42.158976 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-15773302-906d-4e76-9f46-cc65457cc653 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:29:42.160462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-15773302-906d-4e76-9f46-cc65457cc653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:29:42.168743 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 731/1458] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 16 00:29:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:29:42.335242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bbd8b-0e2b-4d85-aad5-6c11a1421c66 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:29:42.349507 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bbd8b-0e2b-4d85-aad5-6c11a1421c66 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:29:42.354928 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfa4d5-e36a-4710-bec9-80d344a85aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:29:42.355566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfa4d5-e36a-4710-bec9-80d344a85aff service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:42.355851 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfa4d5-e36a-4710-bec9-80d344a85aff service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:42.356143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfa4d5-e36a-4710-bec9-80d344a85aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:42.364021 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfa4d5-e36a-4710-bec9-80d344a85aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:29:42.366204 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfa4d5-e36a-4710-bec9-80d344a85aff service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:29:42.375755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 728/1459] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:29:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:29:49.862329 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ecd1f-8917-4762-9b08-670e5513d12d None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:49.862819 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ecd1f-8917-4762-9b08-670e5513d12d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:49.862955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ecd1f-8917-4762-9b08-670e5513d12d None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:49.864672 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 732/1460] 10.222.0.50 () {54 vars in 960 bytes} [Tue Nov 16 00:29:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:29:49.870418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccf7fc-9ce2-4cb7-9eab-3f53b20d0c0b None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:49.870870 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccf7fc-9ce2-4cb7-9eab-3f53b20d0c0b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:49.871017 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccf7fc-9ce2-4cb7-9eab-3f53b20d0c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:49.889412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-d6ccf7fc-9ce2-4cb7-9eab-3f53b20d0c0b None None] MFA Rules not processed for user `678965f2159e4c33bf2465058f69ff02`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:29:49.890593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d6ccf7fc-9ce2-4cb7-9eab-3f53b20d0c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:29:49.900014 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 729/1461] 10.222.0.50 () {58 vars in 1057 bytes} [Tue Nov 16 00:29:49 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:29:49.907705 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ecd1f-8917-4762-9b08-670e5513d12d None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:29:49.921371 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ecd1f-8917-4762-9b08-670e5513d12d None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:29:49.926409 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154d7a8-0df7-4c04-b2c2-71d1dad4da1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:29:49.927083 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154d7a8-0df7-4c04-b2c2-71d1dad4da1a service placement] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:49.927370 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154d7a8-0df7-4c04-b2c2-71d1dad4da1a service placement] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:49.927651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154d7a8-0df7-4c04-b2c2-71d1dad4da1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:49.936013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154d7a8-0df7-4c04-b2c2-71d1dad4da1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:29:49.937612 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154d7a8-0df7-4c04-b2c2-71d1dad4da1a service placement] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:29:49.947655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 733/1462] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:29:49 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:29:54.190125 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb367855-25bd-46ef-a5d8-fa32b40469aa None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:54.190657 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb367855-25bd-46ef-a5d8-fa32b40469aa None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:54.190657 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb367855-25bd-46ef-a5d8-fa32b40469aa None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:54.192410 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 730/1463] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 16 00:29:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:29:54.198547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec533c-62a9-42be-ade2-4d7ac000b843 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:54.199164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec533c-62a9-42be-ade2-4d7ac000b843 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:54.199446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec533c-62a9-42be-ade2-4d7ac000b843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:54.216808 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-abec533c-62a9-42be-ade2-4d7ac000b843 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:29:54.217987 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-abec533c-62a9-42be-ade2-4d7ac000b843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:29:54.226114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 734/1464] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 16 00:29:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:29:54.379085 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb367855-25bd-46ef-a5d8-fa32b40469aa None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:29:54.393964 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb367855-25bd-46ef-a5d8-fa32b40469aa None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:29:54.399550 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e86ddb-3d40-4b0f-9f7c-ecf2fd85ea2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:29:54.400184 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e86ddb-3d40-4b0f-9f7c-ecf2fd85ea2b service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:54.400477 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e86ddb-3d40-4b0f-9f7c-ecf2fd85ea2b service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:54.400763 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e86ddb-3d40-4b0f-9f7c-ecf2fd85ea2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:54.408706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e86ddb-3d40-4b0f-9f7c-ecf2fd85ea2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:29:54.410291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e86ddb-3d40-4b0f-9f7c-ecf2fd85ea2b service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:29:54.420132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 731/1465] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:29:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:29:55.776511 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5a28e-97a8-4c24-a759-9ae08270fdbb None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:55.777094 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5a28e-97a8-4c24-a759-9ae08270fdbb None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:55.777094 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5a28e-97a8-4c24-a759-9ae08270fdbb None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:55.778856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 735/1466] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 16 00:29:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:29:55.784166 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13a491-9a7b-4e71-bb5e-dfeac36152ae None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:55.784607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13a491-9a7b-4e71-bb5e-dfeac36152ae None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:55.784721 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13a491-9a7b-4e71-bb5e-dfeac36152ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:55.804916 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0a13a491-9a7b-4e71-bb5e-dfeac36152ae None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:29:55.806142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0a13a491-9a7b-4e71-bb5e-dfeac36152ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:29:55.814010 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 732/1467] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 16 00:29:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:29:55.967068 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5a28e-97a8-4c24-a759-9ae08270fdbb None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:29:55.981787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5a28e-97a8-4c24-a759-9ae08270fdbb None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:29:55.987229 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62506ac-612c-43d3-99a4-0032681ea55d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:29:55.987881 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62506ac-612c-43d3-99a4-0032681ea55d service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:29:55.988147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62506ac-612c-43d3-99a4-0032681ea55d service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:29:55.988425 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62506ac-612c-43d3-99a4-0032681ea55d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:29:55.996328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62506ac-612c-43d3-99a4-0032681ea55d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:29:55.997908 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62506ac-612c-43d3-99a4-0032681ea55d service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:29:56.008120 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 736/1468] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:29:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:30:00.489244 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07b31c-c9b0-4686-9152-f25d95515ecf None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:30:00.489746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07b31c-c9b0-4686-9152-f25d95515ecf None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:30:00.489843 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07b31c-c9b0-4686-9152-f25d95515ecf None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:30:00.491803 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 733/1469] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 16 00:30:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:30:00.497794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca244b-044f-45c3-bc54-34690b823550 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:30:00.498283 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca244b-044f-45c3-bc54-34690b823550 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:30:00.498387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca244b-044f-45c3-bc54-34690b823550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:30:00.516520 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-85ca244b-044f-45c3-bc54-34690b823550 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:30:00.517726 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-85ca244b-044f-45c3-bc54-34690b823550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:30:00.526308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 737/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 16 00:30:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:30:00.563384 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07b31c-c9b0-4686-9152-f25d95515ecf None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:30:00.565036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2b07b31c-c9b0-4686-9152-f25d95515ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:30:00.620797 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07b31c-c9b0-4686-9152-f25d95515ecf None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:30:00.624358 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569dc8d-d110-4e87-8cd7-205f93c50a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:30:00.624998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569dc8d-d110-4e87-8cd7-205f93c50a90 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:30:00.625283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569dc8d-d110-4e87-8cd7-205f93c50a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:30:00.625562 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569dc8d-d110-4e87-8cd7-205f93c50a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:30:00.634926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569dc8d-d110-4e87-8cd7-205f93c50a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:30:00.636364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569dc8d-d110-4e87-8cd7-205f93c50a90 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:30:00.645531 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 734/1471] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:30:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:30:02.829984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e304958-7df6-474f-b684-4db9b73dc404 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:30:02.830531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e304958-7df6-474f-b684-4db9b73dc404 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:30:02.830531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e304958-7df6-474f-b684-4db9b73dc404 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:30:02.832376 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 738/1472] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 16 00:30:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:30:02.840009 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e48c4-7f37-49e4-805f-c2a98f13337d None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:30:02.840445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e48c4-7f37-49e4-805f-c2a98f13337d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:30:02.840555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e48c4-7f37-49e4-805f-c2a98f13337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:30:02.859041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-883e48c4-7f37-49e4-805f-c2a98f13337d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:30:02.860308 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-883e48c4-7f37-49e4-805f-c2a98f13337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:30:02.871992 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 735/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 16 00:30:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:30:02.914666 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e304958-7df6-474f-b684-4db9b73dc404 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:30:02.925406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e304958-7df6-474f-b684-4db9b73dc404 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:30:02.929063 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fffdf2-e202-470d-984a-1aebf70d5127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:30:02.929595 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fffdf2-e202-470d-984a-1aebf70d5127 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:30:02.929884 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fffdf2-e202-470d-984a-1aebf70d5127 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:30:02.930158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fffdf2-e202-470d-984a-1aebf70d5127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:30:02.938909 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fffdf2-e202-470d-984a-1aebf70d5127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:30:02.940344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fffdf2-e202-470d-984a-1aebf70d5127 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:30:02.950573 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 739/1474] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:30:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:30:06.809272 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d7165-6f99-41b7-a883-6bb4c702f0ba None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:30:06.809825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d7165-6f99-41b7-a883-6bb4c702f0ba None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:30:06.809825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d7165-6f99-41b7-a883-6bb4c702f0ba None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:30:06.811654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 736/1475] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 16 00:30:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:30:06.818466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0c689-8fbf-4b05-8afe-8504d44e5bea None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:30:06.818903 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0c689-8fbf-4b05-8afe-8504d44e5bea None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:30:06.819051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0c689-8fbf-4b05-8afe-8504d44e5bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:30:06.838152 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-68d0c689-8fbf-4b05-8afe-8504d44e5bea None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:30:06.839360 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-68d0c689-8fbf-4b05-8afe-8504d44e5bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:30:06.855410 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 740/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 16 00:30:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:30:06.911755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d7165-6f99-41b7-a883-6bb4c702f0ba None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:30:06.913434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-141d7165-6f99-41b7-a883-6bb4c702f0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:30:06.970526 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d7165-6f99-41b7-a883-6bb4c702f0ba None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:30:06.974282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572b36f-c830-4ad7-9f6a-5f1531612aef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:30:06.974952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b36f-c830-4ad7-9f6a-5f1531612aef service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:30:06.975237 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b36f-c830-4ad7-9f6a-5f1531612aef service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:30:06.975510 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b36f-c830-4ad7-9f6a-5f1531612aef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:30:06.984698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572b36f-c830-4ad7-9f6a-5f1531612aef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:30:06.986163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572b36f-c830-4ad7-9f6a-5f1531612aef service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:30:06.995334 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 737/1477] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:30:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:30:09.164119 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449ccf0-b979-464e-b1d1-27d15b1212ba None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:30:09.164684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449ccf0-b979-464e-b1d1-27d15b1212ba None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:30:09.164684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449ccf0-b979-464e-b1d1-27d15b1212ba None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:30:09.166466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 741/1478] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 16 00:30:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:30:09.173540 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaaae5-1f0d-4ffe-996e-1c6bff569f42 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:30:09.173975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaaae5-1f0d-4ffe-996e-1c6bff569f42 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:30:09.174133 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaaae5-1f0d-4ffe-996e-1c6bff569f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:30:09.192558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-60aaaae5-1f0d-4ffe-996e-1c6bff569f42 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:30:09.193656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-60aaaae5-1f0d-4ffe-996e-1c6bff569f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:30:09.202131 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 738/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 16 00:30:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:30:09.252392 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99af015-2980-475d-95be-c6dbd9b3d4e5 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:30:09.252695 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99af015-2980-475d-95be-c6dbd9b3d4e5 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:30:09.252957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99af015-2980-475d-95be-c6dbd9b3d4e5 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:30:09.254717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 742/1480] 10.222.0.50 () {54 vars in 962 bytes} [Tue Nov 16 00:30:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:30:09.260700 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feded1-e9fd-4862-b259-0b169513a70f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:30:09.260990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feded1-e9fd-4862-b259-0b169513a70f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:30:09.261271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feded1-e9fd-4862-b259-0b169513a70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:30:09.279213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-45feded1-e9fd-4862-b259-0b169513a70f None None] MFA Rules not processed for user `292b73337e674cdfa9c05fe67040cf94`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:30:09.280389 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-45feded1-e9fd-4862-b259-0b169513a70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:30:09.286717 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 739/1481] 10.222.0.50 () {58 vars in 1059 bytes} [Tue Nov 16 00:30:09 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:30:09.294761 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99af015-2980-475d-95be-c6dbd9b3d4e5 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:30:09.305650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99af015-2980-475d-95be-c6dbd9b3d4e5 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:30:09.309254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81e5e0-1067-4036-882a-6f62b2021565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:30:09.309882 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81e5e0-1067-4036-882a-6f62b2021565 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:30:09.310162 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81e5e0-1067-4036-882a-6f62b2021565 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:30:09.310437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81e5e0-1067-4036-882a-6f62b2021565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:30:09.318956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81e5e0-1067-4036-882a-6f62b2021565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:30:09.321139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81e5e0-1067-4036-882a-6f62b2021565 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:30:09.330185 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 743/1482] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:30:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:39.608014 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76688f-e533-4b29-a74d-ebbd9a81c972 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:39.608607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76688f-e533-4b29-a74d-ebbd9a81c972 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:39.608607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76688f-e533-4b29-a74d-ebbd9a81c972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:39.632550 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-6d76688f-e533-4b29-a74d-ebbd9a81c972 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:39.634500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6d76688f-e533-4b29-a74d-ebbd9a81c972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:39.645982 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 740/1483] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:31:39.654598 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4805e71-c30a-4efe-b87e-a38ac868943c None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:39.655570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4805e71-c30a-4efe-b87e-a38ac868943c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:39.656086 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4805e71-c30a-4efe-b87e-a38ac868943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:39.686980 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-d4805e71-c30a-4efe-b87e-a38ac868943c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:39.687735 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb392f-c6ea-496e-907e-5d1d15332b49 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:39.688047 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb392f-c6ea-496e-907e-5d1d15332b49 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:39.688313 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb392f-c6ea-496e-907e-5d1d15332b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:39.689326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d4805e71-c30a-4efe-b87e-a38ac868943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:39.705166 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 744/1484] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:39.710574 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4805e71-c30a-4efe-b87e-a38ac868943c None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:39.716026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-a2cb392f-c6ea-496e-907e-5d1d15332b49 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:39.717387 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a2cb392f-c6ea-496e-907e-5d1d15332b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:39.721002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4805e71-c30a-4efe-b87e-a38ac868943c None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:39.731641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 741/1485] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:39.734288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7476e-df59-425c-8d62-94654dd83f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:39.735259 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7476e-df59-425c-8d62-94654dd83f97 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:39.735951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7476e-df59-425c-8d62-94654dd83f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:39.736449 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7476e-df59-425c-8d62-94654dd83f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:39.737404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7476e-df59-425c-8d62-94654dd83f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:31:39.737942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7476e-df59-425c-8d62-94654dd83f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:39.739824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7476e-df59-425c-8d62-94654dd83f97 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:39.760714 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 745/1486] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:31:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:31:39.760904 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b606c2-d076-40ff-9c25-b2610114d32e None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:39.761099 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b606c2-d076-40ff-9c25-b2610114d32e None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:39.761328 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b606c2-d076-40ff-9c25-b2610114d32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:39.769337 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7476e-df59-425c-8d62-94654dd83f97 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:39.781822 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7476e-df59-425c-8d62-94654dd83f97 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:39.791819 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-14b606c2-d076-40ff-9c25-b2610114d32e None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:39.793039 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-14b606c2-d076-40ff-9c25-b2610114d32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:39.795411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e0cda-8abf-4369-95fc-41eb8b96cf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:39.796348 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0cda-8abf-4369-95fc-41eb8b96cf1e admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:39.796852 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0cda-8abf-4369-95fc-41eb8b96cf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:39.797348 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0cda-8abf-4369-95fc-41eb8b96cf1e admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:39.798255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e0cda-8abf-4369-95fc-41eb8b96cf1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:39.800424 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e0cda-8abf-4369-95fc-41eb8b96cf1e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:39.810342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 742/1487] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:31:39.826977 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b606c2-d076-40ff-9c25-b2610114d32e None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:39.842689 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b606c2-d076-40ff-9c25-b2610114d32e None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:39.849969 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce2a23-a3c7-4f75-9ce9-e978eed59683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:39.850620 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce2a23-a3c7-4f75-9ce9-e978eed59683 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:39.850986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce2a23-a3c7-4f75-9ce9-e978eed59683 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:39.851266 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce2a23-a3c7-4f75-9ce9-e978eed59683 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:39.852860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce2a23-a3c7-4f75-9ce9-e978eed59683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:31:39.854383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce2a23-a3c7-4f75-9ce9-e978eed59683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:39.854868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce2a23-a3c7-4f75-9ce9-e978eed59683 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:39.857957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 746/1488] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:31:39 2021] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:31:39.862886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e0cda-8abf-4369-95fc-41eb8b96cf1e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:39.881464 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 743/1489] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:31:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:31:39.905130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce2a23-a3c7-4f75-9ce9-e978eed59683 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:39.931581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce2a23-a3c7-4f75-9ce9-e978eed59683 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:39.943643 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf4c09-c3a5-4742-b22f-41696c84622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:39.944319 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf4c09-c3a5-4742-b22f-41696c84622d admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:39.944606 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf4c09-c3a5-4742-b22f-41696c84622d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:39.944884 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf4c09-c3a5-4742-b22f-41696c84622d admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:39.946680 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf4c09-c3a5-4742-b22f-41696c84622d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:39.950571 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf4c09-c3a5-4742-b22f-41696c84622d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:39.962127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e0cda-8abf-4369-95fc-41eb8b96cf1e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:39.968020 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53897af0-023c-415e-a86a-11013a18bdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:39.969019 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53897af0-023c-415e-a86a-11013a18bdbc admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:39.969529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53897af0-023c-415e-a86a-11013a18bdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:39.970031 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53897af0-023c-415e-a86a-11013a18bdbc admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:39.970964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53897af0-023c-415e-a86a-11013a18bdbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:39.973721 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53897af0-023c-415e-a86a-11013a18bdbc admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.020670 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 744/1490] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:31:39 2021] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:40.022293 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47196a53-ab85-4567-b47d-15652f747e07 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.022545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 747/1491] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:31:39 2021] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:31:40.023768 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47196a53-ab85-4567-b47d-15652f747e07 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.024615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47196a53-ab85-4567-b47d-15652f747e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.030858 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53897af0-023c-415e-a86a-11013a18bdbc admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.048086 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53897af0-023c-415e-a86a-11013a18bdbc admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.054390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-47196a53-ab85-4567-b47d-15652f747e07 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:40.055739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-47196a53-ab85-4567-b47d-15652f747e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:40.127641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa07b55-2a48-4ce7-a77a-babe85f6a71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.128739 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa07b55-2a48-4ce7-a77a-babe85f6a71c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.129247 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa07b55-2a48-4ce7-a77a-babe85f6a71c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.129744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa07b55-2a48-4ce7-a77a-babe85f6a71c admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.130682 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa07b55-2a48-4ce7-a77a-babe85f6a71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.132644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa07b55-2a48-4ce7-a77a-babe85f6a71c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.143848 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 745/1492] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:40.144510 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 748/1493] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:40 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:40.144777 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47196a53-ab85-4567-b47d-15652f747e07 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.146238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bebb7-4eeb-4842-8d6a-665effd63321 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.146765 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bebb7-4eeb-4842-8d6a-665effd63321 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.150698 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bebb7-4eeb-4842-8d6a-665effd63321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.161584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47196a53-ab85-4567-b47d-15652f747e07 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.167031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb4843-bb80-4d7a-81d1-341f2fd3f919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.167716 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb4843-bb80-4d7a-81d1-341f2fd3f919 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.168002 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb4843-bb80-4d7a-81d1-341f2fd3f919 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.168281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb4843-bb80-4d7a-81d1-341f2fd3f919 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.169067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb4843-bb80-4d7a-81d1-341f2fd3f919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.171186 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb4843-bb80-4d7a-81d1-341f2fd3f919 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.173441 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-164bebb7-4eeb-4842-8d6a-665effd63321 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:40.174797 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-164bebb7-4eeb-4842-8d6a-665effd63321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:40.183890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 749/1494] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:40.185513 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6d1d0-d449-48d1-b15d-ec3518f335ba None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.185952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6d1d0-d449-48d1-b15d-ec3518f335ba None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.186319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6d1d0-d449-48d1-b15d-ec3518f335ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.199920 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 746/1495] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:40.201218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5d639-3368-4525-bd40-a725c0b95bc8 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.201507 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5d639-3368-4525-bd40-a725c0b95bc8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.201788 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5d639-3368-4525-bd40-a725c0b95bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.205099 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-33a6d1d0-d449-48d1-b15d-ec3518f335ba None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:40.206276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-33a6d1d0-d449-48d1-b15d-ec3518f335ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:40.215453 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 750/1496] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:40.218869 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6d1d0-d449-48d1-b15d-ec3518f335ba None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.224746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0dd5d639-3368-4525-bd40-a725c0b95bc8 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:40.225957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0dd5d639-3368-4525-bd40-a725c0b95bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:40.228116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6d1d0-d449-48d1-b15d-ec3518f335ba None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.232675 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06297d6-f300-4597-a472-0673ad8485b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.233334 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06297d6-f300-4597-a472-0673ad8485b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.233622 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06297d6-f300-4597-a472-0673ad8485b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.233995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 747/1497] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:40.234132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06297d6-f300-4597-a472-0673ad8485b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.234739 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06297d6-f300-4597-a472-0673ad8485b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.235026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfaa41-aed2-4233-9274-5741f43912cc None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.235322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfaa41-aed2-4233-9274-5741f43912cc None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.235602 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfaa41-aed2-4233-9274-5741f43912cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.236428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06297d6-f300-4597-a472-0673ad8485b8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.247040 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 751/1498] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:40 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:40.248431 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112118e-5188-44e7-be8f-3f5b541e17db None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.248727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112118e-5188-44e7-be8f-3f5b541e17db None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.249009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112118e-5188-44e7-be8f-3f5b541e17db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.253769 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f0dfaa41-aed2-4233-9274-5741f43912cc None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:40.255111 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f0dfaa41-aed2-4233-9274-5741f43912cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:40.263852 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 748/1499] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:40.265093 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c020a6-2761-4112-8d4a-56503c2675ab None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.265435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c020a6-2761-4112-8d4a-56503c2675ab None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.265650 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c020a6-2761-4112-8d4a-56503c2675ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.268240 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c112118e-5188-44e7-be8f-3f5b541e17db None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:40.269454 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c112118e-5188-44e7-be8f-3f5b541e17db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:40.278528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 752/1500] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:40.279796 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c385c-41f9-4144-8529-207f2ad57df9 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.280090 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c385c-41f9-4144-8529-207f2ad57df9 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.280387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c385c-41f9-4144-8529-207f2ad57df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.284305 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-85c020a6-2761-4112-8d4a-56503c2675ab None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:40.285743 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-85c020a6-2761-4112-8d4a-56503c2675ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:40.294331 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 749/1501] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:40.295352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c020a6-2761-4112-8d4a-56503c2675ab None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.298418 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-da8c385c-41f9-4144-8529-207f2ad57df9 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:40.299647 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-da8c385c-41f9-4144-8529-207f2ad57df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:40.305008 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c020a6-2761-4112-8d4a-56503c2675ab None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.307791 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 753/1502] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:40.308871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9649b0-fa4b-44e8-9f8f-adbb549df26c None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.309160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9649b0-fa4b-44e8-9f8f-adbb549df26c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.309445 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9649b0-fa4b-44e8-9f8f-adbb549df26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.313058 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1196ab-ff9a-4a75-a102-928ff5d51f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.313718 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1196ab-ff9a-4a75-a102-928ff5d51f47 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.314004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1196ab-ff9a-4a75-a102-928ff5d51f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.314284 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1196ab-ff9a-4a75-a102-928ff5d51f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.315048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1196ab-ff9a-4a75-a102-928ff5d51f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.316666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1196ab-ff9a-4a75-a102-928ff5d51f47 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.329992 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 750/1503] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:40 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:40.330175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-6d9649b0-fa4b-44e8-9f8f-adbb549df26c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:40.330281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c0ff3-a641-4b57-a1f4-8ff28ab8a7b8 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.330389 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6d9649b0-fa4b-44e8-9f8f-adbb549df26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:40.330492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c0ff3-a641-4b57-a1f4-8ff28ab8a7b8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.330492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c0ff3-a641-4b57-a1f4-8ff28ab8a7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.337468 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 754/1504] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:40.338275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9649b0-fa4b-44e8-9f8f-adbb549df26c None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.347505 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9649b0-fa4b-44e8-9f8f-adbb549df26c None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.348051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-210c0ff3-a641-4b57-a1f4-8ff28ab8a7b8 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:40.349243 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-210c0ff3-a641-4b57-a1f4-8ff28ab8a7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:40.352696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d2d79-deca-4976-9d92-a5a70d89fd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.353565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d2d79-deca-4976-9d92-a5a70d89fd35 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.353855 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d2d79-deca-4976-9d92-a5a70d89fd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.354137 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d2d79-deca-4976-9d92-a5a70d89fd35 admin admin] PATH_INFO: `/v3/projects/f0fa8d3f36f744f486c77c8a5ed5bb9c/users/75a772d36dc64b34ad0e9f2748cea24f/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.357619 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 751/1505] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:40.358396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c0ff3-a641-4b57-a1f4-8ff28ab8a7b8 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.367821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c0ff3-a641-4b57-a1f4-8ff28ab8a7b8 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.369847 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d2d79-deca-4976-9d92-a5a70d89fd35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fa8d3f36f744f486c77c8a5ed5bb9c, user_id=75a772d36dc64b34ad0e9f2748cea24f, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.372524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d2d79-deca-4976-9d92-a5a70d89fd35 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.372742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e8972-fb28-4b5e-9bdb-6a405b62578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.373392 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8972-fb28-4b5e-9bdb-6a405b62578f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.373684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8972-fb28-4b5e-9bdb-6a405b62578f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.373961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8972-fb28-4b5e-9bdb-6a405b62578f admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.374685 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e8972-fb28-4b5e-9bdb-6a405b62578f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:31:40.375026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e8972-fb28-4b5e-9bdb-6a405b62578f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.376661 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e8972-fb28-4b5e-9bdb-6a405b62578f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.386338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 755/1506] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:40 2021] PUT /identity/v3/projects/f0fa8d3f36f744f486c77c8a5ed5bb9c/users/75a772d36dc64b34ad0e9f2748cea24f/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:40.387709 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2880ba-cde0-4e75-8aae-514cd5461645 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.388001 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2880ba-cde0-4e75-8aae-514cd5461645 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.388277 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2880ba-cde0-4e75-8aae-514cd5461645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.389385 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 752/1507] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:31:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:31:40.391234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feac86c-cd29-44cf-bb42-c1ba4527133c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.391518 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feac86c-cd29-44cf-bb42-c1ba4527133c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.391804 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feac86c-cd29-44cf-bb42-c1ba4527133c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.408103 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-cc2880ba-cde0-4e75-8aae-514cd5461645 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:40.409279 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-cc2880ba-cde0-4e75-8aae-514cd5461645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:40.409443 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-4feac86c-cd29-44cf-bb42-c1ba4527133c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:40.410654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4feac86c-cd29-44cf-bb42-c1ba4527133c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:40.468308 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 753/1508] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:40.469151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feac86c-cd29-44cf-bb42-c1ba4527133c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.469295 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 756/1509] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:40.470166 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2880ba-cde0-4e75-8aae-514cd5461645 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.480481 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2880ba-cde0-4e75-8aae-514cd5461645 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.481067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feac86c-cd29-44cf-bb42-c1ba4527133c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.485011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c94ef-a3bb-4fc5-bd47-093b8a4af6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.485664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ee405-e485-4170-9e51-f49700230fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.486314 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ee405-e485-4170-9e51-f49700230fae admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.486606 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ee405-e485-4170-9e51-f49700230fae admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.486909 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ee405-e485-4170-9e51-f49700230fae admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.487640 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ee405-e485-4170-9e51-f49700230fae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:31:40.487757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c94ef-a3bb-4fc5-bd47-093b8a4af6da admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.487947 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ee405-e485-4170-9e51-f49700230fae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.488049 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c94ef-a3bb-4fc5-bd47-093b8a4af6da admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.488241 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c94ef-a3bb-4fc5-bd47-093b8a4af6da admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.488968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c94ef-a3bb-4fc5-bd47-093b8a4af6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.489550 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ee405-e485-4170-9e51-f49700230fae admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.490548 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c94ef-a3bb-4fc5-bd47-093b8a4af6da admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.502180 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 754/1510] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:31:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:31:40.502788 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ee405-e485-4170-9e51-f49700230fae admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.503042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 757/1511] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:40 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:40.504032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c94ef-a3bb-4fc5-bd47-093b8a4af6da admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.514946 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c94ef-a3bb-4fc5-bd47-093b8a4af6da admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.519598 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3d724-32d6-46c3-9878-f11657636222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.519814 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ee405-e485-4170-9e51-f49700230fae admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.520254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3d724-32d6-46c3-9878-f11657636222 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.520571 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3d724-32d6-46c3-9878-f11657636222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.520858 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3d724-32d6-46c3-9878-f11657636222 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.521586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3d724-32d6-46c3-9878-f11657636222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:31:40.521901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3d724-32d6-46c3-9878-f11657636222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.523764 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3d724-32d6-46c3-9878-f11657636222 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.524607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391cbf8-4908-4f96-a6da-a049ee4b3bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.525261 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391cbf8-4908-4f96-a6da-a049ee4b3bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.525550 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391cbf8-4908-4f96-a6da-a049ee4b3bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.525827 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391cbf8-4908-4f96-a6da-a049ee4b3bf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.526549 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391cbf8-4908-4f96-a6da-a049ee4b3bf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:31:40.526883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391cbf8-4908-4f96-a6da-a049ee4b3bf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.528503 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391cbf8-4908-4f96-a6da-a049ee4b3bf6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.535819 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 758/1512] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:31:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:31:40.537930 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434ebe5-1b20-4795-8313-84e5529e441e None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.538227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434ebe5-1b20-4795-8313-84e5529e441e None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.538510 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434ebe5-1b20-4795-8313-84e5529e441e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.541074 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 755/1513] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:31:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:31:40.541933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391cbf8-4908-4f96-a6da-a049ee4b3bf6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.553073 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391cbf8-4908-4f96-a6da-a049ee4b3bf6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.556346 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-d434ebe5-1b20-4795-8313-84e5529e441e None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:40.557507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d434ebe5-1b20-4795-8313-84e5529e441e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:40.558450 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f5860-eb20-450c-abc2-8b46e8ab2c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.559131 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f5860-eb20-450c-abc2-8b46e8ab2c3b admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.559418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f5860-eb20-450c-abc2-8b46e8ab2c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.559695 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f5860-eb20-450c-abc2-8b46e8ab2c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.560379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f5860-eb20-450c-abc2-8b46e8ab2c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.562278 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f5860-eb20-450c-abc2-8b46e8ab2c3b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.565123 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 759/1514] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:40.566013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434ebe5-1b20-4795-8313-84e5529e441e None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.576144 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434ebe5-1b20-4795-8313-84e5529e441e None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.581166 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d263b5-87f3-4db4-ae52-a069414ef96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.581913 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d263b5-87f3-4db4-ae52-a069414ef96f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.582205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d263b5-87f3-4db4-ae52-a069414ef96f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.582512 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d263b5-87f3-4db4-ae52-a069414ef96f admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.583269 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d263b5-87f3-4db4-ae52-a069414ef96f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:31:40.583580 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d263b5-87f3-4db4-ae52-a069414ef96f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.585177 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d263b5-87f3-4db4-ae52-a069414ef96f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.588283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 756/1515] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:40.589185 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f5860-eb20-450c-abc2-8b46e8ab2c3b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.597199 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 760/1516] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:31:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:31:40.599939 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d263b5-87f3-4db4-ae52-a069414ef96f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.609646 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d263b5-87f3-4db4-ae52-a069414ef96f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.648625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f5860-eb20-450c-abc2-8b46e8ab2c3b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.653338 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1282980-5052-408e-8b79-e6c36a94004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.654112 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1282980-5052-408e-8b79-e6c36a94004b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.654398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1282980-5052-408e-8b79-e6c36a94004b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.654673 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1282980-5052-408e-8b79-e6c36a94004b admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.655429 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1282980-5052-408e-8b79-e6c36a94004b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:31:40.655848 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1282980-5052-408e-8b79-e6c36a94004b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.657457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1282980-5052-408e-8b79-e6c36a94004b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.664031 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32260c95-f288-426f-866f-4824123376cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.664748 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32260c95-f288-426f-866f-4824123376cd admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.665036 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32260c95-f288-426f-866f-4824123376cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.665320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32260c95-f288-426f-866f-4824123376cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.666008 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32260c95-f288-426f-866f-4824123376cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.667934 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32260c95-f288-426f-866f-4824123376cd admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.668540 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 757/1517] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:31:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:31:40.669410 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1282980-5052-408e-8b79-e6c36a94004b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.678788 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1282980-5052-408e-8b79-e6c36a94004b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.684188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006df35c-2ccf-4181-bb75-22a88e218924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.685130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006df35c-2ccf-4181-bb75-22a88e218924 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.685442 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006df35c-2ccf-4181-bb75-22a88e218924 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.685744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006df35c-2ccf-4181-bb75-22a88e218924 admin admin] PATH_INFO: `/v3/projects/e1b8447dba624010956c4df7b5b4b2d2/users/de9afb44d4b74521af5386541a1ad201/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.697342 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 761/1518] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:40.697342 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32260c95-f288-426f-866f-4824123376cd admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.701256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006df35c-2ccf-4181-bb75-22a88e218924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b8447dba624010956c4df7b5b4b2d2, user_id=de9afb44d4b74521af5386541a1ad201, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.704005 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006df35c-2ccf-4181-bb75-22a88e218924 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.719175 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 758/1519] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:40 2021] PUT /identity/v3/projects/e1b8447dba624010956c4df7b5b4b2d2/users/de9afb44d4b74521af5386541a1ad201/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:40.720027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006df35c-2ccf-4181-bb75-22a88e218924 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.756556 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32260c95-f288-426f-866f-4824123376cd admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.781123 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006df35c-2ccf-4181-bb75-22a88e218924 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.785875 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30786157-78b5-4a19-b2c4-2bf1a37bb5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.786576 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786157-78b5-4a19-b2c4-2bf1a37bb5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.786892 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786157-78b5-4a19-b2c4-2bf1a37bb5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.787182 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30786157-78b5-4a19-b2c4-2bf1a37bb5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.787868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30786157-78b5-4a19-b2c4-2bf1a37bb5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.790375 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30786157-78b5-4a19-b2c4-2bf1a37bb5a9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.810592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3adcc1-086c-4b5f-9684-16e25cf20f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.811326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3adcc1-086c-4b5f-9684-16e25cf20f64 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.811783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3adcc1-086c-4b5f-9684-16e25cf20f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.812148 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3adcc1-086c-4b5f-9684-16e25cf20f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.813030 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3adcc1-086c-4b5f-9684-16e25cf20f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.815015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3adcc1-086c-4b5f-9684-16e25cf20f64 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.816941 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 759/1520] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:40.820959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30786157-78b5-4a19-b2c4-2bf1a37bb5a9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.839821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 762/1521] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/projects => generated 363 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:40.840691 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3adcc1-086c-4b5f-9684-16e25cf20f64 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.875611 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30786157-78b5-4a19-b2c4-2bf1a37bb5a9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.901388 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3adcc1-086c-4b5f-9684-16e25cf20f64 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.906054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11cc02-9f31-4548-a395-50ad30ca2532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.906728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11cc02-9f31-4548-a395-50ad30ca2532 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.907113 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11cc02-9f31-4548-a395-50ad30ca2532 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.907396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11cc02-9f31-4548-a395-50ad30ca2532 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.908085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11cc02-9f31-4548-a395-50ad30ca2532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.910027 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11cc02-9f31-4548-a395-50ad30ca2532 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.921221 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b82c3-e9de-4532-8773-b773a26271e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.921922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b82c3-e9de-4532-8773-b773a26271e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.922259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b82c3-e9de-4532-8773-b773a26271e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.922565 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b82c3-e9de-4532-8773-b773a26271e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.932339 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 763/1522] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/users => generated 279 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:40.933210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11cc02-9f31-4548-a395-50ad30ca2532 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.933334 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b82c3-e9de-4532-8773-b773a26271e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.935044 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b82c3-e9de-4532-8773-b773a26271e1 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.942656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11cc02-9f31-4548-a395-50ad30ca2532 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.944873 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 760/1523] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:40.946001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b82c3-e9de-4532-8773-b773a26271e1 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.947825 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa258c5-d937-493c-8bcb-fabff6264edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.948479 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa258c5-d937-493c-8bcb-fabff6264edb admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.948769 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa258c5-d937-493c-8bcb-fabff6264edb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.949050 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa258c5-d937-493c-8bcb-fabff6264edb admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.949741 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa258c5-d937-493c-8bcb-fabff6264edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.951697 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa258c5-d937-493c-8bcb-fabff6264edb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.955398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b82c3-e9de-4532-8773-b773a26271e1 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:40.960433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f1792-6699-4a7f-a8d0-6fab2efbe8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:40.961171 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f1792-6699-4a7f-a8d0-6fab2efbe8fc admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:40.961452 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f1792-6699-4a7f-a8d0-6fab2efbe8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:40.961725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f1792-6699-4a7f-a8d0-6fab2efbe8fc admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:40.962414 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f1792-6699-4a7f-a8d0-6fab2efbe8fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:40.964360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f1792-6699-4a7f-a8d0-6fab2efbe8fc admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:40.982888 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 764/1524] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:40.982888 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa258c5-d937-493c-8bcb-fabff6264edb admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:40.999435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 761/1525] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:41.000836 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe8db6-941b-486c-a554-f826ab102b38 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.001132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe8db6-941b-486c-a554-f826ab102b38 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.001465 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe8db6-941b-486c-a554-f826ab102b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.020734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-1ffe8db6-941b-486c-a554-f826ab102b38 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:41.022150 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1ffe8db6-941b-486c-a554-f826ab102b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:41.052336 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa258c5-d937-493c-8bcb-fabff6264edb admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.087135 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 762/1526] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:41.088055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe8db6-941b-486c-a554-f826ab102b38 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.098719 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe8db6-941b-486c-a554-f826ab102b38 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.104711 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446f05c-8fb6-4ed3-9b4d-9cd7e23e93c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.105382 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446f05c-8fb6-4ed3-9b4d-9cd7e23e93c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.105666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446f05c-8fb6-4ed3-9b4d-9cd7e23e93c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.105941 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446f05c-8fb6-4ed3-9b4d-9cd7e23e93c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.106646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446f05c-8fb6-4ed3-9b4d-9cd7e23e93c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.108821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446f05c-8fb6-4ed3-9b4d-9cd7e23e93c7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.115570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e3c4d-5d92-4b0a-ac87-b70f3f84d5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.116402 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e3c4d-5d92-4b0a-ac87-b70f3f84d5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.117968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e3c4d-5d92-4b0a-ac87-b70f3f84d5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.117968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e3c4d-5d92-4b0a-ac87-b70f3f84d5e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.118567 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e3c4d-5d92-4b0a-ac87-b70f3f84d5e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.120718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e3c4d-5d92-4b0a-ac87-b70f3f84d5e4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.133957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 763/1527] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:31:41 2021] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:41.135238 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446f05c-8fb6-4ed3-9b4d-9cd7e23e93c7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.148061 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 765/1528] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:31:40 2021] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:41.148264 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446f05c-8fb6-4ed3-9b4d-9cd7e23e93c7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.148380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e3c4d-5d92-4b0a-ac87-b70f3f84d5e4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.152272 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5c1b7-6abd-4c11-b5f1-c4b224c4a53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.153120 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5c1b7-6abd-4c11-b5f1-c4b224c4a53e admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.153413 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5c1b7-6abd-4c11-b5f1-c4b224c4a53e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.153696 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5c1b7-6abd-4c11-b5f1-c4b224c4a53e admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.154396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5c1b7-6abd-4c11-b5f1-c4b224c4a53e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.156592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5c1b7-6abd-4c11-b5f1-c4b224c4a53e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.158685 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e3c4d-5d92-4b0a-ac87-b70f3f84d5e4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.163406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df625188-0f30-41be-820e-5d57621bbb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.164208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df625188-0f30-41be-820e-5d57621bbb7b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.165023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df625188-0f30-41be-820e-5d57621bbb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.165259 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df625188-0f30-41be-820e-5d57621bbb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.165977 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df625188-0f30-41be-820e-5d57621bbb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.167588 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df625188-0f30-41be-820e-5d57621bbb7b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.181396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 766/1529] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:41.181396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df625188-0f30-41be-820e-5d57621bbb7b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.181655 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 764/1530] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:31:41 2021] POST /identity/v3/users => generated 282 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:41.181655 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5c1b7-6abd-4c11-b5f1-c4b224c4a53e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.191518 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5c1b7-6abd-4c11-b5f1-c4b224c4a53e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.192356 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df625188-0f30-41be-820e-5d57621bbb7b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.197304 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1c91a-7849-462a-8500-e8bb0bdf1772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.197906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1c91a-7849-462a-8500-e8bb0bdf1772 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.198194 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1c91a-7849-462a-8500-e8bb0bdf1772 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.198573 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1c91a-7849-462a-8500-e8bb0bdf1772 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.198906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56de7d-3d8c-4f90-8cde-a4e39f80261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.199359 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1c91a-7849-462a-8500-e8bb0bdf1772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.199721 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56de7d-3d8c-4f90-8cde-a4e39f80261b admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.200008 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56de7d-3d8c-4f90-8cde-a4e39f80261b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.200283 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56de7d-3d8c-4f90-8cde-a4e39f80261b admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.200969 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56de7d-3d8c-4f90-8cde-a4e39f80261b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.201363 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1c91a-7849-462a-8500-e8bb0bdf1772 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.202882 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56de7d-3d8c-4f90-8cde-a4e39f80261b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.223635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 765/1531] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:31:41 2021] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:41.224734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1c91a-7849-462a-8500-e8bb0bdf1772 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.226468 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-00c1c91a-7849-462a-8500-e8bb0bdf1772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:41.229182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 767/1532] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:31:41 2021] POST /identity/v3/users => generated 294 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:41.230603 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56de7d-3d8c-4f90-8cde-a4e39f80261b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.241817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56de7d-3d8c-4f90-8cde-a4e39f80261b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.247399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499b66c-9731-4330-a6c0-4a635b058c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.248064 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499b66c-9731-4330-a6c0-4a635b058c7a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.248352 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499b66c-9731-4330-a6c0-4a635b058c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.248633 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499b66c-9731-4330-a6c0-4a635b058c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.249351 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499b66c-9731-4330-a6c0-4a635b058c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.250987 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499b66c-9731-4330-a6c0-4a635b058c7a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.262966 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 768/1533] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:41.263968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499b66c-9731-4330-a6c0-4a635b058c7a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.275485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499b66c-9731-4330-a6c0-4a635b058c7a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.280505 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fda84-6346-4805-a8ea-6ab4412961ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.281086 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fda84-6346-4805-a8ea-6ab4412961ed admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.281369 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fda84-6346-4805-a8ea-6ab4412961ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.281646 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fda84-6346-4805-a8ea-6ab4412961ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.282411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fda84-6346-4805-a8ea-6ab4412961ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.284009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fda84-6346-4805-a8ea-6ab4412961ed admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.299129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 769/1534] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:41.302817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fda84-6346-4805-a8ea-6ab4412961ed admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.311026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1c91a-7849-462a-8500-e8bb0bdf1772 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.314965 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fda84-6346-4805-a8ea-6ab4412961ed admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.316218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f67141-ef04-4df3-82fd-a1018ddeba9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.317256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f67141-ef04-4df3-82fd-a1018ddeba9a service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.318043 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f67141-ef04-4df3-82fd-a1018ddeba9a service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.318480 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f67141-ef04-4df3-82fd-a1018ddeba9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.321390 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0197044-d9b1-4a2e-88e5-7bf1a283800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.322134 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0197044-d9b1-4a2e-88e5-7bf1a283800e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.322529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0197044-d9b1-4a2e-88e5-7bf1a283800e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.322899 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0197044-d9b1-4a2e-88e5-7bf1a283800e admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.323716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0197044-d9b1-4a2e-88e5-7bf1a283800e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.325444 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0197044-d9b1-4a2e-88e5-7bf1a283800e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.330584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f67141-ef04-4df3-82fd-a1018ddeba9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.332647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f67141-ef04-4df3-82fd-a1018ddeba9a service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.337314 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 770/1535] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:41.338529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0197044-d9b1-4a2e-88e5-7bf1a283800e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.349007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 766/1536] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:41.350112 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f67141-ef04-4df3-82fd-a1018ddeba9a service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.350248 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0197044-d9b1-4a2e-88e5-7bf1a283800e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.355740 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb695f-04bb-48ba-984c-a4757fc68f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.356631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb695f-04bb-48ba-984c-a4757fc68f28 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.357130 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb695f-04bb-48ba-984c-a4757fc68f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.357485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb695f-04bb-48ba-984c-a4757fc68f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.358593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb695f-04bb-48ba-984c-a4757fc68f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.360313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb695f-04bb-48ba-984c-a4757fc68f28 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.361749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f67141-ef04-4df3-82fd-a1018ddeba9a service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.367681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd7a4e-a676-46ee-bccf-ac867b87c698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.368360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7a4e-a676-46ee-bccf-ac867b87c698 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.368703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7a4e-a676-46ee-bccf-ac867b87c698 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.368989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7a4e-a676-46ee-bccf-ac867b87c698 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.370023 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd7a4e-a676-46ee-bccf-ac867b87c698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.372057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd7a4e-a676-46ee-bccf-ac867b87c698 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.374938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 771/1537] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:41.374938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb695f-04bb-48ba-984c-a4757fc68f28 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.384170 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 767/1538] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:41.385859 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb695f-04bb-48ba-984c-a4757fc68f28 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.388376 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd7a4e-a676-46ee-bccf-ac867b87c698 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.391830 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dc56e-fabc-4365-a96b-2ea19ab1b98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.392582 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dc56e-fabc-4365-a96b-2ea19ab1b98a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.392942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dc56e-fabc-4365-a96b-2ea19ab1b98a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.393311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dc56e-fabc-4365-a96b-2ea19ab1b98a admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.394091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dc56e-fabc-4365-a96b-2ea19ab1b98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.395819 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dc56e-fabc-4365-a96b-2ea19ab1b98a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.398989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd7a4e-a676-46ee-bccf-ac867b87c698 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.404928 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f9bc-db2d-4ad9-9565-522ca24038c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.405526 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f9bc-db2d-4ad9-9565-522ca24038c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.405803 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f9bc-db2d-4ad9-9565-522ca24038c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.406083 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f9bc-db2d-4ad9-9565-522ca24038c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.406802 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74f9bc-db2d-4ad9-9565-522ca24038c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.407182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 772/1539] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:41.408003 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dc56e-fabc-4365-a96b-2ea19ab1b98a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.411618 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74f9bc-db2d-4ad9-9565-522ca24038c0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.418634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dc56e-fabc-4365-a96b-2ea19ab1b98a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.424444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 768/1540] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:41.425257 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f9bc-db2d-4ad9-9565-522ca24038c0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.427444 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b6804-a45d-4e7d-96e0-a2fd8455c280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.428151 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b6804-a45d-4e7d-96e0-a2fd8455c280 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.428444 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b6804-a45d-4e7d-96e0-a2fd8455c280 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.428728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b6804-a45d-4e7d-96e0-a2fd8455c280 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.429460 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b6804-a45d-4e7d-96e0-a2fd8455c280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.431321 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b6804-a45d-4e7d-96e0-a2fd8455c280 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.435703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f9bc-db2d-4ad9-9565-522ca24038c0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.441900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 773/1541] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:41.442246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150f8be-df74-4eef-ae21-6c24150b7db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.443230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150f8be-df74-4eef-ae21-6c24150b7db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.443512 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150f8be-df74-4eef-ae21-6c24150b7db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.443785 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150f8be-df74-4eef-ae21-6c24150b7db6 admin admin] PATH_INFO: `/v3/projects/8c7943acef784205bec73dbd12440254/users/f4abd2f77c814766b4266641038e279c/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.445778 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b6804-a45d-4e7d-96e0-a2fd8455c280 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.455494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b6804-a45d-4e7d-96e0-a2fd8455c280 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.459494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150f8be-df74-4eef-ae21-6c24150b7db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7943acef784205bec73dbd12440254, user_id=f4abd2f77c814766b4266641038e279c, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.462212 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327c8a0-902b-4988-8535-5bd1071a57bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.462943 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327c8a0-902b-4988-8535-5bd1071a57bf admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.463148 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327c8a0-902b-4988-8535-5bd1071a57bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.463259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150f8be-df74-4eef-ae21-6c24150b7db6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.463520 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327c8a0-902b-4988-8535-5bd1071a57bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.464879 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327c8a0-902b-4988-8535-5bd1071a57bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.467016 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327c8a0-902b-4988-8535-5bd1071a57bf admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.478719 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 774/1542] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:41.479577 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327c8a0-902b-4988-8535-5bd1071a57bf admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.480859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 769/1543] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:41 2021] PUT /identity/v3/projects/8c7943acef784205bec73dbd12440254/users/f4abd2f77c814766b4266641038e279c/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:41.486874 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150f8be-df74-4eef-ae21-6c24150b7db6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.492533 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327c8a0-902b-4988-8535-5bd1071a57bf admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.555624 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0cd50-83f6-4f26-839e-baf88a0c5a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.556307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0cd50-83f6-4f26-839e-baf88a0c5a9d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.556604 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0cd50-83f6-4f26-839e-baf88a0c5a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.556879 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0cd50-83f6-4f26-839e-baf88a0c5a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.557620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0cd50-83f6-4f26-839e-baf88a0c5a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.559378 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0cd50-83f6-4f26-839e-baf88a0c5a9d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.560564 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150f8be-df74-4eef-ae21-6c24150b7db6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.565506 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dd796-ba7f-48a1-88f2-07fa242d03a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.566386 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dd796-ba7f-48a1-88f2-07fa242d03a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.566749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dd796-ba7f-48a1-88f2-07fa242d03a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.567187 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dd796-ba7f-48a1-88f2-07fa242d03a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.568006 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dd796-ba7f-48a1-88f2-07fa242d03a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.569660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dd796-ba7f-48a1-88f2-07fa242d03a9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.571477 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 775/1544] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:41.572206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0cd50-83f6-4f26-839e-baf88a0c5a9d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.581654 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0cd50-83f6-4f26-839e-baf88a0c5a9d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.583859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 770/1545] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:41.587170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ac668-5210-4a6e-9c49-8a904f4fdf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.588059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ac668-5210-4a6e-9c49-8a904f4fdf21 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.588479 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ac668-5210-4a6e-9c49-8a904f4fdf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.588592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dd796-ba7f-48a1-88f2-07fa242d03a9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.588771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ac668-5210-4a6e-9c49-8a904f4fdf21 admin admin] PATH_INFO: `/v3/projects/36ebdcfef58f4767b9c9a70cf47d910e/users/f6176ce32e2945cbac1d04222ff9fb44/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.598902 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dd796-ba7f-48a1-88f2-07fa242d03a9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.604025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e14497-2496-4aea-b890-2520832a3d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.604988 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e14497-2496-4aea-b890-2520832a3d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.605363 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e14497-2496-4aea-b890-2520832a3d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.605796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e14497-2496-4aea-b890-2520832a3d34 admin admin] PATH_INFO: `/v3/projects/3aedbd85cc7044dea9fc2a70f7c32773/users/229a204d36f64daa86135fc5104018c5/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.605965 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ac668-5210-4a6e-9c49-8a904f4fdf21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ebdcfef58f4767b9c9a70cf47d910e, user_id=f6176ce32e2945cbac1d04222ff9fb44, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.608860 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ac668-5210-4a6e-9c49-8a904f4fdf21 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.622558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e14497-2496-4aea-b890-2520832a3d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aedbd85cc7044dea9fc2a70f7c32773, user_id=229a204d36f64daa86135fc5104018c5, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.623892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 776/1546] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:41 2021] PUT /identity/v3/projects/36ebdcfef58f4767b9c9a70cf47d910e/users/f6176ce32e2945cbac1d04222ff9fb44/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:41.624460 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ac668-5210-4a6e-9c49-8a904f4fdf21 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.626328 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e14497-2496-4aea-b890-2520832a3d34 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.647491 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 771/1547] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:41 2021] PUT /identity/v3/projects/3aedbd85cc7044dea9fc2a70f7c32773/users/229a204d36f64daa86135fc5104018c5/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:41.649522 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca77be-1138-4049-b481-b189f09b6776 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.650077 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca77be-1138-4049-b481-b189f09b6776 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.650077 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca77be-1138-4049-b481-b189f09b6776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.686458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-95ca77be-1138-4049-b481-b189f09b6776 None None] MFA Rules not processed for user `f4abd2f77c814766b4266641038e279c`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:41.687788 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-95ca77be-1138-4049-b481-b189f09b6776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:41.704360 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ac668-5210-4a6e-9c49-8a904f4fdf21 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.767288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a23808-196f-4ca6-97b0-c18b051f249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.768194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a23808-196f-4ca6-97b0-c18b051f249b admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.768484 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a23808-196f-4ca6-97b0-c18b051f249b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.768769 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a23808-196f-4ca6-97b0-c18b051f249b admin admin] PATH_INFO: `/v3/projects/bc9e9f6b72d949e5bd4f7233535cf749/users/0d309e912d91408ca402f8ea3093a45d/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.773291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 772/1548] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:41 2021] POST /identity/v3/auth/tokens => generated 3377 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:41.775663 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca77be-1138-4049-b481-b189f09b6776 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.786907 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a23808-196f-4ca6-97b0-c18b051f249b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9e9f6b72d949e5bd4f7233535cf749, user_id=0d309e912d91408ca402f8ea3093a45d, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.788648 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca77be-1138-4049-b481-b189f09b6776 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.789900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a23808-196f-4ca6-97b0-c18b051f249b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.793933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4879b-8d0d-4dff-b56d-e2156cf11636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.795082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4879b-8d0d-4dff-b56d-e2156cf11636 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.795388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4879b-8d0d-4dff-b56d-e2156cf11636 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.795688 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4879b-8d0d-4dff-b56d-e2156cf11636 admin admin] PATH_INFO: `/v3/projects/d0a228b9e92749489f5bfd15bc40e3ae/users/8e7b025b18e74bb2b8094853d9ac2c3b/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.806931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 777/1549] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:41 2021] PUT /identity/v3/projects/bc9e9f6b72d949e5bd4f7233535cf749/users/0d309e912d91408ca402f8ea3093a45d/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:41.807338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a23808-196f-4ca6-97b0-c18b051f249b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:41.835070 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4879b-8d0d-4dff-b56d-e2156cf11636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a228b9e92749489f5bfd15bc40e3ae, user_id=8e7b025b18e74bb2b8094853d9ac2c3b, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.840401 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4879b-8d0d-4dff-b56d-e2156cf11636 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.864615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 773/1550] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:41 2021] PUT /identity/v3/projects/d0a228b9e92749489f5bfd15bc40e3ae/users/8e7b025b18e74bb2b8094853d9ac2c3b/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:41.864615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a652e6-1b4d-47a2-b6ee-e6962c28396a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.864615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a652e6-1b4d-47a2-b6ee-e6962c28396a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.864615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a652e6-1b4d-47a2-b6ee-e6962c28396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.875032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a23808-196f-4ca6-97b0-c18b051f249b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:41.946742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-00a652e6-1b4d-47a2-b6ee-e6962c28396a None None] MFA Rules not processed for user `f6176ce32e2945cbac1d04222ff9fb44`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:41.948932 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-00a652e6-1b4d-47a2-b6ee-e6962c28396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:41.954766 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b98244-27d5-49ef-87cd-66097aae9ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:41.955706 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b98244-27d5-49ef-87cd-66097aae9ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.955993 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b98244-27d5-49ef-87cd-66097aae9ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.956308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b98244-27d5-49ef-87cd-66097aae9ee1 admin admin] PATH_INFO: `/v3/projects/b3e21d8c24af4cef9a4289395a5af8e2/users/a5d8ae82c9644a629b96d5edfa11682f/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:41.973717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b98244-27d5-49ef-87cd-66097aae9ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e21d8c24af4cef9a4289395a5af8e2, user_id=a5d8ae82c9644a629b96d5edfa11682f, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:41.977317 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b98244-27d5-49ef-87cd-66097aae9ee1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:41.995587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 778/1551] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:41 2021] PUT /identity/v3/projects/b3e21d8c24af4cef9a4289395a5af8e2/users/a5d8ae82c9644a629b96d5edfa11682f/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:41.995587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede03c-4990-482f-ba93-ce14ff54533e None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:41.995587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede03c-4990-482f-ba93-ce14ff54533e None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:41.995587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede03c-4990-482f-ba93-ce14ff54533e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.030576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-94ede03c-4990-482f-ba93-ce14ff54533e None None] MFA Rules not processed for user `229a204d36f64daa86135fc5104018c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:42.032399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-94ede03c-4990-482f-ba93-ce14ff54533e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:42.040166 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 774/1552] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:41 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:42.041340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a652e6-1b4d-47a2-b6ee-e6962c28396a None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:42.061854 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a652e6-1b4d-47a2-b6ee-e6962c28396a None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:42.114482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 779/1553] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:41 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:42.121692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a847e-3ddd-43e7-9973-d1f6a3630430 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.122238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a847e-3ddd-43e7-9973-d1f6a3630430 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.122733 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a847e-3ddd-43e7-9973-d1f6a3630430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.147244 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cbf15-114d-47c6-9fcf-1c3f8634757d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:42.147991 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cbf15-114d-47c6-9fcf-1c3f8634757d admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.148395 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cbf15-114d-47c6-9fcf-1c3f8634757d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.149396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cbf15-114d-47c6-9fcf-1c3f8634757d admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.150249 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cbf15-114d-47c6-9fcf-1c3f8634757d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:42.152671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cbf15-114d-47c6-9fcf-1c3f8634757d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:42.163017 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-4f1a847e-3ddd-43e7-9973-d1f6a3630430 None None] MFA Rules not processed for user `0d309e912d91408ca402f8ea3093a45d`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:42.165176 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-4f1a847e-3ddd-43e7-9973-d1f6a3630430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:42.186873 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 775/1554] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/projects => generated 355 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:42.187070 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6549d7-f99f-488a-af87-e145578061bf None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.187253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6549d7-f99f-488a-af87-e145578061bf None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.187584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6549d7-f99f-488a-af87-e145578061bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.211617 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7a6549d7-f99f-488a-af87-e145578061bf None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:42.213632 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7a6549d7-f99f-488a-af87-e145578061bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:42.246718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 780/1555] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:42.246718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9436f-d809-48ef-8843-c1d6a5bd339c None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.246718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9436f-d809-48ef-8843-c1d6a5bd339c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.246718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9436f-d809-48ef-8843-c1d6a5bd339c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.274210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-acb9436f-d809-48ef-8843-c1d6a5bd339c None None] MFA Rules not processed for user `75a772d36dc64b34ad0e9f2748cea24f`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:42.275539 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-acb9436f-d809-48ef-8843-c1d6a5bd339c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:42.281900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 776/1556] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:42.283091 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908acb61-0cb2-46e4-a690-7d879a956357 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.283352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908acb61-0cb2-46e4-a690-7d879a956357 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.283595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908acb61-0cb2-46e4-a690-7d879a956357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.307591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-908acb61-0cb2-46e4-a690-7d879a956357 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:42.308946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-908acb61-0cb2-46e4-a690-7d879a956357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:42.319825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 777/1557] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:42.319825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908acb61-0cb2-46e4-a690-7d879a956357 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:42.331328 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908acb61-0cb2-46e4-a690-7d879a956357 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:42.336841 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451fec-3acb-4b48-b3c9-4d73a9ecb493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:42.337559 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451fec-3acb-4b48-b3c9-4d73a9ecb493 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.337845 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451fec-3acb-4b48-b3c9-4d73a9ecb493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.338123 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451fec-3acb-4b48-b3c9-4d73a9ecb493 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.338881 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1451fec-3acb-4b48-b3c9-4d73a9ecb493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:42.340828 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1451fec-3acb-4b48-b3c9-4d73a9ecb493 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:42.372678 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 778/1558] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:42.374763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 781/1559] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:42.376749 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9436f-d809-48ef-8843-c1d6a5bd339c None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:42.377617 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894411e-c422-4eee-9c8a-d17d55f0ecd9 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.377913 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894411e-c422-4eee-9c8a-d17d55f0ecd9 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.378195 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894411e-c422-4eee-9c8a-d17d55f0ecd9 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.380332 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 779/1560] 10.222.0.50 () {54 vars in 959 bytes} [Tue Nov 16 00:31:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:31:42.381173 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894411e-c422-4eee-9c8a-d17d55f0ecd9 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:42.396919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9436f-d809-48ef-8843-c1d6a5bd339c None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:42.457915 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894411e-c422-4eee-9c8a-d17d55f0ecd9 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:42.462781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc28d08-eb17-4432-90a5-3e02e86629c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:42.463589 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc28d08-eb17-4432-90a5-3e02e86629c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.463796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc28d08-eb17-4432-90a5-3e02e86629c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.464129 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc28d08-eb17-4432-90a5-3e02e86629c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.464822 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc28d08-eb17-4432-90a5-3e02e86629c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:42.467004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc28d08-eb17-4432-90a5-3e02e86629c6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:42.472617 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd745ad9-f082-491b-a291-924709bb69ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:42.473649 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd745ad9-f082-491b-a291-924709bb69ff admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.474179 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd745ad9-f082-491b-a291-924709bb69ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.474931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd745ad9-f082-491b-a291-924709bb69ff admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.476386 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd745ad9-f082-491b-a291-924709bb69ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:42.479737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd745ad9-f082-491b-a291-924709bb69ff admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:42.497008 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 780/1561] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:42.500988 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc28d08-eb17-4432-90a5-3e02e86629c6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:42.503082 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 782/1562] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/users => generated 284 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:42.505684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0744b-f919-440f-baca-b0841a52d827 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.506007 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0744b-f919-440f-baca-b0841a52d827 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.506322 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0744b-f919-440f-baca-b0841a52d827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.536112 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-ccf0744b-f919-440f-baca-b0841a52d827 None None] MFA Rules not processed for user `de9afb44d4b74521af5386541a1ad201`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:42.537792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ccf0744b-f919-440f-baca-b0841a52d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:42.564723 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc28d08-eb17-4432-90a5-3e02e86629c6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:42.568640 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01553588-f024-4f23-9e47-e0221fb6e091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:42.569299 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01553588-f024-4f23-9e47-e0221fb6e091 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.569585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01553588-f024-4f23-9e47-e0221fb6e091 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.569863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01553588-f024-4f23-9e47-e0221fb6e091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.604543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 783/1563] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:42.605782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0744b-f919-440f-baca-b0841a52d827 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:42.614807 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0744b-f919-440f-baca-b0841a52d827 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:42.619408 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9094b8e-e518-40d7-990a-f7cc4740c55d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:42.620051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094b8e-e518-40d7-990a-f7cc4740c55d service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.620340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094b8e-e518-40d7-990a-f7cc4740c55d service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.620620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094b8e-e518-40d7-990a-f7cc4740c55d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.632551 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01553588-f024-4f23-9e47-e0221fb6e091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:42.634745 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01553588-f024-4f23-9e47-e0221fb6e091 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:42.644271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 781/1564] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:42.646089 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01553588-f024-4f23-9e47-e0221fb6e091 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:42.655255 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01553588-f024-4f23-9e47-e0221fb6e091 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:42.659976 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a7a42-2c12-4d9a-a948-bd4b72df6a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:42.660647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a7a42-2c12-4d9a-a948-bd4b72df6a66 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.660933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a7a42-2c12-4d9a-a948-bd4b72df6a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.661418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a7a42-2c12-4d9a-a948-bd4b72df6a66 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.661898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a7a42-2c12-4d9a-a948-bd4b72df6a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:42.664355 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a7a42-2c12-4d9a-a948-bd4b72df6a66 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:42.687638 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 782/1565] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:42.688931 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f084f-c4af-440b-8369-71331367c253 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.689235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f084f-c4af-440b-8369-71331367c253 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.689520 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f084f-c4af-440b-8369-71331367c253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.691267 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9094b8e-e518-40d7-990a-f7cc4740c55d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:42.692730 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9094b8e-e518-40d7-990a-f7cc4740c55d service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:42.704150 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 784/1566] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:42.705627 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fa543-9e09-42e1-98a6-9ec74cac9795 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.705627 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fa543-9e09-42e1-98a6-9ec74cac9795 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.706369 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fa543-9e09-42e1-98a6-9ec74cac9795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.711411 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-130f084f-c4af-440b-8369-71331367c253 None None] MFA Rules not processed for user `75a772d36dc64b34ad0e9f2748cea24f`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:42.712780 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-130f084f-c4af-440b-8369-71331367c253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:42.723764 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-7e6fa543-9e09-42e1-98a6-9ec74cac9795 None None] MFA Rules not processed for user `442cc0e13dcb49f0a4a870c06e0edf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:42.725354 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7e6fa543-9e09-42e1-98a6-9ec74cac9795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:42.779757 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 783/1567] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:42.780634 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f084f-c4af-440b-8369-71331367c253 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:42.792493 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f084f-c4af-440b-8369-71331367c253 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:42.798591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539a458-4cf5-4764-b11d-0fe6dc0fe65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:42.799321 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539a458-4cf5-4764-b11d-0fe6dc0fe65a admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.799647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539a458-4cf5-4764-b11d-0fe6dc0fe65a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.799915 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539a458-4cf5-4764-b11d-0fe6dc0fe65a admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.800725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539a458-4cf5-4764-b11d-0fe6dc0fe65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:42.802693 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539a458-4cf5-4764-b11d-0fe6dc0fe65a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:42.802953 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 785/1568] 10.222.0.50 () {58 vars in 1056 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:42.803753 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fa543-9e09-42e1-98a6-9ec74cac9795 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:42.814317 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fa543-9e09-42e1-98a6-9ec74cac9795 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:42.821293 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f537f-6350-42ba-83bc-5d44e28e189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:42.822066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f537f-6350-42ba-83bc-5d44e28e189d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.822356 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f537f-6350-42ba-83bc-5d44e28e189d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.822635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f537f-6350-42ba-83bc-5d44e28e189d admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.823583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f537f-6350-42ba-83bc-5d44e28e189d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:42.825386 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f537f-6350-42ba-83bc-5d44e28e189d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:42.838005 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 784/1569] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/users => generated 288 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:42.838202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 786/1570] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:42 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:42.838202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f537f-6350-42ba-83bc-5d44e28e189d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:42.840692 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb5f35-4259-4b89-a7e7-e37501d48af3 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.841005 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb5f35-4259-4b89-a7e7-e37501d48af3 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.841330 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb5f35-4259-4b89-a7e7-e37501d48af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.848229 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f537f-6350-42ba-83bc-5d44e28e189d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:42.853959 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf49e77-efff-4887-a86a-3b0816df3e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:42.854730 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49e77-efff-4887-a86a-3b0816df3e7d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.855173 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49e77-efff-4887-a86a-3b0816df3e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.855454 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49e77-efff-4887-a86a-3b0816df3e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.856257 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf49e77-efff-4887-a86a-3b0816df3e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:42.858096 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf49e77-efff-4887-a86a-3b0816df3e7d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:42.861514 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-58bb5f35-4259-4b89-a7e7-e37501d48af3 None None] MFA Rules not processed for user `de9afb44d4b74521af5386541a1ad201`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:42.862694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-58bb5f35-4259-4b89-a7e7-e37501d48af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:42.870210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 787/1571] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:42 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:42.871593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a116ab2-8b38-43cd-8b60-e7858a088642 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.871887 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a116ab2-8b38-43cd-8b60-e7858a088642 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.872236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a116ab2-8b38-43cd-8b60-e7858a088642 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.874562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 788/1572] 10.222.0.50 () {54 vars in 959 bytes} [Tue Nov 16 00:31:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:31:42.874697 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 785/1573] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:42.875338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a116ab2-8b38-43cd-8b60-e7858a088642 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:42.879771 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb5f35-4259-4b89-a7e7-e37501d48af3 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:42.892464 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb5f35-4259-4b89-a7e7-e37501d48af3 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:42.892920 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a116ab2-8b38-43cd-8b60-e7858a088642 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:42.897537 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19c9eb-5756-4368-8f60-8215f7a3cdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:42.898492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c9eb-5756-4368-8f60-8215f7a3cdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.899493 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c9eb-5756-4368-8f60-8215f7a3cdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.899861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c9eb-5756-4368-8f60-8215f7a3cdb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.900363 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7197e-2f30-4371-8aa2-633b3a868f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:42.900730 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19c9eb-5756-4368-8f60-8215f7a3cdb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:42.900959 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7197e-2f30-4371-8aa2-633b3a868f89 service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.901240 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7197e-2f30-4371-8aa2-633b3a868f89 service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.901516 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7197e-2f30-4371-8aa2-633b3a868f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.902562 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19c9eb-5756-4368-8f60-8215f7a3cdb7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:42.913200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 786/1574] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:42 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:42.913867 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19c9eb-5756-4368-8f60-8215f7a3cdb7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:42.924551 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19c9eb-5756-4368-8f60-8215f7a3cdb7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:42.931539 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd878f-f770-40e7-ac71-013c46933540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:42.932368 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd878f-f770-40e7-ac71-013c46933540 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.932657 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd878f-f770-40e7-ac71-013c46933540 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.933034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd878f-f770-40e7-ac71-013c46933540 admin admin] PATH_INFO: `/v3/projects/1640ee69d6df4a55a9dc4f46e39a55a4/users/c6d5a75d07174709b7a8908a99657aa4/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:42.955651 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd878f-f770-40e7-ac71-013c46933540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1640ee69d6df4a55a9dc4f46e39a55a4, user_id=c6d5a75d07174709b7a8908a99657aa4, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:42.960069 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd878f-f770-40e7-ac71-013c46933540 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:42.979865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 787/1575] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:42 2021] PUT /identity/v3/projects/1640ee69d6df4a55a9dc4f46e39a55a4/users/c6d5a75d07174709b7a8908a99657aa4/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:42.981006 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd878f-f770-40e7-ac71-013c46933540 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:42.985131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7197e-2f30-4371-8aa2-633b3a868f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:42.986767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7197e-2f30-4371-8aa2-633b3a868f89 service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:42.997942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 789/1576] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:42 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:42.999293 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d11d1-f727-4732-97ae-cc15519c63f7 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:42.999586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d11d1-f727-4732-97ae-cc15519c63f7 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:42.999867 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d11d1-f727-4732-97ae-cc15519c63f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:43.019853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-345d11d1-f727-4732-97ae-cc15519c63f7 None None] MFA Rules not processed for user `442cc0e13dcb49f0a4a870c06e0edf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:43.021069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-345d11d1-f727-4732-97ae-cc15519c63f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:43.059506 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd878f-f770-40e7-ac71-013c46933540 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:43.064856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe9864-c6a7-4ebf-9b0b-2f5315aff70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:43.065869 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe9864-c6a7-4ebf-9b0b-2f5315aff70b admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:43.066440 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe9864-c6a7-4ebf-9b0b-2f5315aff70b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:43.067213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe9864-c6a7-4ebf-9b0b-2f5315aff70b admin admin] PATH_INFO: `/v3/projects/d4310ecf05f94b28a5d466c433715c82/users/2d8c41ae0a7a463ebc1dd260a81c0a6e/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:43.085837 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe9864-c6a7-4ebf-9b0b-2f5315aff70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4310ecf05f94b28a5d466c433715c82, user_id=2d8c41ae0a7a463ebc1dd260a81c0a6e, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:43.089947 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe9864-c6a7-4ebf-9b0b-2f5315aff70b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:43.093781 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 790/1577] 10.222.0.50 () {58 vars in 1056 bytes} [Tue Nov 16 00:31:42 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:43.095384 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d11d1-f727-4732-97ae-cc15519c63f7 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:43.112543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 788/1578] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:42 2021] PUT /identity/v3/projects/d4310ecf05f94b28a5d466c433715c82/users/2d8c41ae0a7a463ebc1dd260a81c0a6e/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:43.113392 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe9864-c6a7-4ebf-9b0b-2f5315aff70b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:43.133458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d11d1-f727-4732-97ae-cc15519c63f7 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:43.202316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe9864-c6a7-4ebf-9b0b-2f5315aff70b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:43.207746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7aa2e-0cf9-4a0d-8870-973ced9611ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:43.208614 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7aa2e-0cf9-4a0d-8870-973ced9611ae admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:43.209001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7aa2e-0cf9-4a0d-8870-973ced9611ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:43.209418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7aa2e-0cf9-4a0d-8870-973ced9611ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:43.210394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7aa2e-0cf9-4a0d-8870-973ced9611ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:43.213640 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7aa2e-0cf9-4a0d-8870-973ced9611ae admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:43.230116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 789/1579] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:43 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:43.230116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7aa2e-0cf9-4a0d-8870-973ced9611ae admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:43.272334 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03958c17-af70-43fc-8136-d47a1d870820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:43.273593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958c17-af70-43fc-8136-d47a1d870820 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:43.273873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958c17-af70-43fc-8136-d47a1d870820 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:43.274235 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958c17-af70-43fc-8136-d47a1d870820 admin admin] PATH_INFO: `/v3/projects/91366ea673844e1d8bd0cddd91a913ac/users/e8576f3cc672435bacb8828a5f8c0ed3/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:43.310928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03958c17-af70-43fc-8136-d47a1d870820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91366ea673844e1d8bd0cddd91a913ac, user_id=e8576f3cc672435bacb8828a5f8c0ed3, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:43.317451 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03958c17-af70-43fc-8136-d47a1d870820 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:43.344435 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 791/1580] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:43 2021] PUT /identity/v3/projects/91366ea673844e1d8bd0cddd91a913ac/users/e8576f3cc672435bacb8828a5f8c0ed3/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:43.349843 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03958c17-af70-43fc-8136-d47a1d870820 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:43.358543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7aa2e-0cf9-4a0d-8870-973ced9611ae admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:43.446746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03958c17-af70-43fc-8136-d47a1d870820 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:43.453320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c02d8-2607-404d-aab7-3f4c7cad8cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:43.454602 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c02d8-2607-404d-aab7-3f4c7cad8cfb admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:43.454928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c02d8-2607-404d-aab7-3f4c7cad8cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:43.455218 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c02d8-2607-404d-aab7-3f4c7cad8cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:43.455957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c02d8-2607-404d-aab7-3f4c7cad8cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:43.457584 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c02d8-2607-404d-aab7-3f4c7cad8cfb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:43.458020 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6d21e-b93a-4b96-a6fa-523e074d9704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:43.459030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d21e-b93a-4b96-a6fa-523e074d9704 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:43.459496 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d21e-b93a-4b96-a6fa-523e074d9704 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:43.459946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d21e-b93a-4b96-a6fa-523e074d9704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:43.471064 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 792/1581] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:43 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:43.471846 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c02d8-2607-404d-aab7-3f4c7cad8cfb admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:43.486324 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c02d8-2607-404d-aab7-3f4c7cad8cfb admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:43.492973 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab517cd5-ac28-40f2-97bd-ea8899f7b251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:43.493910 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab517cd5-ac28-40f2-97bd-ea8899f7b251 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:43.494246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab517cd5-ac28-40f2-97bd-ea8899f7b251 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:43.494572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab517cd5-ac28-40f2-97bd-ea8899f7b251 admin admin] PATH_INFO: `/v3/projects/1640ee69d6df4a55a9dc4f46e39a55a4/users/c6d5a75d07174709b7a8908a99657aa4/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:43.496815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab517cd5-ac28-40f2-97bd-ea8899f7b251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1640ee69d6df4a55a9dc4f46e39a55a4, user_id=c6d5a75d07174709b7a8908a99657aa4, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:43.499537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab517cd5-ac28-40f2-97bd-ea8899f7b251 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:43.512152 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 793/1582] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:43 2021] PUT /identity/v3/projects/1640ee69d6df4a55a9dc4f46e39a55a4/users/c6d5a75d07174709b7a8908a99657aa4/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:43.513140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab517cd5-ac28-40f2-97bd-ea8899f7b251 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:43.537738 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6d21e-b93a-4b96-a6fa-523e074d9704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:43.540071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6d21e-b93a-4b96-a6fa-523e074d9704 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:43.549401 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 790/1583] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:43 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:43.556771 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b662e2-2c0e-4473-81ad-cb3210d4908f None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:43.557512 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b662e2-2c0e-4473-81ad-cb3210d4908f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:43.558008 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b662e2-2c0e-4473-81ad-cb3210d4908f None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:43.561856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 791/1584] 10.222.0.50 () {54 vars in 912 bytes} [Tue Nov 16 00:31:43 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:31:43.563040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b662e2-2c0e-4473-81ad-cb3210d4908f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:43.591595 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab517cd5-ac28-40f2-97bd-ea8899f7b251 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:43.597738 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d444dd5-1843-4fb6-aa96-bde78a5bd7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:43.598687 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d444dd5-1843-4fb6-aa96-bde78a5bd7ea admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:43.599026 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d444dd5-1843-4fb6-aa96-bde78a5bd7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:43.599400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d444dd5-1843-4fb6-aa96-bde78a5bd7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:43.602447 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d444dd5-1843-4fb6-aa96-bde78a5bd7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:43.604718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d444dd5-1843-4fb6-aa96-bde78a5bd7ea admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:43.616484 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 794/1585] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:43 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:43.618652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8e3ab-5758-4ee4-b254-d1d67093abeb None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:43.618652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8e3ab-5758-4ee4-b254-d1d67093abeb None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:43.618652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8e3ab-5758-4ee4-b254-d1d67093abeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:43.655538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-67b8e3ab-5758-4ee4-b254-d1d67093abeb None None] MFA Rules not processed for user `c6d5a75d07174709b7a8908a99657aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:43.656484 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b662e2-2c0e-4473-81ad-cb3210d4908f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:43.656954 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-67b8e3ab-5758-4ee4-b254-d1d67093abeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:43.662383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab301ce-db13-4882-abee-352ef6617d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:43.663687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab301ce-db13-4882-abee-352ef6617d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:43.665135 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab301ce-db13-4882-abee-352ef6617d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:43.665702 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab301ce-db13-4882-abee-352ef6617d7d admin admin] PATH_INFO: `/v3/projects/d4310ecf05f94b28a5d466c433715c82/users/2d8c41ae0a7a463ebc1dd260a81c0a6e/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:43.668053 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab301ce-db13-4882-abee-352ef6617d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4310ecf05f94b28a5d466c433715c82, user_id=2d8c41ae0a7a463ebc1dd260a81c0a6e, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:43.671365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab301ce-db13-4882-abee-352ef6617d7d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:43.693335 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 792/1586] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:43 2021] PUT /identity/v3/projects/d4310ecf05f94b28a5d466c433715c82/users/2d8c41ae0a7a463ebc1dd260a81c0a6e/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:43.695127 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc643-667b-4e8a-9ac3-7f4d8ceff28b None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:43.695556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc643-667b-4e8a-9ac3-7f4d8ceff28b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:43.696160 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc643-667b-4e8a-9ac3-7f4d8ceff28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:43.728353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-20ccc643-667b-4e8a-9ac3-7f4d8ceff28b None None] MFA Rules not processed for user `442cc0e13dcb49f0a4a870c06e0edf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:43.729522 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-20ccc643-667b-4e8a-9ac3-7f4d8ceff28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:43.749781 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 795/1587] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:43 2021] POST /identity/v3/auth/tokens => generated 3442 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:43.751354 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8e3ab-5758-4ee4-b254-d1d67093abeb None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:43.768299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8e3ab-5758-4ee4-b254-d1d67093abeb None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:43.824280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 793/1588] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Nov 16 00:31:43 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:43.825929 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5398b2a-9b8f-4484-80a7-a8b5acd85fe4 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:43.826161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5398b2a-9b8f-4484-80a7-a8b5acd85fe4 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:43.826453 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5398b2a-9b8f-4484-80a7-a8b5acd85fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:43.862226 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-b5398b2a-9b8f-4484-80a7-a8b5acd85fe4 None None] MFA Rules not processed for user `2d8c41ae0a7a463ebc1dd260a81c0a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:43.863498 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-b5398b2a-9b8f-4484-80a7-a8b5acd85fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:43.893771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bc0e5-8944-4c16-b64e-95bb645d8658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:43.896358 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bc0e5-8944-4c16-b64e-95bb645d8658 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:43.896819 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bc0e5-8944-4c16-b64e-95bb645d8658 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:43.901469 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bc0e5-8944-4c16-b64e-95bb645d8658 admin admin] PATH_INFO: `/v3/projects/91366ea673844e1d8bd0cddd91a913ac/users/e8576f3cc672435bacb8828a5f8c0ed3/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:43.909899 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5bc0e5-8944-4c16-b64e-95bb645d8658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91366ea673844e1d8bd0cddd91a913ac, user_id=e8576f3cc672435bacb8828a5f8c0ed3, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:43.913083 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5bc0e5-8944-4c16-b64e-95bb645d8658 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:43.955583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 796/1589] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:43 2021] PUT /identity/v3/projects/91366ea673844e1d8bd0cddd91a913ac/users/e8576f3cc672435bacb8828a5f8c0ed3/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:43.956753 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bc0e5-8944-4c16-b64e-95bb645d8658 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:44.001957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 794/1590] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:43 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:44.004904 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5398b2a-9b8f-4484-80a7-a8b5acd85fe4 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:44.090865 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bc0e5-8944-4c16-b64e-95bb645d8658 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:44.094847 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2809a9f-b7a0-4f9d-a4f2-4351bacfddc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:44.095508 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2809a9f-b7a0-4f9d-a4f2-4351bacfddc0 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:44.095793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2809a9f-b7a0-4f9d-a4f2-4351bacfddc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:44.096068 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2809a9f-b7a0-4f9d-a4f2-4351bacfddc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:44.103664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5398b2a-9b8f-4484-80a7-a8b5acd85fe4 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:44.107974 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208beb51-4d34-4bf2-aea2-2fee98978995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:44.108686 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208beb51-4d34-4bf2-aea2-2fee98978995 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:44.108920 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208beb51-4d34-4bf2-aea2-2fee98978995 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:44.109203 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208beb51-4d34-4bf2-aea2-2fee98978995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:44.190047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2809a9f-b7a0-4f9d-a4f2-4351bacfddc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:44.191839 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2809a9f-b7a0-4f9d-a4f2-4351bacfddc0 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:44.216620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 797/1591] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:43 2021] GET /identity/v3/auth/tokens => generated 3442 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:44.218290 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5584c4-b87a-4a28-bf71-0a09a562a001 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:44.219072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5584c4-b87a-4a28-bf71-0a09a562a001 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:44.219072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5584c4-b87a-4a28-bf71-0a09a562a001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:44.239683 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208beb51-4d34-4bf2-aea2-2fee98978995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:44.241516 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208beb51-4d34-4bf2-aea2-2fee98978995 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:44.271039 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 795/1592] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:44 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:44.275792 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca399621-8eee-4455-8d0f-bf577427cfaa None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:44.276199 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca399621-8eee-4455-8d0f-bf577427cfaa None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:44.276426 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca399621-8eee-4455-8d0f-bf577427cfaa None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:44.279912 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 796/1593] 10.222.0.50 () {54 vars in 912 bytes} [Tue Nov 16 00:31:44 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:31:44.280835 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca399621-8eee-4455-8d0f-bf577427cfaa None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:44.294341 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca399621-8eee-4455-8d0f-bf577427cfaa None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:44.299599 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345153b-7371-4913-83fb-f1abe03ac702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:44.300361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345153b-7371-4913-83fb-f1abe03ac702 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:44.300652 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345153b-7371-4913-83fb-f1abe03ac702 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:44.301005 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345153b-7371-4913-83fb-f1abe03ac702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:44.308178 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-bb5584c4-b87a-4a28-bf71-0a09a562a001 None None] MFA Rules not processed for user `e8576f3cc672435bacb8828a5f8c0ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:44.309165 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-bb5584c4-b87a-4a28-bf71-0a09a562a001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:44.369577 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345153b-7371-4913-83fb-f1abe03ac702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:44.371362 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345153b-7371-4913-83fb-f1abe03ac702 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:44.393804 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 797/1594] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:44 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:44.396398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f96bc-324a-4a0f-b013-f4fea3e78ceb None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:44.398083 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f96bc-324a-4a0f-b013-f4fea3e78ceb None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:44.399203 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f96bc-324a-4a0f-b013-f4fea3e78ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:44.447572 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-286f96bc-324a-4a0f-b013-f4fea3e78ceb None None] MFA Rules not processed for user `442cc0e13dcb49f0a4a870c06e0edf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:44.449059 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-286f96bc-324a-4a0f-b013-f4fea3e78ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:44.470102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 798/1595] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:44 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:44.473815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 798/1596] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Nov 16 00:31:44 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:44.489330 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5584c4-b87a-4a28-bf71-0a09a562a001 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:44.491681 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-bb5584c4-b87a-4a28-bf71-0a09a562a001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:44.585382 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f96bc-324a-4a0f-b013-f4fea3e78ceb None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:44.599224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f96bc-324a-4a0f-b013-f4fea3e78ceb None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:44.608537 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4d514-557c-4da8-8b28-d3e057a4d07e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:44.609207 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4d514-557c-4da8-8b28-d3e057a4d07e service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:44.609498 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4d514-557c-4da8-8b28-d3e057a4d07e service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:44.609782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4d514-557c-4da8-8b28-d3e057a4d07e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:44.635361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4d514-557c-4da8-8b28-d3e057a4d07e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:44.636871 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4d514-557c-4da8-8b28-d3e057a4d07e service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:44.644007 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5584c4-b87a-4a28-bf71-0a09a562a001 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:44.653962 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 799/1597] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:44 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:31:44.664631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1217f-52e6-455c-b86e-da6895e69ffa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cab78404d3c4980a4b99da09edab426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:44.665333 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1217f-52e6-455c-b86e-da6895e69ffa service glance] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:44.665773 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1217f-52e6-455c-b86e-da6895e69ffa service glance] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:44.666065 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1217f-52e6-455c-b86e-da6895e69ffa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:44.690727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1217f-52e6-455c-b86e-da6895e69ffa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:44.692307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1217f-52e6-455c-b86e-da6895e69ffa service glance] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:44.708538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4d514-557c-4da8-8b28-d3e057a4d07e service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:44.718607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4d514-557c-4da8-8b28-d3e057a4d07e service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:44.746410 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1be4bd-dbdf-47a2-a15e-77bef2103cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:44.752026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1be4bd-dbdf-47a2-a15e-77bef2103cdd service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:44.752569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1be4bd-dbdf-47a2-a15e-77bef2103cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:44.753018 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1be4bd-dbdf-47a2-a15e-77bef2103cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:44.757488 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 799/1598] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:44 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:44.878572 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1be4bd-dbdf-47a2-a15e-77bef2103cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:44.880385 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1be4bd-dbdf-47a2-a15e-77bef2103cdd service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:44.892322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 800/1599] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:44 2021] GET /identity/v3/auth/tokens => generated 3377 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:31:45.146088 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1217f-52e6-455c-b86e-da6895e69ffa service glance] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:45.158854 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1217f-52e6-455c-b86e-da6895e69ffa service glance] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:45.167163 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9384b7-eeff-45eb-816a-132ec74250e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:45.177797 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9384b7-eeff-45eb-816a-132ec74250e1 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:45.179830 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9384b7-eeff-45eb-816a-132ec74250e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:45.180282 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9384b7-eeff-45eb-816a-132ec74250e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:45.265744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9384b7-eeff-45eb-816a-132ec74250e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:45.267296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9384b7-eeff-45eb-816a-132ec74250e1 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:45.286883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926c3b-0e12-42a9-8865-ea3233b904d7 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:45.287538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926c3b-0e12-42a9-8865-ea3233b904d7 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:45.288228 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926c3b-0e12-42a9-8865-ea3233b904d7 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:45.291882 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 801/1600] 10.222.0.50 () {54 vars in 912 bytes} [Tue Nov 16 00:31:45 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:31:45.295280 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 800/1601] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:45 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:45.340500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a9f06-a1b7-46b6-9ac2-fcaf5957539e None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:45.340814 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a9f06-a1b7-46b6-9ac2-fcaf5957539e None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:45.341095 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a9f06-a1b7-46b6-9ac2-fcaf5957539e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:45.447356 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-e93a9f06-a1b7-46b6-9ac2-fcaf5957539e None None] MFA Rules not processed for user `7893cca0610b40abb9c45414f3690df0`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:45.448785 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e93a9f06-a1b7-46b6-9ac2-fcaf5957539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:45.576289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 802/1602] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Nov 16 00:31:45 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:31:45.592429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9384b7-eeff-45eb-816a-132ec74250e1 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:45.607549 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9384b7-eeff-45eb-816a-132ec74250e1 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:45.616508 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4fb80-a2be-4bd8-8a33-0b19d50003c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:45.620203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4fb80-a2be-4bd8-8a33-0b19d50003c5 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:45.620497 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4fb80-a2be-4bd8-8a33-0b19d50003c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:45.620785 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4fb80-a2be-4bd8-8a33-0b19d50003c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:45.632807 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a9f06-a1b7-46b6-9ac2-fcaf5957539e None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:45.642901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4fb80-a2be-4bd8-8a33-0b19d50003c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:45.644333 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4fb80-a2be-4bd8-8a33-0b19d50003c5 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:45.645560 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a9f06-a1b7-46b6-9ac2-fcaf5957539e None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:45.650695 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb9602-1fad-4819-8d66-3477e3ec12b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:45.651457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb9602-1fad-4819-8d66-3477e3ec12b5 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:45.651763 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb9602-1fad-4819-8d66-3477e3ec12b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:45.652685 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb9602-1fad-4819-8d66-3477e3ec12b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:45.658807 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 801/1603] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:45 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:45.659695 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4fb80-a2be-4bd8-8a33-0b19d50003c5 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:45.689874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4fb80-a2be-4bd8-8a33-0b19d50003c5 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:45.708554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648063c-0e18-4aa4-baeb-f5f20cf8b50d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:45.713629 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648063c-0e18-4aa4-baeb-f5f20cf8b50d service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:45.714529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648063c-0e18-4aa4-baeb-f5f20cf8b50d service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:45.715779 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648063c-0e18-4aa4-baeb-f5f20cf8b50d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:45.773262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb9602-1fad-4819-8d66-3477e3ec12b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:45.779271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb9602-1fad-4819-8d66-3477e3ec12b5 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:45.796321 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 803/1604] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:45 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:45.834030 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648063c-0e18-4aa4-baeb-f5f20cf8b50d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:45.837174 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648063c-0e18-4aa4-baeb-f5f20cf8b50d service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:45.854818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 802/1605] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:45 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:46.417915 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d3442-d359-466d-bce1-7d20818b8ca6 None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:46.418684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d3442-d359-466d-bce1-7d20818b8ca6 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:46.419437 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d3442-d359-466d-bce1-7d20818b8ca6 None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:46.423809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 804/1606] 10.222.0.50 () {54 vars in 912 bytes} [Tue Nov 16 00:31:46 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:31:46.432688 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353532e-cdc9-4fe2-9efd-0dd396eadf5e None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:46.433150 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353532e-cdc9-4fe2-9efd-0dd396eadf5e None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:46.433493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353532e-cdc9-4fe2-9efd-0dd396eadf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:46.455102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-f353532e-cdc9-4fe2-9efd-0dd396eadf5e None None] MFA Rules not processed for user `7893cca0610b40abb9c45414f3690df0`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:46.456592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-f353532e-cdc9-4fe2-9efd-0dd396eadf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:46.469845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 803/1607] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Nov 16 00:31:46 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:31:46.524682 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d3442-d359-466d-bce1-7d20818b8ca6 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:46.540433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d3442-d359-466d-bce1-7d20818b8ca6 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:46.549669 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea8078-ff60-4b9f-83fd-d3ce15b601ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:46.550607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea8078-ff60-4b9f-83fd-d3ce15b601ec service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:46.551021 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea8078-ff60-4b9f-83fd-d3ce15b601ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:46.551307 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea8078-ff60-4b9f-83fd-d3ce15b601ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:46.577106 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea8078-ff60-4b9f-83fd-d3ce15b601ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:46.579151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea8078-ff60-4b9f-83fd-d3ce15b601ec service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:46.607135 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 805/1608] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:46 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:46.960396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259451fe-5df1-4ad4-a5d7-6310f97b0b2c None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:46.961932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259451fe-5df1-4ad4-a5d7-6310f97b0b2c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:46.962382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259451fe-5df1-4ad4-a5d7-6310f97b0b2c None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:46.965416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 804/1609] 10.222.0.50 () {54 vars in 960 bytes} [Tue Nov 16 00:31:46 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:31:46.973091 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98268a91-d53a-4dc8-8e04-ee87667c45e8 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:46.973693 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98268a91-d53a-4dc8-8e04-ee87667c45e8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:46.974698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98268a91-d53a-4dc8-8e04-ee87667c45e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:47.010747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-98268a91-d53a-4dc8-8e04-ee87667c45e8 None None] MFA Rules not processed for user `678965f2159e4c33bf2465058f69ff02`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:47.016247 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-98268a91-d53a-4dc8-8e04-ee87667c45e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:47.218515 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 806/1610] 10.222.0.50 () {58 vars in 1057 bytes} [Tue Nov 16 00:31:46 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:47.219771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259451fe-5df1-4ad4-a5d7-6310f97b0b2c None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:47.252208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259451fe-5df1-4ad4-a5d7-6310f97b0b2c None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:47.270772 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ddc07-f10e-4c39-add8-67fa00386ae7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:47.274811 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ddc07-f10e-4c39-add8-67fa00386ae7 service placement] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:47.279950 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ddc07-f10e-4c39-add8-67fa00386ae7 service placement] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:47.281978 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ddc07-f10e-4c39-add8-67fa00386ae7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:47.289503 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-dc1ddc07-f10e-4c39-add8-67fa00386ae7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:47.341192 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ddc07-f10e-4c39-add8-67fa00386ae7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:47.347721 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ddc07-f10e-4c39-add8-67fa00386ae7 service placement] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:47.395238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 805/1611] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:47 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:50.919253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e5a9-55e7-40e9-9f4a-2a2291326817 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:50.920489 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e5a9-55e7-40e9-9f4a-2a2291326817 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:50.921124 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e5a9-55e7-40e9-9f4a-2a2291326817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:50.962189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-5a61e5a9-55e7-40e9-9f4a-2a2291326817 None None] MFA Rules not processed for user `8e7b025b18e74bb2b8094853d9ac2c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:50.963747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-5a61e5a9-55e7-40e9-9f4a-2a2291326817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:51.107746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 807/1612] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:50 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:51.118560 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799633f-7b9c-40d3-ac6d-3b563e95b9d8 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:51.119254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799633f-7b9c-40d3-ac6d-3b563e95b9d8 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:51.119254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799633f-7b9c-40d3-ac6d-3b563e95b9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:51.151233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-a799633f-7b9c-40d3-ac6d-3b563e95b9d8 None None] MFA Rules not processed for user `8e7b025b18e74bb2b8094853d9ac2c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:51.152813 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a799633f-7b9c-40d3-ac6d-3b563e95b9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:51.163131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 806/1613] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:51 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:51.181949 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61e5a9-55e7-40e9-9f4a-2a2291326817 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:51.203459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61e5a9-55e7-40e9-9f4a-2a2291326817 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:51.218430 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d190e0-47e0-4182-91d8-5bf97a3d98ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:51.219376 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d190e0-47e0-4182-91d8-5bf97a3d98ed service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:51.221954 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d190e0-47e0-4182-91d8-5bf97a3d98ed service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:51.222320 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d190e0-47e0-4182-91d8-5bf97a3d98ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:51.233702 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d190e0-47e0-4182-91d8-5bf97a3d98ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:51.235547 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d190e0-47e0-4182-91d8-5bf97a3d98ed service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:51.249424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 808/1614] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:51 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:51.467016 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d146cd-668f-4953-b2a4-ce6d106c670d None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:51.467786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d146cd-668f-4953-b2a4-ce6d106c670d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:51.468279 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d146cd-668f-4953-b2a4-ce6d106c670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:51.504021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-39d146cd-668f-4953-b2a4-ce6d106c670d None None] MFA Rules not processed for user `a5d8ae82c9644a629b96d5edfa11682f`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:51.505485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-39d146cd-668f-4953-b2a4-ce6d106c670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:51.595164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 807/1615] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:51 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:31:51.607237 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d190e0-47e0-4182-91d8-5bf97a3d98ed service nova] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:51.622635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d190e0-47e0-4182-91d8-5bf97a3d98ed service nova] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:51.630663 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce52d5-d761-48d5-b7cb-96e7b22947e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:51.631364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce52d5-d761-48d5-b7cb-96e7b22947e9 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:51.631655 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce52d5-d761-48d5-b7cb-96e7b22947e9 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:51.631937 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce52d5-d761-48d5-b7cb-96e7b22947e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:51.641961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce52d5-d761-48d5-b7cb-96e7b22947e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:51.643941 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce52d5-d761-48d5-b7cb-96e7b22947e9 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:51.661174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 809/1616] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:51 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:31:52.127180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710e72a-b84b-4c22-8d23-28a12119cc77 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:52.128281 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710e72a-b84b-4c22-8d23-28a12119cc77 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:52.128932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710e72a-b84b-4c22-8d23-28a12119cc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:52.149071 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-f710e72a-b84b-4c22-8d23-28a12119cc77 None None] MFA Rules not processed for user `8e7b025b18e74bb2b8094853d9ac2c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:52.150306 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-f710e72a-b84b-4c22-8d23-28a12119cc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:52.157953 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 808/1617] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:52 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:54.043775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8016e0-347c-4a11-b7b1-25a03d771493 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:54.044320 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8016e0-347c-4a11-b7b1-25a03d771493 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:54.044613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8016e0-347c-4a11-b7b1-25a03d771493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:54.072022 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-aa8016e0-347c-4a11-b7b1-25a03d771493 None None] MFA Rules not processed for user `a5d8ae82c9644a629b96d5edfa11682f`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:54.074345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-aa8016e0-347c-4a11-b7b1-25a03d771493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:54.085151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 810/1618] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:54 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:54.215717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710e72a-b84b-4c22-8d23-28a12119cc77 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:54.329388 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710e72a-b84b-4c22-8d23-28a12119cc77 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:54.335469 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555d143-6470-4fce-a323-8f3b3362a896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:54.337522 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555d143-6470-4fce-a323-8f3b3362a896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:54.338003 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555d143-6470-4fce-a323-8f3b3362a896 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:54.338440 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555d143-6470-4fce-a323-8f3b3362a896 admin admin] PATH_INFO: `/v3/users/0d309e912d91408ca402f8ea3093a45d` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:54.339908 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555d143-6470-4fce-a323-8f3b3362a896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d309e912d91408ca402f8ea3093a45d)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:54.342128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555d143-6470-4fce-a323-8f3b3362a896 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:54.434745 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3555d143-6470-4fce-a323-8f3b3362a896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d309e912d91408ca402f8ea3093a45d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:54.446942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3555d143-6470-4fce-a323-8f3b3362a896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d309e912d91408ca402f8ea3093a45d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:54.464013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3555d143-6470-4fce-a323-8f3b3362a896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d309e912d91408ca402f8ea3093a45d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:54.514510 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3555d143-6470-4fce-a323-8f3b3362a896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d309e912d91408ca402f8ea3093a45d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:54.515824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3555d143-6470-4fce-a323-8f3b3362a896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d309e912d91408ca402f8ea3093a45d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:54.548948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 809/1619] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:31:54 2021] DELETE /identity/v3/users/0d309e912d91408ca402f8ea3093a45d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:54.553146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85597a-520c-4482-82a5-084923296677 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:54.553619 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85597a-520c-4482-82a5-084923296677 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:54.553996 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85597a-520c-4482-82a5-084923296677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:54.610225 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7b85597a-520c-4482-82a5-084923296677 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:54.616855 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7b85597a-520c-4482-82a5-084923296677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:54.825595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 811/1620] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:54.912586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555d143-6470-4fce-a323-8f3b3362a896 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:54.915160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3555d143-6470-4fce-a323-8f3b3362a896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:55.184646 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555d143-6470-4fce-a323-8f3b3362a896 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:55.215974 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84043d4-804a-4fa9-9c92-7eea5c718297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:55.219087 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84043d4-804a-4fa9-9c92-7eea5c718297 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:55.224973 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84043d4-804a-4fa9-9c92-7eea5c718297 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:55.225503 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84043d4-804a-4fa9-9c92-7eea5c718297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:55.245708 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84043d4-804a-4fa9-9c92-7eea5c718297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:55.249130 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84043d4-804a-4fa9-9c92-7eea5c718297 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:55.267625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 810/1621] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:55.486285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11228e-99fd-4f81-84a7-450521c5c4b4 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:55.487380 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11228e-99fd-4f81-84a7-450521c5c4b4 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:55.487706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11228e-99fd-4f81-84a7-450521c5c4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:55.548562 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-9f11228e-99fd-4f81-84a7-450521c5c4b4 None None] MFA Rules not processed for user `f6af4c462c6347ff8abbcc8770874b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:55.550041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9f11228e-99fd-4f81-84a7-450521c5c4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:55.711751 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 812/1622] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Nov 16 00:31:55 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:56.090601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84043d4-804a-4fa9-9c92-7eea5c718297 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:56.092320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-f84043d4-804a-4fa9-9c92-7eea5c718297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:56.384819 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84043d4-804a-4fa9-9c92-7eea5c718297 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:56.402349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f05b8c-a52a-47b9-a469-ab47fc816924 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac32c6730654a889472a3bad95374bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:56.403305 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f05b8c-a52a-47b9-a469-ab47fc816924 service swift] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:56.403838 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f05b8c-a52a-47b9-a469-ab47fc816924 service swift] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:56.404568 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f05b8c-a52a-47b9-a469-ab47fc816924 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:56.426229 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f05b8c-a52a-47b9-a469-ab47fc816924 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:56.428385 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f05b8c-a52a-47b9-a469-ab47fc816924 service swift] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:56.452144 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 811/1623] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Nov 16 00:31:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 00:31:56.475266 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11228e-99fd-4f81-84a7-450521c5c4b4 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:56.478025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9f11228e-99fd-4f81-84a7-450521c5c4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:56.531770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11228e-99fd-4f81-84a7-450521c5c4b4 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:56.552216 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:56.562938 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:56.563607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:56.565779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] PATH_INFO: `/v3/projects/bc9e9f6b72d949e5bd4f7233535cf749` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:56.575889 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9e9f6b72d949e5bd4f7233535cf749)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:56.578830 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:56.715875 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9e9f6b72d949e5bd4f7233535cf749', 'request_id': 'req-58aba5aa-0502-4d91-8deb-6cf91b06d808'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:56.726383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9e9f6b72d949e5bd4f7233535cf749', 'request_id': 'req-58aba5aa-0502-4d91-8deb-6cf91b06d808'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:56.738696 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9e9f6b72d949e5bd4f7233535cf749', 'request_id': 'req-58aba5aa-0502-4d91-8deb-6cf91b06d808'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:56.777615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] The token cache is being invalidate because project bc9e9f6b72d949e5bd4f7233535cf749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:31:56.778396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:56.780236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:56.783544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 813/1624] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:31:56 2021] DELETE /identity/v3/projects/bc9e9f6b72d949e5bd4f7233535cf749 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:56.788696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f05b8c-a52a-47b9-a469-ab47fc816924 service swift] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:56.802560 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f05b8c-a52a-47b9-a469-ab47fc816924 service swift] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:56.902515 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319d4ad-297c-480a-ac5d-90e388cf3ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:56.903560 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d4ad-297c-480a-ac5d-90e388cf3ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:56.903938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d4ad-297c-480a-ac5d-90e388cf3ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:56.904473 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d4ad-297c-480a-ac5d-90e388cf3ed2 admin admin] PATH_INFO: `/v3/users/e8576f3cc672435bacb8828a5f8c0ed3` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:56.905920 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319d4ad-297c-480a-ac5d-90e388cf3ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8576f3cc672435bacb8828a5f8c0ed3)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:56.908038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319d4ad-297c-480a-ac5d-90e388cf3ed2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:56.965703 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-f319d4ad-297c-480a-ac5d-90e388cf3ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8576f3cc672435bacb8828a5f8c0ed3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:56.979783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-f319d4ad-297c-480a-ac5d-90e388cf3ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8576f3cc672435bacb8828a5f8c0ed3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:56.980663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-f319d4ad-297c-480a-ac5d-90e388cf3ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8576f3cc672435bacb8828a5f8c0ed3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:56.997867 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-f319d4ad-297c-480a-ac5d-90e388cf3ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8576f3cc672435bacb8828a5f8c0ed3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:56.998759 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-f319d4ad-297c-480a-ac5d-90e388cf3ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8576f3cc672435bacb8828a5f8c0ed3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:57.015909 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 812/1625] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:31:56 2021] DELETE /identity/v3/users/e8576f3cc672435bacb8828a5f8c0ed3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:57.517267 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:57.520242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:57.567965 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aba5aa-0502-4d91-8deb-6cf91b06d808 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:57.745913 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2d717-3827-4bc0-ac7a-c331535051e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:57.746953 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2d717-3827-4bc0-ac7a-c331535051e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:57.747122 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2d717-3827-4bc0-ac7a-c331535051e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:57.747428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2d717-3827-4bc0-ac7a-c331535051e2 admin admin] PATH_INFO: `/v3/projects/91366ea673844e1d8bd0cddd91a913ac` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:57.748682 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2d717-3827-4bc0-ac7a-c331535051e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91366ea673844e1d8bd0cddd91a913ac)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:57.750572 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2d717-3827-4bc0-ac7a-c331535051e2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:57.824944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-94f2d717-3827-4bc0-ac7a-c331535051e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91366ea673844e1d8bd0cddd91a913ac', 'request_id': 'req-94f2d717-3827-4bc0-ac7a-c331535051e2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:57.831307 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-94f2d717-3827-4bc0-ac7a-c331535051e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91366ea673844e1d8bd0cddd91a913ac', 'request_id': 'req-94f2d717-3827-4bc0-ac7a-c331535051e2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:57.846128 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-94f2d717-3827-4bc0-ac7a-c331535051e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91366ea673844e1d8bd0cddd91a913ac', 'request_id': 'req-94f2d717-3827-4bc0-ac7a-c331535051e2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:57.859346 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-94f2d717-3827-4bc0-ac7a-c331535051e2 admin admin] The token cache is being invalidate because project 91366ea673844e1d8bd0cddd91a913ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:31:57.859667 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-94f2d717-3827-4bc0-ac7a-c331535051e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:57.860337 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-94f2d717-3827-4bc0-ac7a-c331535051e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:31:57.861980 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 814/1626] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:31:57 2021] DELETE /identity/v3/projects/91366ea673844e1d8bd0cddd91a913ac => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:57.871234 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbe758-6d0e-49ce-8258-fa0e980b0177 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:57.871756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbe758-6d0e-49ce-8258-fa0e980b0177 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:57.871960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbe758-6d0e-49ce-8258-fa0e980b0177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:57.890237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-b0dbe758-6d0e-49ce-8258-fa0e980b0177 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:57.891604 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b0dbe758-6d0e-49ce-8258-fa0e980b0177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:57.954344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 813/1627] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:58.000660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63eb37-54e2-4e7e-824d-d9625b596efe None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.000947 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63eb37-54e2-4e7e-824d-d9625b596efe None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.001257 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63eb37-54e2-4e7e-824d-d9625b596efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.020783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7f63eb37-54e2-4e7e-824d-d9625b596efe None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:58.021998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7f63eb37-54e2-4e7e-824d-d9625b596efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:58.031399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 815/1628] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:58.035674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbe758-6d0e-49ce-8258-fa0e980b0177 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:58.045840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbe758-6d0e-49ce-8258-fa0e980b0177 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:58.051566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc572a1-c466-4beb-bc12-ce5584ae0049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:58.052619 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc572a1-c466-4beb-bc12-ce5584ae0049 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.053060 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc572a1-c466-4beb-bc12-ce5584ae0049 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.053488 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc572a1-c466-4beb-bc12-ce5584ae0049 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.054245 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc572a1-c466-4beb-bc12-ce5584ae0049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:31:58.054692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc572a1-c466-4beb-bc12-ce5584ae0049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:58.056490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc572a1-c466-4beb-bc12-ce5584ae0049 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:58.069135 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 814/1629] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:31:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:31:58.074005 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63eb37-54e2-4e7e-824d-d9625b596efe None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:58.083671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63eb37-54e2-4e7e-824d-d9625b596efe None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:58.089684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af95d7-25eb-4869-80d3-9caaa07efecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:58.090367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af95d7-25eb-4869-80d3-9caaa07efecd admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.090664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af95d7-25eb-4869-80d3-9caaa07efecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.091051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af95d7-25eb-4869-80d3-9caaa07efecd admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.091734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af95d7-25eb-4869-80d3-9caaa07efecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:58.093966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af95d7-25eb-4869-80d3-9caaa07efecd admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:58.121296 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 816/1630] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:31:58 2021] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:31:58.125524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc572a1-c466-4beb-bc12-ce5584ae0049 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:58.136707 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc572a1-c466-4beb-bc12-ce5584ae0049 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:58.196737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c82ff-d458-4e15-91ef-363fd586c561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:58.197428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c82ff-d458-4e15-91ef-363fd586c561 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.197716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c82ff-d458-4e15-91ef-363fd586c561 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.197994 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c82ff-d458-4e15-91ef-363fd586c561 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.198706 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c82ff-d458-4e15-91ef-363fd586c561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:58.200691 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c82ff-d458-4e15-91ef-363fd586c561 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:58.222011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 815/1631] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:31:58 2021] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:58.226482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af95d7-25eb-4869-80d3-9caaa07efecd admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:58.236918 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af95d7-25eb-4869-80d3-9caaa07efecd admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:58.242458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2863f-9f46-4cbd-9e1a-70c35bd46c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:58.243175 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2863f-9f46-4cbd-9e1a-70c35bd46c5f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.243463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2863f-9f46-4cbd-9e1a-70c35bd46c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.243746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2863f-9f46-4cbd-9e1a-70c35bd46c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.244481 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2863f-9f46-4cbd-9e1a-70c35bd46c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:58.246099 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2863f-9f46-4cbd-9e1a-70c35bd46c5f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:58.258355 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 817/1632] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:58 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:31:58.262463 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c82ff-d458-4e15-91ef-363fd586c561 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:58.274890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c82ff-d458-4e15-91ef-363fd586c561 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:58.280971 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb18c1-b33d-4ddb-860e-5a0ba4e6ccee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:58.281734 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb18c1-b33d-4ddb-860e-5a0ba4e6ccee admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.282114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb18c1-b33d-4ddb-860e-5a0ba4e6ccee admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.282595 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb18c1-b33d-4ddb-860e-5a0ba4e6ccee admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.283491 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb18c1-b33d-4ddb-860e-5a0ba4e6ccee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:58.285195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb18c1-b33d-4ddb-860e-5a0ba4e6ccee admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:58.296668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 816/1633] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:58 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:58.300875 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2863f-9f46-4cbd-9e1a-70c35bd46c5f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:58.311551 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2863f-9f46-4cbd-9e1a-70c35bd46c5f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:58.316446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8c239-e9fa-416f-863d-be61979668ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:58.317290 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c239-e9fa-416f-863d-be61979668ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.317571 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c239-e9fa-416f-863d-be61979668ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.317841 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c239-e9fa-416f-863d-be61979668ee admin admin] PATH_INFO: `/v3/projects/9352ad96907543c1bd729cdf86ecc0ea/users/d42cc19207174c27b6c45a360cff37a6/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.334789 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8c239-e9fa-416f-863d-be61979668ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9352ad96907543c1bd729cdf86ecc0ea, user_id=d42cc19207174c27b6c45a360cff37a6, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:58.338435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8c239-e9fa-416f-863d-be61979668ee admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:58.353457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 818/1634] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:58 2021] PUT /identity/v3/projects/9352ad96907543c1bd729cdf86ecc0ea/users/d42cc19207174c27b6c45a360cff37a6/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:31:58.363775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e90f58-dc30-44d6-beb7-44f2cd7bf2f5 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.364266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e90f58-dc30-44d6-beb7-44f2cd7bf2f5 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.364631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e90f58-dc30-44d6-beb7-44f2cd7bf2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.393044 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-70e90f58-dc30-44d6-beb7-44f2cd7bf2f5 None None] MFA Rules not processed for user `d42cc19207174c27b6c45a360cff37a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:58.394277 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-70e90f58-dc30-44d6-beb7-44f2cd7bf2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:58.462109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 817/1635] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:58 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:31:58.466673 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8c239-e9fa-416f-863d-be61979668ee admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:58.538690 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8c239-e9fa-416f-863d-be61979668ee admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:58.545036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3724e-6519-40e3-874f-fb6370b35ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:58.545893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3724e-6519-40e3-874f-fb6370b35ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.546275 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3724e-6519-40e3-874f-fb6370b35ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.546651 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3724e-6519-40e3-874f-fb6370b35ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.547501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3724e-6519-40e3-874f-fb6370b35ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:58.549881 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3724e-6519-40e3-874f-fb6370b35ec3 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:58.584639 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 819/1636] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:31:58 2021] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:31:58.589051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e90f58-dc30-44d6-beb7-44f2cd7bf2f5 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:58.604405 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e90f58-dc30-44d6-beb7-44f2cd7bf2f5 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:58.692956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b3104-3b91-4dec-8212-1efeaf47dc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:58.693643 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3104-3b91-4dec-8212-1efeaf47dc48 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.693936 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3104-3b91-4dec-8212-1efeaf47dc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.694223 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b3104-3b91-4dec-8212-1efeaf47dc48 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.695581 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b3104-3b91-4dec-8212-1efeaf47dc48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:58.697471 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b3104-3b91-4dec-8212-1efeaf47dc48 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:58.716885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 818/1637] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:31:58 2021] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:31:58.720985 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3724e-6519-40e3-874f-fb6370b35ec3 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:58.732534 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3724e-6519-40e3-874f-fb6370b35ec3 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:58.737163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd33254-9bae-4b04-861a-44b35baad0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:58.737827 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd33254-9bae-4b04-861a-44b35baad0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.738118 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd33254-9bae-4b04-861a-44b35baad0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.738398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd33254-9bae-4b04-861a-44b35baad0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.739182 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd33254-9bae-4b04-861a-44b35baad0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:58.740801 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd33254-9bae-4b04-861a-44b35baad0e6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:58.753448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 820/1638] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:58.756013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b3104-3b91-4dec-8212-1efeaf47dc48 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:58.766485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b3104-3b91-4dec-8212-1efeaf47dc48 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:58.771463 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d1fcd-9e78-4832-8bd8-e53a3ddd7baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:58.772982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d1fcd-9e78-4832-8bd8-e53a3ddd7baf admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.772982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d1fcd-9e78-4832-8bd8-e53a3ddd7baf admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.773186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d1fcd-9e78-4832-8bd8-e53a3ddd7baf admin admin] PATH_INFO: `/v3/projects/63b55251eeee4329bda8366b673986a9/users/0695bda3024c402ea0284b3aaf330451/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.787641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d1fcd-9e78-4832-8bd8-e53a3ddd7baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b55251eeee4329bda8366b673986a9, user_id=0695bda3024c402ea0284b3aaf330451, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:58.791125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d1fcd-9e78-4832-8bd8-e53a3ddd7baf admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:58.806265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 819/1639] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:58 2021] PUT /identity/v3/projects/63b55251eeee4329bda8366b673986a9/users/0695bda3024c402ea0284b3aaf330451/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:58.810039 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd33254-9bae-4b04-861a-44b35baad0e6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:58.820342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd33254-9bae-4b04-861a-44b35baad0e6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:58.885393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ea0ba-fed3-4e44-96f3-118a72880a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:58.886071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ea0ba-fed3-4e44-96f3-118a72880a6e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.886352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ea0ba-fed3-4e44-96f3-118a72880a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.886629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ea0ba-fed3-4e44-96f3-118a72880a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.887403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ea0ba-fed3-4e44-96f3-118a72880a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:58.889061 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ea0ba-fed3-4e44-96f3-118a72880a6e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:58.903660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 821/1640] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:31:58 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:31:58.904859 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d1fcd-9e78-4832-8bd8-e53a3ddd7baf admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:58.916000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d1fcd-9e78-4832-8bd8-e53a3ddd7baf admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:58.921119 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae24839-d81a-48b1-adee-243d5a17e7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:58.922027 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae24839-d81a-48b1-adee-243d5a17e7d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.922308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae24839-d81a-48b1-adee-243d5a17e7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.922585 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae24839-d81a-48b1-adee-243d5a17e7d7 admin admin] PATH_INFO: `/v3/projects/63b55251eeee4329bda8366b673986a9/users/0695bda3024c402ea0284b3aaf330451/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.928542 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae24839-d81a-48b1-adee-243d5a17e7d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b55251eeee4329bda8366b673986a9, user_id=0695bda3024c402ea0284b3aaf330451, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:58.932388 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae24839-d81a-48b1-adee-243d5a17e7d7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:58.942975 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 820/1641] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:31:58 2021] PUT /identity/v3/projects/63b55251eeee4329bda8366b673986a9/users/0695bda3024c402ea0284b3aaf330451/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:31:58.953455 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca1ca-a58c-477c-8371-9de0f3646d6b None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:58.953757 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca1ca-a58c-477c-8371-9de0f3646d6b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:58.954044 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca1ca-a58c-477c-8371-9de0f3646d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:58.983412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7b1ca1ca-a58c-477c-8371-9de0f3646d6b None None] MFA Rules not processed for user `0695bda3024c402ea0284b3aaf330451`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:31:58.984661 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7b1ca1ca-a58c-477c-8371-9de0f3646d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:59.055239 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 822/1642] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:31:58 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:31:59.064886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae24839-d81a-48b1-adee-243d5a17e7d7 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:59.066613 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-4ae24839-d81a-48b1-adee-243d5a17e7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:31:59.130629 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae24839-d81a-48b1-adee-243d5a17e7d7 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:59.136078 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57417a89-206d-4da6-a599-b5634bc338b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:59.136731 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57417a89-206d-4da6-a599-b5634bc338b5 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:59.137016 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57417a89-206d-4da6-a599-b5634bc338b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:59.137296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57417a89-206d-4da6-a599-b5634bc338b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:59.149579 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57417a89-206d-4da6-a599-b5634bc338b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:59.151126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57417a89-206d-4da6-a599-b5634bc338b5 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:59.160814 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 821/1643] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:59 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:31:59.253811 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ca1ca-a58c-477c-8371-9de0f3646d6b None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:31:59.263146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ca1ca-a58c-477c-8371-9de0f3646d6b None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:31:59.267103 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817a3ec-444d-4bae-91dd-8287ae51c9ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:31:59.267748 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817a3ec-444d-4bae-91dd-8287ae51c9ed service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:31:59.268035 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817a3ec-444d-4bae-91dd-8287ae51c9ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:31:59.268316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817a3ec-444d-4bae-91dd-8287ae51c9ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:31:59.323855 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817a3ec-444d-4bae-91dd-8287ae51c9ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:31:59.325361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817a3ec-444d-4bae-91dd-8287ae51c9ed service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:31:59.338644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 823/1644] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:31:59 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:01.770615 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57417a89-206d-4da6-a599-b5634bc338b5 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:01.772883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-57417a89-206d-4da6-a599-b5634bc338b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:01.843404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57417a89-206d-4da6-a599-b5634bc338b5 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:01.848692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718594d-1163-4a68-a2ab-7e7d224df809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:01.850174 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718594d-1163-4a68-a2ab-7e7d224df809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:01.850610 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718594d-1163-4a68-a2ab-7e7d224df809 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:01.851853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718594d-1163-4a68-a2ab-7e7d224df809 admin admin] PATH_INFO: `/v3/users/229a204d36f64daa86135fc5104018c5` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:01.853611 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718594d-1163-4a68-a2ab-7e7d224df809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=229a204d36f64daa86135fc5104018c5)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:01.856172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718594d-1163-4a68-a2ab-7e7d224df809 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:01.906144 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-6718594d-1163-4a68-a2ab-7e7d224df809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229a204d36f64daa86135fc5104018c5'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:01.914135 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-6718594d-1163-4a68-a2ab-7e7d224df809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229a204d36f64daa86135fc5104018c5'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:01.916064 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-6718594d-1163-4a68-a2ab-7e7d224df809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229a204d36f64daa86135fc5104018c5'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:01.933192 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-6718594d-1163-4a68-a2ab-7e7d224df809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229a204d36f64daa86135fc5104018c5'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:01.933936 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-6718594d-1163-4a68-a2ab-7e7d224df809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229a204d36f64daa86135fc5104018c5'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:01.972383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 822/1645] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:01 2021] DELETE /identity/v3/users/229a204d36f64daa86135fc5104018c5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:01.975289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72e5e-6d8b-44a2-ab3f-843eb9bf5881 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:01.975783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72e5e-6d8b-44a2-ab3f-843eb9bf5881 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:01.976466 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72e5e-6d8b-44a2-ab3f-843eb9bf5881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:01.996206 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-16a72e5e-6d8b-44a2-ab3f-843eb9bf5881 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:01.997551 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-16a72e5e-6d8b-44a2-ab3f-843eb9bf5881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:02.068275 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 824/1646] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:02.078598 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718594d-1163-4a68-a2ab-7e7d224df809 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:02.080230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6718594d-1163-4a68-a2ab-7e7d224df809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:02.164875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718594d-1163-4a68-a2ab-7e7d224df809 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:02.177104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6749adf-f1ac-4675-9cfc-bd31b59f7e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:02.178729 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6749adf-f1ac-4675-9cfc-bd31b59f7e8b service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:02.181327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6749adf-f1ac-4675-9cfc-bd31b59f7e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:02.181670 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6749adf-f1ac-4675-9cfc-bd31b59f7e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:02.194055 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6749adf-f1ac-4675-9cfc-bd31b59f7e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:02.195596 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6749adf-f1ac-4675-9cfc-bd31b59f7e8b service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:02.210762 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 823/1647] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:02.787392 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72e5e-6d8b-44a2-ab3f-843eb9bf5881 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:02.789087 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-16a72e5e-6d8b-44a2-ab3f-843eb9bf5881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:02.819468 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72e5e-6d8b-44a2-ab3f-843eb9bf5881 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:02.828529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:02.829415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:02.829706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:02.829984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84 admin admin] PATH_INFO: `/v3/projects/3aedbd85cc7044dea9fc2a70f7c32773` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:02.831946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aedbd85cc7044dea9fc2a70f7c32773)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:02.833894 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:02.888882 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aedbd85cc7044dea9fc2a70f7c32773', 'request_id': 'req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:02.895828 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aedbd85cc7044dea9fc2a70f7c32773', 'request_id': 'req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:02.904113 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aedbd85cc7044dea9fc2a70f7c32773', 'request_id': 'req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:02.934291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84 admin admin] The token cache is being invalidate because project 3aedbd85cc7044dea9fc2a70f7c32773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:02.934716 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:02.935657 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-70ac0b23-9d45-4cdc-a554-edfcbb19ab84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:02.937810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 825/1648] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:02 2021] DELETE /identity/v3/projects/3aedbd85cc7044dea9fc2a70f7c32773 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:02.943906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402b6e9-9d5f-4158-8186-f6ee8c4481eb None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:02.944447 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402b6e9-9d5f-4158-8186-f6ee8c4481eb None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:02.944447 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402b6e9-9d5f-4158-8186-f6ee8c4481eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:02.966009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-1402b6e9-9d5f-4158-8186-f6ee8c4481eb None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:02.967278 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-1402b6e9-9d5f-4158-8186-f6ee8c4481eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:03.046984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 824/1649] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:03.051286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccad80-a085-4c86-bc18-9352115357f9 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:03.052243 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccad80-a085-4c86-bc18-9352115357f9 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:03.052679 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccad80-a085-4c86-bc18-9352115357f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:03.072630 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-3bccad80-a085-4c86-bc18-9352115357f9 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:03.073748 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-3bccad80-a085-4c86-bc18-9352115357f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:03.088806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 826/1650] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:03.092964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402b6e9-9d5f-4158-8186-f6ee8c4481eb None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:03.103643 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402b6e9-9d5f-4158-8186-f6ee8c4481eb None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:03.108376 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcd396-4251-45b7-bc74-ff1395f64db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:03.109042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd396-4251-45b7-bc74-ff1395f64db6 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:03.109333 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd396-4251-45b7-bc74-ff1395f64db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:03.109621 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd396-4251-45b7-bc74-ff1395f64db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:03.110358 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcd396-4251-45b7-bc74-ff1395f64db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:32:03.110677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcd396-4251-45b7-bc74-ff1395f64db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:03.113148 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcd396-4251-45b7-bc74-ff1395f64db6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:03.131493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 825/1651] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:32:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:32:03.142154 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccad80-a085-4c86-bc18-9352115357f9 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:03.155099 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccad80-a085-4c86-bc18-9352115357f9 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:03.161485 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca41be-c87c-459b-a204-03ae1ad43ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:03.162179 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca41be-c87c-459b-a204-03ae1ad43ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:03.162476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca41be-c87c-459b-a204-03ae1ad43ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:03.162967 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca41be-c87c-459b-a204-03ae1ad43ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:03.172890 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca41be-c87c-459b-a204-03ae1ad43ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:03.175310 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca41be-c87c-459b-a204-03ae1ad43ac7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:03.203251 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 827/1652] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:03 2021] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:03.207230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcd396-4251-45b7-bc74-ff1395f64db6 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:03.217554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcd396-4251-45b7-bc74-ff1395f64db6 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:03.298298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037adae1-5734-48cc-a389-fb466abc8166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:03.300015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037adae1-5734-48cc-a389-fb466abc8166 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:03.300392 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037adae1-5734-48cc-a389-fb466abc8166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:03.301048 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037adae1-5734-48cc-a389-fb466abc8166 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:03.301555 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037adae1-5734-48cc-a389-fb466abc8166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:03.303764 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037adae1-5734-48cc-a389-fb466abc8166 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:03.330991 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 826/1653] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:03 2021] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:32:03.336736 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca41be-c87c-459b-a204-03ae1ad43ac7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:03.355742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca41be-c87c-459b-a204-03ae1ad43ac7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:03.374040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa201d-7e17-437f-a9e5-6a9e657a0957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:03.374914 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa201d-7e17-437f-a9e5-6a9e657a0957 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:03.375771 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa201d-7e17-437f-a9e5-6a9e657a0957 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:03.376806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa201d-7e17-437f-a9e5-6a9e657a0957 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:03.378463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa201d-7e17-437f-a9e5-6a9e657a0957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:03.394586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037adae1-5734-48cc-a389-fb466abc8166 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:03.396787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-037adae1-5734-48cc-a389-fb466abc8166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:03.407620 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa201d-7e17-437f-a9e5-6a9e657a0957 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:03.443340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037adae1-5734-48cc-a389-fb466abc8166 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:03.459679 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 828/1654] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:03 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:03.464878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa201d-7e17-437f-a9e5-6a9e657a0957 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:03.465078 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79598d-bade-47ff-b6c3-fc2bbf0f9673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:03.466485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79598d-bade-47ff-b6c3-fc2bbf0f9673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:03.467104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79598d-bade-47ff-b6c3-fc2bbf0f9673 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:03.467654 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79598d-bade-47ff-b6c3-fc2bbf0f9673 admin admin] PATH_INFO: `/v3/users/d42cc19207174c27b6c45a360cff37a6` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:03.475113 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79598d-bade-47ff-b6c3-fc2bbf0f9673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42cc19207174c27b6c45a360cff37a6)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:03.479517 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79598d-bade-47ff-b6c3-fc2bbf0f9673 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:03.510325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa201d-7e17-437f-a9e5-6a9e657a0957 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:03.516484 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47315829-38b3-483b-8b56-b880cfbd6857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:03.528544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47315829-38b3-483b-8b56-b880cfbd6857 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:03.528544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47315829-38b3-483b-8b56-b880cfbd6857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:03.528544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47315829-38b3-483b-8b56-b880cfbd6857 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:03.528544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47315829-38b3-483b-8b56-b880cfbd6857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:03.528544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47315829-38b3-483b-8b56-b880cfbd6857 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:03.548880 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 829/1655] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:03 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:03.550241 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47315829-38b3-483b-8b56-b880cfbd6857 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:03.579055 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ca79598d-bade-47ff-b6c3-fc2bbf0f9673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42cc19207174c27b6c45a360cff37a6'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:03.584915 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47315829-38b3-483b-8b56-b880cfbd6857 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:03.593204 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ca79598d-bade-47ff-b6c3-fc2bbf0f9673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42cc19207174c27b6c45a360cff37a6'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:03.594897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ca79598d-bade-47ff-b6c3-fc2bbf0f9673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42cc19207174c27b6c45a360cff37a6'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:03.605299 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb1184-5194-4c8d-aa50-0728b6c88ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:03.606153 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb1184-5194-4c8d-aa50-0728b6c88ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:03.606439 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb1184-5194-4c8d-aa50-0728b6c88ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:03.606720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb1184-5194-4c8d-aa50-0728b6c88ed5 admin admin] PATH_INFO: `/v3/projects/277ec455a5f04200b652395fd4f8e8a7/users/e8664da0b7c4436c87c7ddbf852bd56a/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:03.611838 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ca79598d-bade-47ff-b6c3-fc2bbf0f9673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42cc19207174c27b6c45a360cff37a6'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:03.612760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ca79598d-bade-47ff-b6c3-fc2bbf0f9673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42cc19207174c27b6c45a360cff37a6'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:03.636871 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb1184-5194-4c8d-aa50-0728b6c88ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277ec455a5f04200b652395fd4f8e8a7, user_id=e8664da0b7c4436c87c7ddbf852bd56a, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:03.637555 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 827/1656] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:03 2021] DELETE /identity/v3/users/d42cc19207174c27b6c45a360cff37a6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:32:03.644430 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb1184-5194-4c8d-aa50-0728b6c88ed5 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:03.667489 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd09283-7bb7-4b82-928d-0afbb869ba94 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:03.667792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd09283-7bb7-4b82-928d-0afbb869ba94 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:03.668083 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd09283-7bb7-4b82-928d-0afbb869ba94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:03.701600 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 830/1657] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:03 2021] PUT /identity/v3/projects/277ec455a5f04200b652395fd4f8e8a7/users/e8664da0b7c4436c87c7ddbf852bd56a/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:03.701600 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a396cc-209d-4702-9b42-c9594216e19b None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:03.701600 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a396cc-209d-4702-9b42-c9594216e19b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:03.701600 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a396cc-209d-4702-9b42-c9594216e19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:03.722106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-6bd09283-7bb7-4b82-928d-0afbb869ba94 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:03.723351 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6bd09283-7bb7-4b82-928d-0afbb869ba94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:03.768576 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-b5a396cc-209d-4702-9b42-c9594216e19b None None] MFA Rules not processed for user `e8664da0b7c4436c87c7ddbf852bd56a`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:03.769834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-b5a396cc-209d-4702-9b42-c9594216e19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:03.840268 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 828/1658] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:03.847414 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd09283-7bb7-4b82-928d-0afbb869ba94 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:03.848952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6bd09283-7bb7-4b82-928d-0afbb869ba94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:03.916742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 831/1659] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:03 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:03.937262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a396cc-209d-4702-9b42-c9594216e19b None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:03.938711 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-b5a396cc-209d-4702-9b42-c9594216e19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:03.992136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd09283-7bb7-4b82-928d-0afbb869ba94 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:03.996876 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e5089-86b9-4561-b6ac-2dd71c5d02e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:03.997670 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e5089-86b9-4561-b6ac-2dd71c5d02e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:03.998021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e5089-86b9-4561-b6ac-2dd71c5d02e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:03.998341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e5089-86b9-4561-b6ac-2dd71c5d02e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:04.011372 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e5089-86b9-4561-b6ac-2dd71c5d02e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:04.013000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e5089-86b9-4561-b6ac-2dd71c5d02e2 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:04.025667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 829/1660] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:32:04.042749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a396cc-209d-4702-9b42-c9594216e19b None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:04.049257 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e5264-baff-47ef-99f4-1c4f4ad39d9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:04.050215 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e5264-baff-47ef-99f4-1c4f4ad39d9e service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:04.051006 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e5264-baff-47ef-99f4-1c4f4ad39d9e service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:04.051492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e5264-baff-47ef-99f4-1c4f4ad39d9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:04.064846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e5264-baff-47ef-99f4-1c4f4ad39d9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:04.067478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e5264-baff-47ef-99f4-1c4f4ad39d9e service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:04.084588 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 832/1661] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:03 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:32:04.502538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e5089-86b9-4561-b6ac-2dd71c5d02e2 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:04.504208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7d7e5089-86b9-4561-b6ac-2dd71c5d02e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:04.550196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e5089-86b9-4561-b6ac-2dd71c5d02e2 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:04.577216 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:04.578535 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:04.579094 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:04.579575 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] PATH_INFO: `/v3/projects/9352ad96907543c1bd729cdf86ecc0ea` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:04.582131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9352ad96907543c1bd729cdf86ecc0ea)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:04.583399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: WARNING py.warnings [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:32:04.583399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: warnings.warn(msg) Nov 16 00:32:04.583399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: Nov 16 00:32:04.595980 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:04.697910 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9352ad96907543c1bd729cdf86ecc0ea', 'request_id': 'req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:04.705787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9352ad96907543c1bd729cdf86ecc0ea', 'request_id': 'req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:04.732114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9352ad96907543c1bd729cdf86ecc0ea', 'request_id': 'req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:04.745915 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] The token cache is being invalidate because project 9352ad96907543c1bd729cdf86ecc0ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:04.746206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:04.746857 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:04.748419 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 830/1662] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:04 2021] DELETE /identity/v3/projects/9352ad96907543c1bd729cdf86ecc0ea => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:04.752647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e5264-baff-47ef-99f4-1c4f4ad39d9e service nova] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:04.763630 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e5264-baff-47ef-99f4-1c4f4ad39d9e service nova] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:04.830938 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287639c-6ba0-4677-a322-db10af9a5a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:04.831819 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287639c-6ba0-4677-a322-db10af9a5a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:04.832106 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287639c-6ba0-4677-a322-db10af9a5a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:04.832389 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287639c-6ba0-4677-a322-db10af9a5a87 admin admin] PATH_INFO: `/v3/users/0695bda3024c402ea0284b3aaf330451` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:04.833605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287639c-6ba0-4677-a322-db10af9a5a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0695bda3024c402ea0284b3aaf330451)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:04.834628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: WARNING py.warnings [None req-b287639c-6ba0-4677-a322-db10af9a5a87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:32:04.834628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: warnings.warn(msg) Nov 16 00:32:04.834628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: Nov 16 00:32:04.836547 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287639c-6ba0-4677-a322-db10af9a5a87 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:04.939963 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-b287639c-6ba0-4677-a322-db10af9a5a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0695bda3024c402ea0284b3aaf330451'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:04.959551 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-b287639c-6ba0-4677-a322-db10af9a5a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0695bda3024c402ea0284b3aaf330451'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:04.970167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-b287639c-6ba0-4677-a322-db10af9a5a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0695bda3024c402ea0284b3aaf330451'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:04.991976 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-b287639c-6ba0-4677-a322-db10af9a5a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0695bda3024c402ea0284b3aaf330451'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:04.992797 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-b287639c-6ba0-4677-a322-db10af9a5a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0695bda3024c402ea0284b3aaf330451'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:05.000167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 833/1663] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:04 2021] DELETE /identity/v3/users/0695bda3024c402ea0284b3aaf330451 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:05.281310 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:05.282965 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:05.328976 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbf1f9-a9b7-4546-97fc-9d6ac3f2b5c8 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:05.412391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db193f4-5a29-4594-9a42-8cc20c5de9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:05.413186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db193f4-5a29-4594-9a42-8cc20c5de9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:05.413689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db193f4-5a29-4594-9a42-8cc20c5de9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:05.414046 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db193f4-5a29-4594-9a42-8cc20c5de9b0 admin admin] PATH_INFO: `/v3/projects/63b55251eeee4329bda8366b673986a9` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:05.415300 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db193f4-5a29-4594-9a42-8cc20c5de9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b55251eeee4329bda8366b673986a9)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:05.417209 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db193f4-5a29-4594-9a42-8cc20c5de9b0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:05.509619 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1db193f4-5a29-4594-9a42-8cc20c5de9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b55251eeee4329bda8366b673986a9', 'request_id': 'req-1db193f4-5a29-4594-9a42-8cc20c5de9b0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:05.516255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1db193f4-5a29-4594-9a42-8cc20c5de9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b55251eeee4329bda8366b673986a9', 'request_id': 'req-1db193f4-5a29-4594-9a42-8cc20c5de9b0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:05.526179 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1db193f4-5a29-4594-9a42-8cc20c5de9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b55251eeee4329bda8366b673986a9', 'request_id': 'req-1db193f4-5a29-4594-9a42-8cc20c5de9b0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:05.544637 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1db193f4-5a29-4594-9a42-8cc20c5de9b0 admin admin] The token cache is being invalidate because project 63b55251eeee4329bda8366b673986a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:05.545049 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1db193f4-5a29-4594-9a42-8cc20c5de9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:05.545775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1db193f4-5a29-4594-9a42-8cc20c5de9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:05.548104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 831/1664] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:05 2021] DELETE /identity/v3/projects/63b55251eeee4329bda8366b673986a9 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:05.555425 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cc81d-c147-4505-923f-7c8ad846d904 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:05.555972 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cc81d-c147-4505-923f-7c8ad846d904 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:05.556048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cc81d-c147-4505-923f-7c8ad846d904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:05.591958 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-717cc81d-c147-4505-923f-7c8ad846d904 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:05.608746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-717cc81d-c147-4505-923f-7c8ad846d904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:05.720948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 834/1665] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:05.730462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a8089-e144-4c44-bcb0-25f17f8e99f2 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:05.732285 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a8089-e144-4c44-bcb0-25f17f8e99f2 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:05.733251 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a8089-e144-4c44-bcb0-25f17f8e99f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:05.796470 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-d46a8089-e144-4c44-bcb0-25f17f8e99f2 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:05.801154 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d46a8089-e144-4c44-bcb0-25f17f8e99f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:05.832036 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 832/1666] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:05.838710 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cc81d-c147-4505-923f-7c8ad846d904 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:05.857185 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cc81d-c147-4505-923f-7c8ad846d904 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:05.864096 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dff424-8873-4d58-a94a-cfb6beb7610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:05.865192 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dff424-8873-4d58-a94a-cfb6beb7610c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:05.865632 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dff424-8873-4d58-a94a-cfb6beb7610c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:05.866128 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dff424-8873-4d58-a94a-cfb6beb7610c admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:05.867899 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dff424-8873-4d58-a94a-cfb6beb7610c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:32:05.868606 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dff424-8873-4d58-a94a-cfb6beb7610c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:05.877780 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dff424-8873-4d58-a94a-cfb6beb7610c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:05.911209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 835/1667] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:32:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:32:05.915660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a8089-e144-4c44-bcb0-25f17f8e99f2 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:05.925360 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a8089-e144-4c44-bcb0-25f17f8e99f2 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:05.933826 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4d49d-ce0d-4f5f-9344-21ad41fc3f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:05.934528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4d49d-ce0d-4f5f-9344-21ad41fc3f84 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:05.934819 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4d49d-ce0d-4f5f-9344-21ad41fc3f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:05.935133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4d49d-ce0d-4f5f-9344-21ad41fc3f84 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:05.935847 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4d49d-ce0d-4f5f-9344-21ad41fc3f84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:05.937775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4d49d-ce0d-4f5f-9344-21ad41fc3f84 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:06.006160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 833/1668] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:05 2021] POST /identity/v3/projects => generated 369 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:32:06.011192 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dff424-8873-4d58-a94a-cfb6beb7610c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:06.025190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dff424-8873-4d58-a94a-cfb6beb7610c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:06.106870 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa05fa0-7c2b-4e63-aa71-c4af0337f752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:06.108233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa05fa0-7c2b-4e63-aa71-c4af0337f752 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:06.108959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa05fa0-7c2b-4e63-aa71-c4af0337f752 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:06.109455 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa05fa0-7c2b-4e63-aa71-c4af0337f752 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:06.111315 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa05fa0-7c2b-4e63-aa71-c4af0337f752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:06.114094 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa05fa0-7c2b-4e63-aa71-c4af0337f752 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:06.144758 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 836/1669] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:06 2021] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:06.149597 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4d49d-ce0d-4f5f-9344-21ad41fc3f84 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:06.167955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4d49d-ce0d-4f5f-9344-21ad41fc3f84 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:06.173037 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761f9e1-19a2-4ce0-a0e9-50f1d9cafa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:06.173719 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761f9e1-19a2-4ce0-a0e9-50f1d9cafa15 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:06.174011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761f9e1-19a2-4ce0-a0e9-50f1d9cafa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:06.174350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761f9e1-19a2-4ce0-a0e9-50f1d9cafa15 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:06.175131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761f9e1-19a2-4ce0-a0e9-50f1d9cafa15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:06.176809 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761f9e1-19a2-4ce0-a0e9-50f1d9cafa15 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:06.190307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 834/1670] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:06 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:32:06.194190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa05fa0-7c2b-4e63-aa71-c4af0337f752 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:06.204641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa05fa0-7c2b-4e63-aa71-c4af0337f752 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:06.209318 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3de12-991b-48c5-a472-c2b808003f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:06.209990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3de12-991b-48c5-a472-c2b808003f22 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:06.210807 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3de12-991b-48c5-a472-c2b808003f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:06.211142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3de12-991b-48c5-a472-c2b808003f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:06.211884 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3de12-991b-48c5-a472-c2b808003f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:06.213494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3de12-991b-48c5-a472-c2b808003f22 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:06.230407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 837/1671] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:06 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:06.231722 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761f9e1-19a2-4ce0-a0e9-50f1d9cafa15 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:06.244170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761f9e1-19a2-4ce0-a0e9-50f1d9cafa15 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:06.252376 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf53850-e90f-44df-b321-213c36811ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:06.253292 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf53850-e90f-44df-b321-213c36811ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:06.253575 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf53850-e90f-44df-b321-213c36811ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:06.253850 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf53850-e90f-44df-b321-213c36811ecd admin admin] PATH_INFO: `/v3/projects/14e28269c5704ae5b89c74ac5ea32551/users/cf3b8037cbee477f80382d4d4490f77c/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:06.269970 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf53850-e90f-44df-b321-213c36811ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e28269c5704ae5b89c74ac5ea32551, user_id=cf3b8037cbee477f80382d4d4490f77c, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:06.272764 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf53850-e90f-44df-b321-213c36811ecd admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:06.286455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 835/1672] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:06 2021] PUT /identity/v3/projects/14e28269c5704ae5b89c74ac5ea32551/users/cf3b8037cbee477f80382d4d4490f77c/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:06.294647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe6756-cab3-44ba-b619-6bcdd7490583 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:06.295152 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe6756-cab3-44ba-b619-6bcdd7490583 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:06.295438 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe6756-cab3-44ba-b619-6bcdd7490583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:06.319055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-e6fe6756-cab3-44ba-b619-6bcdd7490583 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:06.320790 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e6fe6756-cab3-44ba-b619-6bcdd7490583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:06.376521 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 838/1673] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:06.387271 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf53850-e90f-44df-b321-213c36811ecd admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:06.389017 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-fbf53850-e90f-44df-b321-213c36811ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:06.450507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf53850-e90f-44df-b321-213c36811ecd admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:06.454521 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8a8e1-e811-4836-b251-c94d45716993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:06.455294 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8a8e1-e811-4836-b251-c94d45716993 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:06.455683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8a8e1-e811-4836-b251-c94d45716993 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:06.455989 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8a8e1-e811-4836-b251-c94d45716993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:06.467038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8a8e1-e811-4836-b251-c94d45716993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:06.468622 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8a8e1-e811-4836-b251-c94d45716993 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:06.480129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 836/1674] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:07.220315 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe6756-cab3-44ba-b619-6bcdd7490583 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:07.221782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e6fe6756-cab3-44ba-b619-6bcdd7490583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:07.247362 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe6756-cab3-44ba-b619-6bcdd7490583 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:07.260690 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69a2e2-68d3-4e36-80ce-28cf14d7e187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:07.262180 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69a2e2-68d3-4e36-80ce-28cf14d7e187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:07.264346 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69a2e2-68d3-4e36-80ce-28cf14d7e187 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:07.264823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69a2e2-68d3-4e36-80ce-28cf14d7e187 admin admin] PATH_INFO: `/v3/users/e8664da0b7c4436c87c7ddbf852bd56a` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:07.266377 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69a2e2-68d3-4e36-80ce-28cf14d7e187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8664da0b7c4436c87c7ddbf852bd56a)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:07.268916 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69a2e2-68d3-4e36-80ce-28cf14d7e187 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:07.371041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-7c69a2e2-68d3-4e36-80ce-28cf14d7e187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8664da0b7c4436c87c7ddbf852bd56a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:07.380337 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-7c69a2e2-68d3-4e36-80ce-28cf14d7e187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8664da0b7c4436c87c7ddbf852bd56a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:07.388281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-7c69a2e2-68d3-4e36-80ce-28cf14d7e187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8664da0b7c4436c87c7ddbf852bd56a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:07.404686 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-7c69a2e2-68d3-4e36-80ce-28cf14d7e187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8664da0b7c4436c87c7ddbf852bd56a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:07.406293 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-7c69a2e2-68d3-4e36-80ce-28cf14d7e187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8664da0b7c4436c87c7ddbf852bd56a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:07.414720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 839/1675] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:07 2021] DELETE /identity/v3/users/e8664da0b7c4436c87c7ddbf852bd56a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:07.419320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb409f35-e6c2-4e8f-896a-ed431ef712eb None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:07.428572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb409f35-e6c2-4e8f-896a-ed431ef712eb None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:07.429511 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb409f35-e6c2-4e8f-896a-ed431ef712eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:07.452666 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-eb409f35-e6c2-4e8f-896a-ed431ef712eb None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:07.454327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-eb409f35-e6c2-4e8f-896a-ed431ef712eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:07.516506 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a454411-7018-4640-b664-12b1d5f2fe00 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:07.517122 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a454411-7018-4640-b664-12b1d5f2fe00 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:07.517665 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a454411-7018-4640-b664-12b1d5f2fe00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:07.568591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7a454411-7018-4640-b664-12b1d5f2fe00 None None] MFA Rules not processed for user `cf3b8037cbee477f80382d4d4490f77c`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:07.570430 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7a454411-7018-4640-b664-12b1d5f2fe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:07.595932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 837/1676] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:07.608504 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb409f35-e6c2-4e8f-896a-ed431ef712eb None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:07.610898 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-eb409f35-e6c2-4e8f-896a-ed431ef712eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:07.690539 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 840/1677] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:07 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:07.694545 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a454411-7018-4640-b664-12b1d5f2fe00 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:07.696087 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7a454411-7018-4640-b664-12b1d5f2fe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:07.713220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb409f35-e6c2-4e8f-896a-ed431ef712eb None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:07.717914 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a454411-7018-4640-b664-12b1d5f2fe00 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:07.718698 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d2d70-76e3-473b-b44d-4b923d8b7ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:07.719755 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d2d70-76e3-473b-b44d-4b923d8b7ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:07.720299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d2d70-76e3-473b-b44d-4b923d8b7ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:07.720711 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d2d70-76e3-473b-b44d-4b923d8b7ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:07.735733 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b5a83-7a0f-48db-ac8f-7dbae8306267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:07.736810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b5a83-7a0f-48db-ac8f-7dbae8306267 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:07.737271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b5a83-7a0f-48db-ac8f-7dbae8306267 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:07.737721 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b5a83-7a0f-48db-ac8f-7dbae8306267 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:07.738430 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b5a83-7a0f-48db-ac8f-7dbae8306267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:07.739115 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d2d70-76e3-473b-b44d-4b923d8b7ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:07.740716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d2d70-76e3-473b-b44d-4b923d8b7ea7 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:07.741217 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b5a83-7a0f-48db-ac8f-7dbae8306267 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:07.750892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 838/1678] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:32:07.771065 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 841/1679] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:07 2021] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:32:07.775065 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d2d70-76e3-473b-b44d-4b923d8b7ea7 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:07.785913 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d2d70-76e3-473b-b44d-4b923d8b7ea7 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:07.887439 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e474560-969b-4017-a53c-2881c0856085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:07.888198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474560-969b-4017-a53c-2881c0856085 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:07.888947 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474560-969b-4017-a53c-2881c0856085 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:07.889069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474560-969b-4017-a53c-2881c0856085 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:07.889844 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e474560-969b-4017-a53c-2881c0856085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:07.892000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e474560-969b-4017-a53c-2881c0856085 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:07.920670 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 839/1680] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:07 2021] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:32:07.921855 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b5a83-7a0f-48db-ac8f-7dbae8306267 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:07.941036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b5a83-7a0f-48db-ac8f-7dbae8306267 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:07.961527 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c38be-a6d3-44d9-a2b2-751b1dd52047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:07.967316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c38be-a6d3-44d9-a2b2-751b1dd52047 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:07.968136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c38be-a6d3-44d9-a2b2-751b1dd52047 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:07.968625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c38be-a6d3-44d9-a2b2-751b1dd52047 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:07.969604 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c38be-a6d3-44d9-a2b2-751b1dd52047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:07.971593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c38be-a6d3-44d9-a2b2-751b1dd52047 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:07.989067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 842/1681] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:07 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:32:07.993344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e474560-969b-4017-a53c-2881c0856085 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:08.004553 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e474560-969b-4017-a53c-2881c0856085 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:08.011924 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c0dda-b54e-4092-9cac-3fd4ec007120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:08.012824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c0dda-b54e-4092-9cac-3fd4ec007120 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:08.013109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c0dda-b54e-4092-9cac-3fd4ec007120 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:08.013390 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c0dda-b54e-4092-9cac-3fd4ec007120 admin admin] PATH_INFO: `/v3/projects/cba3190797d54c11b30220f84c593a7e/users/c096e62111474dafbb7da5fccbc5a90e/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:08.029244 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c0dda-b54e-4092-9cac-3fd4ec007120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba3190797d54c11b30220f84c593a7e, user_id=c096e62111474dafbb7da5fccbc5a90e, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:08.031937 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c0dda-b54e-4092-9cac-3fd4ec007120 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:08.045460 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 840/1682] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:07 2021] PUT /identity/v3/projects/cba3190797d54c11b30220f84c593a7e/users/c096e62111474dafbb7da5fccbc5a90e/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:08.049274 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c38be-a6d3-44d9-a2b2-751b1dd52047 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:08.065159 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c38be-a6d3-44d9-a2b2-751b1dd52047 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:08.127892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c0dda-b54e-4092-9cac-3fd4ec007120 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:08.129619 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ce1c0dda-b54e-4092-9cac-3fd4ec007120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:08.200192 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683c156-2023-457d-aa1a-23c157c36d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:08.200879 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683c156-2023-457d-aa1a-23c157c36d0b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:08.201826 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683c156-2023-457d-aa1a-23c157c36d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:08.201826 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683c156-2023-457d-aa1a-23c157c36d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:08.202501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683c156-2023-457d-aa1a-23c157c36d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:08.204500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683c156-2023-457d-aa1a-23c157c36d0b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:08.227437 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 843/1683] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:08 2021] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:08.231082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683c156-2023-457d-aa1a-23c157c36d0b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:08.246429 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683c156-2023-457d-aa1a-23c157c36d0b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:08.249391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c0dda-b54e-4092-9cac-3fd4ec007120 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:08.252631 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfc24b-8296-43e5-8e0b-b54c7e10c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:08.253842 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfc24b-8296-43e5-8e0b-b54c7e10c79e admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:08.254326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfc24b-8296-43e5-8e0b-b54c7e10c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:08.254753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfc24b-8296-43e5-8e0b-b54c7e10c79e admin admin] PATH_INFO: `/v3/projects/cba3190797d54c11b30220f84c593a7e/users/c096e62111474dafbb7da5fccbc5a90e/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:08.257967 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfc24b-8296-43e5-8e0b-b54c7e10c79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba3190797d54c11b30220f84c593a7e, user_id=c096e62111474dafbb7da5fccbc5a90e, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:08.261212 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b31729-db33-4afa-8a9f-cda6fa970c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:08.261479 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfc24b-8296-43e5-8e0b-b54c7e10c79e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:08.262828 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b31729-db33-4afa-8a9f-cda6fa970c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:08.264854 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b31729-db33-4afa-8a9f-cda6fa970c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:08.265224 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b31729-db33-4afa-8a9f-cda6fa970c13 admin admin] PATH_INFO: `/v3/projects/277ec455a5f04200b652395fd4f8e8a7` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:08.274333 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b31729-db33-4afa-8a9f-cda6fa970c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=277ec455a5f04200b652395fd4f8e8a7)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:08.275958 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 844/1684] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:08 2021] PUT /identity/v3/projects/cba3190797d54c11b30220f84c593a7e/users/c096e62111474dafbb7da5fccbc5a90e/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:08.277132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b31729-db33-4afa-8a9f-cda6fa970c13 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:08.401008 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-55b31729-db33-4afa-8a9f-cda6fa970c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277ec455a5f04200b652395fd4f8e8a7', 'request_id': 'req-55b31729-db33-4afa-8a9f-cda6fa970c13'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:08.412125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-55b31729-db33-4afa-8a9f-cda6fa970c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277ec455a5f04200b652395fd4f8e8a7', 'request_id': 'req-55b31729-db33-4afa-8a9f-cda6fa970c13'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:08.423459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-55b31729-db33-4afa-8a9f-cda6fa970c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277ec455a5f04200b652395fd4f8e8a7', 'request_id': 'req-55b31729-db33-4afa-8a9f-cda6fa970c13'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:08.453319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-55b31729-db33-4afa-8a9f-cda6fa970c13 admin admin] The token cache is being invalidate because project 277ec455a5f04200b652395fd4f8e8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:08.453651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-55b31729-db33-4afa-8a9f-cda6fa970c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:08.456213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-55b31729-db33-4afa-8a9f-cda6fa970c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:08.464121 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 841/1685] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:08 2021] DELETE /identity/v3/projects/277ec455a5f04200b652395fd4f8e8a7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:08.466275 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9dc34-35ed-4059-86b8-964d3d4fa062 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:08.466720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9dc34-35ed-4059-86b8-964d3d4fa062 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:08.467189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9dc34-35ed-4059-86b8-964d3d4fa062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:08.501932 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-99e9dc34-35ed-4059-86b8-964d3d4fa062 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:08.503306 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-99e9dc34-35ed-4059-86b8-964d3d4fa062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:08.709120 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 845/1686] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:08.711778 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160810f7-53ac-4cd8-b7fb-e9e0a0e4aaa3 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:08.712358 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160810f7-53ac-4cd8-b7fb-e9e0a0e4aaa3 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:08.713024 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160810f7-53ac-4cd8-b7fb-e9e0a0e4aaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:08.758617 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-160810f7-53ac-4cd8-b7fb-e9e0a0e4aaa3 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:08.760266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-160810f7-53ac-4cd8-b7fb-e9e0a0e4aaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:08.777345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9dc34-35ed-4059-86b8-964d3d4fa062 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:08.786590 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 842/1687] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:08.792042 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9dc34-35ed-4059-86b8-964d3d4fa062 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:08.807927 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2f34d-31d4-4feb-83d5-f22b6188211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:08.809061 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f34d-31d4-4feb-83d5-f22b6188211a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:08.809511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f34d-31d4-4feb-83d5-f22b6188211a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:08.810123 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f34d-31d4-4feb-83d5-f22b6188211a admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:08.811048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2f34d-31d4-4feb-83d5-f22b6188211a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:32:08.811561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2f34d-31d4-4feb-83d5-f22b6188211a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:08.814294 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2f34d-31d4-4feb-83d5-f22b6188211a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:08.836578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 846/1688] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:32:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:32:08.840919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160810f7-53ac-4cd8-b7fb-e9e0a0e4aaa3 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:08.850879 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160810f7-53ac-4cd8-b7fb-e9e0a0e4aaa3 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:08.855933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ed3d8-e61d-49e0-bf0f-7bcb2602ed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:08.856597 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed3d8-e61d-49e0-bf0f-7bcb2602ed57 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:08.856883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed3d8-e61d-49e0-bf0f-7bcb2602ed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:08.857160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed3d8-e61d-49e0-bf0f-7bcb2602ed57 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:08.857904 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ed3d8-e61d-49e0-bf0f-7bcb2602ed57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:08.859861 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ed3d8-e61d-49e0-bf0f-7bcb2602ed57 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:08.887794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 843/1689] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:08 2021] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:08.891723 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2f34d-31d4-4feb-83d5-f22b6188211a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:08.904274 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2f34d-31d4-4feb-83d5-f22b6188211a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:09.022233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9d837-491c-4359-b5d0-e11018b93506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:09.024217 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d837-491c-4359-b5d0-e11018b93506 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:09.024505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d837-491c-4359-b5d0-e11018b93506 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:09.024784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d837-491c-4359-b5d0-e11018b93506 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:09.042473 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9d837-491c-4359-b5d0-e11018b93506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:09.046133 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9d837-491c-4359-b5d0-e11018b93506 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:09.101510 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 847/1690] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:08 2021] POST /identity/v3/users => generated 282 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:32:09.107667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ed3d8-e61d-49e0-bf0f-7bcb2602ed57 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:09.125566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ed3d8-e61d-49e0-bf0f-7bcb2602ed57 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:09.141070 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1afa9-01a4-4e41-b2e9-5c71190a7426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:09.141961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1afa9-01a4-4e41-b2e9-5c71190a7426 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:09.142429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1afa9-01a4-4e41-b2e9-5c71190a7426 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:09.142958 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1afa9-01a4-4e41-b2e9-5c71190a7426 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:09.143742 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1afa9-01a4-4e41-b2e9-5c71190a7426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:09.145389 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1afa9-01a4-4e41-b2e9-5c71190a7426 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:09.158158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 844/1691] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:09 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:09.162169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9d837-491c-4359-b5d0-e11018b93506 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:09.178332 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9d837-491c-4359-b5d0-e11018b93506 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:09.189400 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79676750-2ae6-49b4-a579-46c6ceff33d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:09.193635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79676750-2ae6-49b4-a579-46c6ceff33d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:09.193635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79676750-2ae6-49b4-a579-46c6ceff33d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:09.193635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79676750-2ae6-49b4-a579-46c6ceff33d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:09.193635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79676750-2ae6-49b4-a579-46c6ceff33d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:09.194138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79676750-2ae6-49b4-a579-46c6ceff33d7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:09.206544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 848/1692] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:09 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:09.211100 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1afa9-01a4-4e41-b2e9-5c71190a7426 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:09.227119 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1afa9-01a4-4e41-b2e9-5c71190a7426 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:09.231932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e96ef-f80a-4cbc-a322-5739aa7a708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:09.232843 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e96ef-f80a-4cbc-a322-5739aa7a708a admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:09.233128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e96ef-f80a-4cbc-a322-5739aa7a708a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:09.233406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e96ef-f80a-4cbc-a322-5739aa7a708a admin admin] PATH_INFO: `/v3/projects/f2d9f23b4b10414f8c43f12af28e8d41/users/5ec5679ad61c4b159737cc77165cff6b/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:09.249843 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e96ef-f80a-4cbc-a322-5739aa7a708a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d9f23b4b10414f8c43f12af28e8d41, user_id=5ec5679ad61c4b159737cc77165cff6b, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:09.252676 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e96ef-f80a-4cbc-a322-5739aa7a708a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:09.265897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 845/1693] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:09 2021] PUT /identity/v3/projects/f2d9f23b4b10414f8c43f12af28e8d41/users/5ec5679ad61c4b159737cc77165cff6b/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:09.276104 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43ab46-c12f-4d0b-a1e0-126172db412e None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:09.276613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43ab46-c12f-4d0b-a1e0-126172db412e None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:09.276613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43ab46-c12f-4d0b-a1e0-126172db412e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:09.303253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7f43ab46-c12f-4d0b-a1e0-126172db412e None None] MFA Rules not processed for user `5ec5679ad61c4b159737cc77165cff6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:09.306065 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7f43ab46-c12f-4d0b-a1e0-126172db412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:09.415957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39178-32eb-4036-884e-362924be6205 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:09.415957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39178-32eb-4036-884e-362924be6205 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:09.415957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39178-32eb-4036-884e-362924be6205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:09.416885 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 849/1694] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:09 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:09.441762 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43ab46-c12f-4d0b-a1e0-126172db412e None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:09.445576 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7f43ab46-c12f-4d0b-a1e0-126172db412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:09.495779 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-3cf39178-32eb-4036-884e-362924be6205 None None] MFA Rules not processed for user `c096e62111474dafbb7da5fccbc5a90e`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:09.496998 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3cf39178-32eb-4036-884e-362924be6205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:09.542638 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43ab46-c12f-4d0b-a1e0-126172db412e None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:09.546807 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81f063-b371-40fe-9792-2dd729e8ff67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:09.547701 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81f063-b371-40fe-9792-2dd729e8ff67 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:09.547986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81f063-b371-40fe-9792-2dd729e8ff67 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:09.548262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81f063-b371-40fe-9792-2dd729e8ff67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:09.558761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81f063-b371-40fe-9792-2dd729e8ff67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:09.560236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81f063-b371-40fe-9792-2dd729e8ff67 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:09.578116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 850/1695] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:09 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:09.610430 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 846/1696] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:09 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:09.622282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81f063-b371-40fe-9792-2dd729e8ff67 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:09.624635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-fe81f063-b371-40fe-9792-2dd729e8ff67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:09.648725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81f063-b371-40fe-9792-2dd729e8ff67 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:09.652898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edade7-a0d6-4e8a-ba02-b8d8906f8c3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:09.653874 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edade7-a0d6-4e8a-ba02-b8d8906f8c3f service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:09.654229 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edade7-a0d6-4e8a-ba02-b8d8906f8c3f service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:09.654596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edade7-a0d6-4e8a-ba02-b8d8906f8c3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:09.657333 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a1edade7-a0d6-4e8a-ba02-b8d8906f8c3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:09.727026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edade7-a0d6-4e8a-ba02-b8d8906f8c3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:09.728541 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edade7-a0d6-4e8a-ba02-b8d8906f8c3f service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:09.738601 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 851/1697] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:09 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:12.432054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf39178-32eb-4036-884e-362924be6205 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:12.441197 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf39178-32eb-4036-884e-362924be6205 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:12.445315 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2938a-8bb2-4f5f-8a79-9f4c9ee7e874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:12.445963 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2938a-8bb2-4f5f-8a79-9f4c9ee7e874 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:12.446246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2938a-8bb2-4f5f-8a79-9f4c9ee7e874 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:12.446521 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2938a-8bb2-4f5f-8a79-9f4c9ee7e874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:12.456125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2938a-8bb2-4f5f-8a79-9f4c9ee7e874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:12.457557 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2938a-8bb2-4f5f-8a79-9f4c9ee7e874 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:12.468205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 847/1698] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:12 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:13.059559 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9360181-af78-4c33-ba3e-a820a83dfe4a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:13.060482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9360181-af78-4c33-ba3e-a820a83dfe4a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:13.061225 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9360181-af78-4c33-ba3e-a820a83dfe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:13.090586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-b9360181-af78-4c33-ba3e-a820a83dfe4a None None] MFA Rules not processed for user `7893cca0610b40abb9c45414f3690df0`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:13.092085 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-b9360181-af78-4c33-ba3e-a820a83dfe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:13.169282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 852/1699] 10.222.0.54 () {58 vars in 1015 bytes} [Tue Nov 16 00:32:13 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:13.190375 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2938a-8bb2-4f5f-8a79-9f4c9ee7e874 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:13.192661 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-27a2938a-8bb2-4f5f-8a79-9f4c9ee7e874 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:13.196304 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9360181-af78-4c33-ba3e-a820a83dfe4a None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:13.197726 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-b9360181-af78-4c33-ba3e-a820a83dfe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:13.206347 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2938a-8bb2-4f5f-8a79-9f4c9ee7e874 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:13.208743 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9360181-af78-4c33-ba3e-a820a83dfe4a None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:13.210871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827faf0-2afa-4250-8ddb-ea9cb146ac85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:13.212400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827faf0-2afa-4250-8ddb-ea9cb146ac85 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:13.212400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827faf0-2afa-4250-8ddb-ea9cb146ac85 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:13.212812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827faf0-2afa-4250-8ddb-ea9cb146ac85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:13.220563 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827faf0-2afa-4250-8ddb-ea9cb146ac85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:13.221430 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dccde9-9703-4b0d-974c-3df3e1f47998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:13.221988 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827faf0-2afa-4250-8ddb-ea9cb146ac85 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:13.222238 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dccde9-9703-4b0d-974c-3df3e1f47998 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:13.222534 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dccde9-9703-4b0d-974c-3df3e1f47998 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:13.222818 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dccde9-9703-4b0d-974c-3df3e1f47998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:13.232058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 848/1700] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:13 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:13.235957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dccde9-9703-4b0d-974c-3df3e1f47998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:13.237555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dccde9-9703-4b0d-974c-3df3e1f47998 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:13.248367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 853/1701] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:13 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:32:14.756234 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827faf0-2afa-4250-8ddb-ea9cb146ac85 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:14.758461 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9827faf0-2afa-4250-8ddb-ea9cb146ac85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:14.832128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827faf0-2afa-4250-8ddb-ea9cb146ac85 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:14.838458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067badb0-ba75-4f9f-b20d-67a4372213d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:14.839375 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067badb0-ba75-4f9f-b20d-67a4372213d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:14.839661 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067badb0-ba75-4f9f-b20d-67a4372213d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:14.839939 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067badb0-ba75-4f9f-b20d-67a4372213d5 admin admin] PATH_INFO: `/v3/users/f4abd2f77c814766b4266641038e279c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:14.841193 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067badb0-ba75-4f9f-b20d-67a4372213d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4abd2f77c814766b4266641038e279c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:14.843171 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067badb0-ba75-4f9f-b20d-67a4372213d5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:14.926083 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-067badb0-ba75-4f9f-b20d-67a4372213d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4abd2f77c814766b4266641038e279c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:14.937518 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-067badb0-ba75-4f9f-b20d-67a4372213d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4abd2f77c814766b4266641038e279c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:14.938496 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-067badb0-ba75-4f9f-b20d-67a4372213d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4abd2f77c814766b4266641038e279c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:14.956009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-067badb0-ba75-4f9f-b20d-67a4372213d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4abd2f77c814766b4266641038e279c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:14.956934 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-067badb0-ba75-4f9f-b20d-67a4372213d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4abd2f77c814766b4266641038e279c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:14.971022 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 849/1702] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:14 2021] DELETE /identity/v3/users/f4abd2f77c814766b4266641038e279c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:14.976771 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159671e-235f-4fbf-ba13-8ab285a41a89 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:14.977900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159671e-235f-4fbf-ba13-8ab285a41a89 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:14.977900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159671e-235f-4fbf-ba13-8ab285a41a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:15.002687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-4159671e-235f-4fbf-ba13-8ab285a41a89 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:15.004242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4159671e-235f-4fbf-ba13-8ab285a41a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:15.073648 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 854/1703] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:32:15.118039 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067badb0-ba75-4f9f-b20d-67a4372213d5 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:15.119574 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-067badb0-ba75-4f9f-b20d-67a4372213d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:15.196783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067badb0-ba75-4f9f-b20d-67a4372213d5 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:15.201461 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85dd0-8ecb-4041-a8e6-42478cf681c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:15.202128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85dd0-8ecb-4041-a8e6-42478cf681c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:15.202445 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85dd0-8ecb-4041-a8e6-42478cf681c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:15.202729 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85dd0-8ecb-4041-a8e6-42478cf681c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:15.215715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b85dd0-8ecb-4041-a8e6-42478cf681c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:15.217918 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b6f82-1a14-4178-b066-02a89bb3540c None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:15.218209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b6f82-1a14-4178-b066-02a89bb3540c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:15.218490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b6f82-1a14-4178-b066-02a89bb3540c None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:15.219616 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b85dd0-8ecb-4041-a8e6-42478cf681c0 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:15.222674 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 855/1704] 10.222.0.50 () {54 vars in 921 bytes} [Tue Nov 16 00:32:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:32:15.234770 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 850/1705] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:15.293977 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4b8f6-b7eb-4774-a52a-d2a1d3cdd658 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:15.294436 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4b8f6-b7eb-4774-a52a-d2a1d3cdd658 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:15.294636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4b8f6-b7eb-4774-a52a-d2a1d3cdd658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:15.336739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-5bf4b8f6-b7eb-4774-a52a-d2a1d3cdd658 None None] MFA Rules not processed for user `442cc0e13dcb49f0a4a870c06e0edf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:15.345438 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-5bf4b8f6-b7eb-4774-a52a-d2a1d3cdd658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:15.496920 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 856/1706] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Nov 16 00:32:15 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:15.595174 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85dd0-8ecb-4041-a8e6-42478cf681c0 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:15.598791 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-23b85dd0-8ecb-4041-a8e6-42478cf681c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:15.625120 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85dd0-8ecb-4041-a8e6-42478cf681c0 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:15.636088 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2914b9d-f2bf-49a2-881b-314c159df291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:15.638562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2914b9d-f2bf-49a2-881b-314c159df291 service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:15.638903 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2914b9d-f2bf-49a2-881b-314c159df291 service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:15.639199 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2914b9d-f2bf-49a2-881b-314c159df291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:15.658320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2914b9d-f2bf-49a2-881b-314c159df291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:15.661812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2914b9d-f2bf-49a2-881b-314c159df291 service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:15.684008 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 851/1707] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:15 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:16.658717 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96335500-0b9a-42b0-849c-6e71a12e9a4b None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:16.659286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96335500-0b9a-42b0-849c-6e71a12e9a4b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:16.659286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96335500-0b9a-42b0-849c-6e71a12e9a4b None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:16.661232 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 857/1708] 10.222.0.50 () {54 vars in 921 bytes} [Tue Nov 16 00:32:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:32:16.785648 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb71514-6cc0-496b-97b3-db580e23280c None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:16.786130 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb71514-6cc0-496b-97b3-db580e23280c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:16.786257 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb71514-6cc0-496b-97b3-db580e23280c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:16.825036 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-0eb71514-6cc0-496b-97b3-db580e23280c None None] MFA Rules not processed for user `442cc0e13dcb49f0a4a870c06e0edf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:16.828802 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0eb71514-6cc0-496b-97b3-db580e23280c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:16.849928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 852/1709] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Nov 16 00:32:16 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:17.201434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96335500-0b9a-42b0-849c-6e71a12e9a4b None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:17.203271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-96335500-0b9a-42b0-849c-6e71a12e9a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:17.222198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96335500-0b9a-42b0-849c-6e71a12e9a4b None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:17.228360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:17.229388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:17.229685 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:17.229966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] PATH_INFO: `/v3/projects/8c7943acef784205bec73dbd12440254` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:17.231279 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7943acef784205bec73dbd12440254)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:17.233242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:17.284030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7943acef784205bec73dbd12440254', 'request_id': 'req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:17.291400 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7943acef784205bec73dbd12440254', 'request_id': 'req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:17.299408 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7943acef784205bec73dbd12440254', 'request_id': 'req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:17.318747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] The token cache is being invalidate because project 8c7943acef784205bec73dbd12440254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:17.318747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:17.320475 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:17.322564 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 858/1710] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:17 2021] DELETE /identity/v3/projects/8c7943acef784205bec73dbd12440254 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:17.326893 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb71514-6cc0-496b-97b3-db580e23280c None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:17.349428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb71514-6cc0-496b-97b3-db580e23280c None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:17.427719 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4ce3d-340a-4a60-8773-8af59ec865ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:17.428694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4ce3d-340a-4a60-8773-8af59ec865ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:17.429092 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4ce3d-340a-4a60-8773-8af59ec865ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:17.429448 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4ce3d-340a-4a60-8773-8af59ec865ad admin admin] PATH_INFO: `/v3/users/c6d5a75d07174709b7a8908a99657aa4` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:17.431914 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4ce3d-340a-4a60-8773-8af59ec865ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d5a75d07174709b7a8908a99657aa4)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:17.434477 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4ce3d-340a-4a60-8773-8af59ec865ad admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:17.509465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-91e4ce3d-340a-4a60-8773-8af59ec865ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d5a75d07174709b7a8908a99657aa4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:17.518164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-91e4ce3d-340a-4a60-8773-8af59ec865ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d5a75d07174709b7a8908a99657aa4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:17.519081 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-91e4ce3d-340a-4a60-8773-8af59ec865ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d5a75d07174709b7a8908a99657aa4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:17.533756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-91e4ce3d-340a-4a60-8773-8af59ec865ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d5a75d07174709b7a8908a99657aa4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:17.534784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-91e4ce3d-340a-4a60-8773-8af59ec865ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d5a75d07174709b7a8908a99657aa4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:17.551597 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 853/1711] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:17 2021] DELETE /identity/v3/users/c6d5a75d07174709b7a8908a99657aa4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:17.631303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:17.633385 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:17.716488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d757b-e4eb-44c9-a941-c3ea6fb96613 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:17.785153 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b8260-f17b-4e45-b4fd-1704ff0616a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:17.785960 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b8260-f17b-4e45-b4fd-1704ff0616a0 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:17.786242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b8260-f17b-4e45-b4fd-1704ff0616a0 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:17.786768 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b8260-f17b-4e45-b4fd-1704ff0616a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:17.789366 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-102b8260-f17b-4e45-b4fd-1704ff0616a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:17.813541 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b8260-f17b-4e45-b4fd-1704ff0616a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:17.815450 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b8260-f17b-4e45-b4fd-1704ff0616a0 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:17.830363 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 859/1712] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:17 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:18.863678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4ce3d-340a-4a60-8773-8af59ec865ad admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:18.865185 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-91e4ce3d-340a-4a60-8773-8af59ec865ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:18.945961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4ce3d-340a-4a60-8773-8af59ec865ad admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:18.951906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a1901-5359-46fc-bac1-e004e84c615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:18.953488 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a1901-5359-46fc-bac1-e004e84c615f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:18.954184 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a1901-5359-46fc-bac1-e004e84c615f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:18.954720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a1901-5359-46fc-bac1-e004e84c615f admin admin] PATH_INFO: `/v3/projects/1640ee69d6df4a55a9dc4f46e39a55a4` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:18.956437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a1901-5359-46fc-bac1-e004e84c615f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1640ee69d6df4a55a9dc4f46e39a55a4)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:18.959377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a1901-5359-46fc-bac1-e004e84c615f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:19.013992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-191a1901-5359-46fc-bac1-e004e84c615f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1640ee69d6df4a55a9dc4f46e39a55a4', 'request_id': 'req-191a1901-5359-46fc-bac1-e004e84c615f'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:19.021319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-191a1901-5359-46fc-bac1-e004e84c615f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1640ee69d6df4a55a9dc4f46e39a55a4', 'request_id': 'req-191a1901-5359-46fc-bac1-e004e84c615f'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:19.031555 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-191a1901-5359-46fc-bac1-e004e84c615f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1640ee69d6df4a55a9dc4f46e39a55a4', 'request_id': 'req-191a1901-5359-46fc-bac1-e004e84c615f'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:19.049519 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-191a1901-5359-46fc-bac1-e004e84c615f admin admin] The token cache is being invalidate because project 1640ee69d6df4a55a9dc4f46e39a55a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:19.050022 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-191a1901-5359-46fc-bac1-e004e84c615f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:19.051111 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-191a1901-5359-46fc-bac1-e004e84c615f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:19.053080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 854/1713] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:18 2021] DELETE /identity/v3/projects/1640ee69d6df4a55a9dc4f46e39a55a4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:19.058956 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3221472-931f-424a-85e0-a86255e56233 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:19.059568 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3221472-931f-424a-85e0-a86255e56233 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:19.059821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3221472-931f-424a-85e0-a86255e56233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:19.088229 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-d3221472-931f-424a-85e0-a86255e56233 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:19.089509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d3221472-931f-424a-85e0-a86255e56233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:19.155812 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 860/1714] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:32:19.204926 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b519b-5a24-49d3-8272-54a541bf8e6d None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:19.205878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b519b-5a24-49d3-8272-54a541bf8e6d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:19.206348 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b519b-5a24-49d3-8272-54a541bf8e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:19.230668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-b07b519b-5a24-49d3-8272-54a541bf8e6d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:19.232184 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b07b519b-5a24-49d3-8272-54a541bf8e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:19.242688 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 855/1715] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:19.247168 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3221472-931f-424a-85e0-a86255e56233 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:19.260435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3221472-931f-424a-85e0-a86255e56233 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:19.266420 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef25663-9d0b-495a-8fe5-7ea7a15b21fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:19.267381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef25663-9d0b-495a-8fe5-7ea7a15b21fa admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:19.268336 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef25663-9d0b-495a-8fe5-7ea7a15b21fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:19.268791 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef25663-9d0b-495a-8fe5-7ea7a15b21fa admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:19.269679 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef25663-9d0b-495a-8fe5-7ea7a15b21fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:32:19.270145 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef25663-9d0b-495a-8fe5-7ea7a15b21fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:19.273749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef25663-9d0b-495a-8fe5-7ea7a15b21fa admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:19.317482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b519b-5a24-49d3-8272-54a541bf8e6d None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:19.333499 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b519b-5a24-49d3-8272-54a541bf8e6d None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:19.334159 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 861/1716] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:32:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:32:19.342955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb0952-7f4c-4a05-98ea-b6463b610fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:19.344229 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb0952-7f4c-4a05-98ea-b6463b610fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:19.344522 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb0952-7f4c-4a05-98ea-b6463b610fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:19.344840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb0952-7f4c-4a05-98ea-b6463b610fb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:19.345553 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb0952-7f4c-4a05-98ea-b6463b610fb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:19.358188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb0952-7f4c-4a05-98ea-b6463b610fb4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:19.391042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 856/1717] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:19 2021] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:19.395054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef25663-9d0b-495a-8fe5-7ea7a15b21fa admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:19.411954 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef25663-9d0b-495a-8fe5-7ea7a15b21fa admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:19.512170 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd5596-b3d2-483e-82ee-856289e2fef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:19.512920 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd5596-b3d2-483e-82ee-856289e2fef9 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:19.513210 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd5596-b3d2-483e-82ee-856289e2fef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:19.514482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd5596-b3d2-483e-82ee-856289e2fef9 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:19.515240 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd5596-b3d2-483e-82ee-856289e2fef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:19.517871 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd5596-b3d2-483e-82ee-856289e2fef9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:19.542571 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 862/1718] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:19 2021] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:19.549908 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb0952-7f4c-4a05-98ea-b6463b610fb4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:19.565906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb0952-7f4c-4a05-98ea-b6463b610fb4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:19.575630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f243960-ef24-4775-ae62-deded3eb52c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:19.577135 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f243960-ef24-4775-ae62-deded3eb52c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:19.577509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f243960-ef24-4775-ae62-deded3eb52c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:19.578429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f243960-ef24-4775-ae62-deded3eb52c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:19.579313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f243960-ef24-4775-ae62-deded3eb52c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:19.581946 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f243960-ef24-4775-ae62-deded3eb52c0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:19.597881 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 857/1719] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:19 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:19.603052 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd5596-b3d2-483e-82ee-856289e2fef9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:19.614636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd5596-b3d2-483e-82ee-856289e2fef9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:19.622206 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f7222-4ebe-4aff-9608-3836b71a8043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:19.623047 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7222-4ebe-4aff-9608-3836b71a8043 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:19.623514 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7222-4ebe-4aff-9608-3836b71a8043 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:19.623873 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7222-4ebe-4aff-9608-3836b71a8043 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:19.624816 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f7222-4ebe-4aff-9608-3836b71a8043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:19.626568 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f7222-4ebe-4aff-9608-3836b71a8043 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:19.637759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 863/1720] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:19 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:19.642045 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f243960-ef24-4775-ae62-deded3eb52c0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:19.655082 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f243960-ef24-4775-ae62-deded3eb52c0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:19.660415 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c0734-a7f3-450f-ac71-479360ba9c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:19.661363 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c0734-a7f3-450f-ac71-479360ba9c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:19.661715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c0734-a7f3-450f-ac71-479360ba9c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:19.662069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c0734-a7f3-450f-ac71-479360ba9c23 admin admin] PATH_INFO: `/v3/projects/74f805b038f64c64830bc028c3e87755/users/ef1a6a2c07744eddb2cebc47226b7f83/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:19.687018 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c0734-a7f3-450f-ac71-479360ba9c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f805b038f64c64830bc028c3e87755, user_id=ef1a6a2c07744eddb2cebc47226b7f83, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:19.690420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c0734-a7f3-450f-ac71-479360ba9c23 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:19.720258 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 858/1721] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:19 2021] PUT /identity/v3/projects/74f805b038f64c64830bc028c3e87755/users/ef1a6a2c07744eddb2cebc47226b7f83/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:19.737877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bce619-07e8-406f-8c14-e4bc0a502969 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:19.738995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bce619-07e8-406f-8c14-e4bc0a502969 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:19.739538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bce619-07e8-406f-8c14-e4bc0a502969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:19.779833 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-28bce619-07e8-406f-8c14-e4bc0a502969 None None] MFA Rules not processed for user `ef1a6a2c07744eddb2cebc47226b7f83`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:19.781422 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-28bce619-07e8-406f-8c14-e4bc0a502969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:19.884342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 864/1722] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:19 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:19.888902 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c0734-a7f3-450f-ac71-479360ba9c23 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:19.959322 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c0734-a7f3-450f-ac71-479360ba9c23 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:19.965216 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e452e-ddb4-4579-bb9d-de761aea235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:19.965964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e452e-ddb4-4579-bb9d-de761aea235f admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:19.966262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e452e-ddb4-4579-bb9d-de761aea235f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:19.966613 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e452e-ddb4-4579-bb9d-de761aea235f admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:19.967272 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e452e-ddb4-4579-bb9d-de761aea235f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:19.969182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e452e-ddb4-4579-bb9d-de761aea235f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:19.996423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 859/1723] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:19 2021] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:20.001531 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bce619-07e8-406f-8c14-e4bc0a502969 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:20.013104 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bce619-07e8-406f-8c14-e4bc0a502969 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:20.072608 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c6e50-0119-4eef-b401-196566fa9246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:20.073361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c6e50-0119-4eef-b401-196566fa9246 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:20.073587 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c6e50-0119-4eef-b401-196566fa9246 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:20.073866 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c6e50-0119-4eef-b401-196566fa9246 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:20.074585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c6e50-0119-4eef-b401-196566fa9246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:20.076609 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c6e50-0119-4eef-b401-196566fa9246 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:20.101577 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 865/1724] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:20 2021] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:32:20.106642 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e452e-ddb4-4579-bb9d-de761aea235f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:20.119771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e452e-ddb4-4579-bb9d-de761aea235f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:20.124638 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470de6a4-5b19-485f-9267-9ce740b06ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:20.125431 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470de6a4-5b19-485f-9267-9ce740b06ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:20.125876 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470de6a4-5b19-485f-9267-9ce740b06ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:20.126153 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470de6a4-5b19-485f-9267-9ce740b06ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:20.126908 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470de6a4-5b19-485f-9267-9ce740b06ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:20.128675 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470de6a4-5b19-485f-9267-9ce740b06ad6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:20.140355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 860/1725] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:20 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:20.145186 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c6e50-0119-4eef-b401-196566fa9246 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:20.156756 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c6e50-0119-4eef-b401-196566fa9246 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:20.161759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10af01e-c1f2-48ac-b828-4b2dbf47212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:20.162451 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10af01e-c1f2-48ac-b828-4b2dbf47212c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:20.162723 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10af01e-c1f2-48ac-b828-4b2dbf47212c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:20.163038 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10af01e-c1f2-48ac-b828-4b2dbf47212c admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:20.164714 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10af01e-c1f2-48ac-b828-4b2dbf47212c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:20.166862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10af01e-c1f2-48ac-b828-4b2dbf47212c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:20.177001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 866/1726] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:20 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:20.181408 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470de6a4-5b19-485f-9267-9ce740b06ad6 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:20.191304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470de6a4-5b19-485f-9267-9ce740b06ad6 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:20.197120 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60088d-17f0-4215-b01a-38319c87dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:20.198007 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60088d-17f0-4215-b01a-38319c87dc95 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:20.198294 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60088d-17f0-4215-b01a-38319c87dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:20.198572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60088d-17f0-4215-b01a-38319c87dc95 admin admin] PATH_INFO: `/v3/projects/f5b03c6a07414ed0adc628acfd2718ac/users/47ca5989bda54452bbd11132879e7c8b/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:20.213509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60088d-17f0-4215-b01a-38319c87dc95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b03c6a07414ed0adc628acfd2718ac, user_id=47ca5989bda54452bbd11132879e7c8b, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:20.216262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60088d-17f0-4215-b01a-38319c87dc95 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:20.230271 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 861/1727] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:20 2021] PUT /identity/v3/projects/f5b03c6a07414ed0adc628acfd2718ac/users/47ca5989bda54452bbd11132879e7c8b/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:20.240460 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394504e3-3d29-47ca-918f-43e90c7e1a4f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:20.240955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394504e3-3d29-47ca-918f-43e90c7e1a4f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:20.241273 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394504e3-3d29-47ca-918f-43e90c7e1a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:20.267394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-394504e3-3d29-47ca-918f-43e90c7e1a4f None None] MFA Rules not processed for user `47ca5989bda54452bbd11132879e7c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:20.268631 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-394504e3-3d29-47ca-918f-43e90c7e1a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:20.331914 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 867/1728] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:20 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:20.337205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60088d-17f0-4215-b01a-38319c87dc95 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:20.404450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60088d-17f0-4215-b01a-38319c87dc95 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:20.409511 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596991f8-c1cb-4ee6-bb2d-8297241717af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:20.410305 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596991f8-c1cb-4ee6-bb2d-8297241717af admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:20.410601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596991f8-c1cb-4ee6-bb2d-8297241717af admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:20.410914 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596991f8-c1cb-4ee6-bb2d-8297241717af admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:20.411704 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596991f8-c1cb-4ee6-bb2d-8297241717af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:20.414728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596991f8-c1cb-4ee6-bb2d-8297241717af admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:20.446909 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 862/1729] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:20 2021] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:32:20.450951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394504e3-3d29-47ca-918f-43e90c7e1a4f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:20.467341 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394504e3-3d29-47ca-918f-43e90c7e1a4f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:20.529314 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8d90a-d38a-48fc-bb59-d3b480681321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:20.530105 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8d90a-d38a-48fc-bb59-d3b480681321 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:20.530399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8d90a-d38a-48fc-bb59-d3b480681321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:20.530680 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8d90a-d38a-48fc-bb59-d3b480681321 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:20.531442 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8d90a-d38a-48fc-bb59-d3b480681321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:20.533404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8d90a-d38a-48fc-bb59-d3b480681321 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:20.558025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 868/1730] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:20 2021] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:20.561767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596991f8-c1cb-4ee6-bb2d-8297241717af admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:20.573238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596991f8-c1cb-4ee6-bb2d-8297241717af admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:20.578269 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e7eab-f07e-47f6-8fdc-4a8f12676e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:20.579048 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e7eab-f07e-47f6-8fdc-4a8f12676e43 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:20.579404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e7eab-f07e-47f6-8fdc-4a8f12676e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:20.579746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e7eab-f07e-47f6-8fdc-4a8f12676e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:20.580552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e7eab-f07e-47f6-8fdc-4a8f12676e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:20.582204 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e7eab-f07e-47f6-8fdc-4a8f12676e43 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:20.594546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 863/1731] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:20 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:20.599241 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8d90a-d38a-48fc-bb59-d3b480681321 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:20.611659 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8d90a-d38a-48fc-bb59-d3b480681321 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:20.617370 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be2e10-e666-4939-a76d-64514caa0315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:20.618342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be2e10-e666-4939-a76d-64514caa0315 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:20.618661 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be2e10-e666-4939-a76d-64514caa0315 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:20.618967 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be2e10-e666-4939-a76d-64514caa0315 admin admin] PATH_INFO: `/v3/projects/cfa3a50d1a434ca786351515793661c7/users/00725a9f0aa24180bf0624c456c2d7eb/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:20.636791 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be2e10-e666-4939-a76d-64514caa0315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa3a50d1a434ca786351515793661c7, user_id=00725a9f0aa24180bf0624c456c2d7eb, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:20.639542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be2e10-e666-4939-a76d-64514caa0315 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:20.654440 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 869/1732] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:20 2021] PUT /identity/v3/projects/cfa3a50d1a434ca786351515793661c7/users/00725a9f0aa24180bf0624c456c2d7eb/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:20.658472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e7eab-f07e-47f6-8fdc-4a8f12676e43 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:20.668670 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e7eab-f07e-47f6-8fdc-4a8f12676e43 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:20.723784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a3652-5d9b-4276-b4d4-4c0ffb5f1750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:20.724392 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a3652-5d9b-4276-b4d4-4c0ffb5f1750 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:20.724931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a3652-5d9b-4276-b4d4-4c0ffb5f1750 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:20.725209 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a3652-5d9b-4276-b4d4-4c0ffb5f1750 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:20.725971 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a3652-5d9b-4276-b4d4-4c0ffb5f1750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:20.727607 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a3652-5d9b-4276-b4d4-4c0ffb5f1750 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:20.737310 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 864/1733] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:20 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:32:20.741667 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be2e10-e666-4939-a76d-64514caa0315 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:20.751723 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be2e10-e666-4939-a76d-64514caa0315 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:20.756532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4b39d-c270-4196-a2a2-1772cf92908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:20.758558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b39d-c270-4196-a2a2-1772cf92908c admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:20.758558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b39d-c270-4196-a2a2-1772cf92908c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:20.758798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b39d-c270-4196-a2a2-1772cf92908c admin admin] PATH_INFO: `/v3/projects/cfa3a50d1a434ca786351515793661c7/users/00725a9f0aa24180bf0624c456c2d7eb/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:20.760711 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4b39d-c270-4196-a2a2-1772cf92908c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa3a50d1a434ca786351515793661c7, user_id=00725a9f0aa24180bf0624c456c2d7eb, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:20.763642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4b39d-c270-4196-a2a2-1772cf92908c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:20.775045 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 870/1734] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:20 2021] PUT /identity/v3/projects/cfa3a50d1a434ca786351515793661c7/users/00725a9f0aa24180bf0624c456c2d7eb/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:20.785901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c81136-c9a6-4f6c-b9d7-e713e5d04ae1 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:20.786198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c81136-c9a6-4f6c-b9d7-e713e5d04ae1 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:20.786509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c81136-c9a6-4f6c-b9d7-e713e5d04ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:20.813815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-a4c81136-c9a6-4f6c-b9d7-e713e5d04ae1 None None] MFA Rules not processed for user `00725a9f0aa24180bf0624c456c2d7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:20.815036 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a4c81136-c9a6-4f6c-b9d7-e713e5d04ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:20.879994 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 865/1735] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:20 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:20.891041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4b39d-c270-4196-a2a2-1772cf92908c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:20.892712 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a1c4b39d-c270-4196-a2a2-1772cf92908c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:20.955833 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4b39d-c270-4196-a2a2-1772cf92908c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:20.962508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521e3e-096b-40ec-87a4-da6463f2e325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:20.963202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521e3e-096b-40ec-87a4-da6463f2e325 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:20.963494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521e3e-096b-40ec-87a4-da6463f2e325 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:20.963777 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521e3e-096b-40ec-87a4-da6463f2e325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:20.973216 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65521e3e-096b-40ec-87a4-da6463f2e325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:20.974995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65521e3e-096b-40ec-87a4-da6463f2e325 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:20.984461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 871/1736] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:20 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:21.458580 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c81136-c9a6-4f6c-b9d7-e713e5d04ae1 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:21.460778 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a4c81136-c9a6-4f6c-b9d7-e713e5d04ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:21.473892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c81136-c9a6-4f6c-b9d7-e713e5d04ae1 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:21.478423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fab0b-30e6-4a5c-a197-648783a20623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:21.479117 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fab0b-30e6-4a5c-a197-648783a20623 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:21.479409 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fab0b-30e6-4a5c-a197-648783a20623 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:21.479688 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fab0b-30e6-4a5c-a197-648783a20623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:21.540243 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fab0b-30e6-4a5c-a197-648783a20623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:21.541820 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fab0b-30e6-4a5c-a197-648783a20623 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:21.551153 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 866/1737] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:21 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:32:31.188190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521e3e-096b-40ec-87a4-da6463f2e325 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:31.189848 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-65521e3e-096b-40ec-87a4-da6463f2e325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:31.262418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521e3e-096b-40ec-87a4-da6463f2e325 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:31.267582 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22c871-238a-4e52-9cf4-1467314274fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:31.268479 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22c871-238a-4e52-9cf4-1467314274fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:31.268812 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22c871-238a-4e52-9cf4-1467314274fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:31.269107 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22c871-238a-4e52-9cf4-1467314274fa admin admin] PATH_INFO: `/v3/users/5ec5679ad61c4b159737cc77165cff6b` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:31.270548 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22c871-238a-4e52-9cf4-1467314274fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec5679ad61c4b159737cc77165cff6b)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:31.272557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22c871-238a-4e52-9cf4-1467314274fa admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:31.322597 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8a22c871-238a-4e52-9cf4-1467314274fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec5679ad61c4b159737cc77165cff6b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:31.329508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8a22c871-238a-4e52-9cf4-1467314274fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec5679ad61c4b159737cc77165cff6b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:31.337280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8a22c871-238a-4e52-9cf4-1467314274fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec5679ad61c4b159737cc77165cff6b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:31.349503 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8a22c871-238a-4e52-9cf4-1467314274fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec5679ad61c4b159737cc77165cff6b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:31.350580 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8a22c871-238a-4e52-9cf4-1467314274fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec5679ad61c4b159737cc77165cff6b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:31.357259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 872/1738] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:31 2021] DELETE /identity/v3/users/5ec5679ad61c4b159737cc77165cff6b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:31.361775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ed8f3-ec23-444c-965a-8c634fa83070 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:31.362236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ed8f3-ec23-444c-965a-8c634fa83070 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:31.362339 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ed8f3-ec23-444c-965a-8c634fa83070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:31.379955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-563ed8f3-ec23-444c-965a-8c634fa83070 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:31.381150 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-563ed8f3-ec23-444c-965a-8c634fa83070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:31.441492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 867/1739] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:31.451544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22c871-238a-4e52-9cf4-1467314274fa admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:31.452969 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8a22c871-238a-4e52-9cf4-1467314274fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:31.512624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22c871-238a-4e52-9cf4-1467314274fa admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:31.516037 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eff9f-976b-4ff7-9f1c-17938f9b5c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:31.516694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eff9f-976b-4ff7-9f1c-17938f9b5c0a service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:31.516983 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eff9f-976b-4ff7-9f1c-17938f9b5c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:31.517263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eff9f-976b-4ff7-9f1c-17938f9b5c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:31.527485 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eff9f-976b-4ff7-9f1c-17938f9b5c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:31.528970 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eff9f-976b-4ff7-9f1c-17938f9b5c0a service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:31.540100 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 873/1740] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:31.994347 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ed8f3-ec23-444c-965a-8c634fa83070 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:31.998722 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-563ed8f3-ec23-444c-965a-8c634fa83070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:32.031903 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ed8f3-ec23-444c-965a-8c634fa83070 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:32.036841 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca45417-333e-4211-9207-4b916436ce59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:32.037718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45417-333e-4211-9207-4b916436ce59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:32.038091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45417-333e-4211-9207-4b916436ce59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:32.038459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45417-333e-4211-9207-4b916436ce59 admin admin] PATH_INFO: `/v3/projects/f2d9f23b4b10414f8c43f12af28e8d41` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:32.040032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca45417-333e-4211-9207-4b916436ce59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d9f23b4b10414f8c43f12af28e8d41)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:32.041979 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca45417-333e-4211-9207-4b916436ce59 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:32.105728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fca45417-333e-4211-9207-4b916436ce59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d9f23b4b10414f8c43f12af28e8d41', 'request_id': 'req-fca45417-333e-4211-9207-4b916436ce59'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:32.115206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fca45417-333e-4211-9207-4b916436ce59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d9f23b4b10414f8c43f12af28e8d41', 'request_id': 'req-fca45417-333e-4211-9207-4b916436ce59'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:32.120164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fca45417-333e-4211-9207-4b916436ce59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d9f23b4b10414f8c43f12af28e8d41', 'request_id': 'req-fca45417-333e-4211-9207-4b916436ce59'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:32.137340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fca45417-333e-4211-9207-4b916436ce59 admin admin] The token cache is being invalidate because project f2d9f23b4b10414f8c43f12af28e8d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:32.137660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fca45417-333e-4211-9207-4b916436ce59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:32.138457 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fca45417-333e-4211-9207-4b916436ce59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:32.140365 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 868/1741] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:31 2021] DELETE /identity/v3/projects/f2d9f23b4b10414f8c43f12af28e8d41 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:32.146236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387594-438f-4458-87e1-59c06ab40066 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:32.147311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387594-438f-4458-87e1-59c06ab40066 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:32.147813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387594-438f-4458-87e1-59c06ab40066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:32.167136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-17387594-438f-4458-87e1-59c06ab40066 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:32.168539 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-17387594-438f-4458-87e1-59c06ab40066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:32.229616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 874/1742] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:32.238196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ba4f6-e046-4932-99aa-97318333ca07 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:32.238514 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ba4f6-e046-4932-99aa-97318333ca07 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:32.238808 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ba4f6-e046-4932-99aa-97318333ca07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:32.260179 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-865ba4f6-e046-4932-99aa-97318333ca07 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:32.261633 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-865ba4f6-e046-4932-99aa-97318333ca07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:32.269937 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 869/1743] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:32.274948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17387594-438f-4458-87e1-59c06ab40066 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:32.285058 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17387594-438f-4458-87e1-59c06ab40066 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:32.290806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92e64c-f420-4903-9f87-66e973f5ae90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:32.291753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92e64c-f420-4903-9f87-66e973f5ae90 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:32.292038 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92e64c-f420-4903-9f87-66e973f5ae90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:32.292315 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92e64c-f420-4903-9f87-66e973f5ae90 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:32.293041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92e64c-f420-4903-9f87-66e973f5ae90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:32:32.293349 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92e64c-f420-4903-9f87-66e973f5ae90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:32.295017 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92e64c-f420-4903-9f87-66e973f5ae90 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:32.308062 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 875/1744] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:32:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:32:32.312919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ba4f6-e046-4932-99aa-97318333ca07 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:32.326276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ba4f6-e046-4932-99aa-97318333ca07 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:32.331929 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccb1b3-2f81-49f3-894a-a1f4ce4408fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:32.332747 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccb1b3-2f81-49f3-894a-a1f4ce4408fe admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:32.333209 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccb1b3-2f81-49f3-894a-a1f4ce4408fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:32.333496 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccb1b3-2f81-49f3-894a-a1f4ce4408fe admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:32.334196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccb1b3-2f81-49f3-894a-a1f4ce4408fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:32.337354 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccb1b3-2f81-49f3-894a-a1f4ce4408fe admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:32.371702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 870/1745] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:32 2021] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:32.376327 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92e64c-f420-4903-9f87-66e973f5ae90 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:32.396841 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92e64c-f420-4903-9f87-66e973f5ae90 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:32.421303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987bd59-4778-4ae8-8f2d-984d77d1de30 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:32.421679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987bd59-4778-4ae8-8f2d-984d77d1de30 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:32.422046 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987bd59-4778-4ae8-8f2d-984d77d1de30 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:32.424119 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 871/1746] 10.222.0.50 () {54 vars in 921 bytes} [Tue Nov 16 00:32:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:32:32.436214 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaf3f5-df15-4752-ae00-c7c003662e9e None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:32.436592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaf3f5-df15-4752-ae00-c7c003662e9e None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:32.437220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaf3f5-df15-4752-ae00-c7c003662e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:32.458998 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-deeaf3f5-df15-4752-ae00-c7c003662e9e None None] MFA Rules not processed for user `442cc0e13dcb49f0a4a870c06e0edf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:32.460969 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-deeaf3f5-df15-4752-ae00-c7c003662e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:32.471245 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687d2cb-0f89-404d-b083-bf228b4c6cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:32.472546 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687d2cb-0f89-404d-b083-bf228b4c6cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:32.473039 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687d2cb-0f89-404d-b083-bf228b4c6cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:32.473432 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687d2cb-0f89-404d-b083-bf228b4c6cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:32.474416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687d2cb-0f89-404d-b083-bf228b4c6cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:32.478452 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687d2cb-0f89-404d-b083-bf228b4c6cf0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:32.501300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 876/1747] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:32 2021] POST /identity/v3/users => generated 283 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:32.505244 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687d2cb-0f89-404d-b083-bf228b4c6cf0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:32.515138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687d2cb-0f89-404d-b083-bf228b4c6cf0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:32.519977 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daa442-cf92-46a9-9fb3-695d93b32a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:32.520639 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daa442-cf92-46a9-9fb3-695d93b32a86 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:32.520934 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daa442-cf92-46a9-9fb3-695d93b32a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:32.521263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daa442-cf92-46a9-9fb3-695d93b32a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:32.521991 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4daa442-cf92-46a9-9fb3-695d93b32a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:32.523917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4daa442-cf92-46a9-9fb3-695d93b32a86 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:32.534646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 877/1748] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:32:32.539188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daa442-cf92-46a9-9fb3-695d93b32a86 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:32.547311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 872/1749] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Nov 16 00:32:32 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:32.550681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daa442-cf92-46a9-9fb3-695d93b32a86 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:32.557943 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463848e9-d1ae-4a56-bd06-002e37145625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:32.558618 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463848e9-d1ae-4a56-bd06-002e37145625 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:32.558951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463848e9-d1ae-4a56-bd06-002e37145625 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:32.559231 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463848e9-d1ae-4a56-bd06-002e37145625 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:32.560078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463848e9-d1ae-4a56-bd06-002e37145625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:32.562741 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaf3f5-df15-4752-ae00-c7c003662e9e None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:32.563424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463848e9-d1ae-4a56-bd06-002e37145625 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:32.564770 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-deeaf3f5-df15-4752-ae00-c7c003662e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:32.578987 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 878/1750] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:32 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:32:32.580213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaf3f5-df15-4752-ae00-c7c003662e9e None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:32.580924 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463848e9-d1ae-4a56-bd06-002e37145625 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:32.587001 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73675504-0daf-4a36-b1fd-bc04237263ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:32.587732 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73675504-0daf-4a36-b1fd-bc04237263ec service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:32.588085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73675504-0daf-4a36-b1fd-bc04237263ec service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:32.588435 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73675504-0daf-4a36-b1fd-bc04237263ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:32.591048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463848e9-d1ae-4a56-bd06-002e37145625 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:32.596754 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2026af-e3f2-439b-ad59-3ac2a2758c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:32.597961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2026af-e3f2-439b-ad59-3ac2a2758c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:32.597961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2026af-e3f2-439b-ad59-3ac2a2758c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:32.598150 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2026af-e3f2-439b-ad59-3ac2a2758c31 admin admin] PATH_INFO: `/v3/projects/65ef03525d854bc7a4c64fd687607197/users/e1e94038f1ec444f804362d52e797429/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:32.601725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73675504-0daf-4a36-b1fd-bc04237263ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:32.603267 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73675504-0daf-4a36-b1fd-bc04237263ec service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:32.615717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 873/1751] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:32 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:32.620094 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2026af-e3f2-439b-ad59-3ac2a2758c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ef03525d854bc7a4c64fd687607197, user_id=e1e94038f1ec444f804362d52e797429, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:32.623828 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2026af-e3f2-439b-ad59-3ac2a2758c31 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:32.644260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 879/1752] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:32 2021] PUT /identity/v3/projects/65ef03525d854bc7a4c64fd687607197/users/e1e94038f1ec444f804362d52e797429/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:32.657058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df13d34-b23a-4c6a-a5bb-5b6db0aae97d None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:32.657505 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df13d34-b23a-4c6a-a5bb-5b6db0aae97d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:32.658056 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df13d34-b23a-4c6a-a5bb-5b6db0aae97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:32.686765 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-8df13d34-b23a-4c6a-a5bb-5b6db0aae97d None None] MFA Rules not processed for user `e1e94038f1ec444f804362d52e797429`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:32.688035 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8df13d34-b23a-4c6a-a5bb-5b6db0aae97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:32.760411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 874/1753] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:32 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:32:32.761821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2026af-e3f2-439b-ad59-3ac2a2758c31 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:32.847190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2026af-e3f2-439b-ad59-3ac2a2758c31 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:32.854399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc337b-bab3-42ae-8d0e-c21e8bc0ec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:32.855115 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc337b-bab3-42ae-8d0e-c21e8bc0ec64 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:32.855457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc337b-bab3-42ae-8d0e-c21e8bc0ec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:32.856009 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc337b-bab3-42ae-8d0e-c21e8bc0ec64 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:32.857023 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc337b-bab3-42ae-8d0e-c21e8bc0ec64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:32.859451 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc337b-bab3-42ae-8d0e-c21e8bc0ec64 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:32.914542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 880/1754] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:32 2021] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:32:32.916265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df13d34-b23a-4c6a-a5bb-5b6db0aae97d None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:32.945727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df13d34-b23a-4c6a-a5bb-5b6db0aae97d None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:33.054532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366ae17-82b2-4fa1-bfb8-ef0aebe9f2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:33.055956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366ae17-82b2-4fa1-bfb8-ef0aebe9f2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:33.056395 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366ae17-82b2-4fa1-bfb8-ef0aebe9f2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:33.056920 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366ae17-82b2-4fa1-bfb8-ef0aebe9f2c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:33.058203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366ae17-82b2-4fa1-bfb8-ef0aebe9f2c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:33.060721 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366ae17-82b2-4fa1-bfb8-ef0aebe9f2c9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:33.099148 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc337b-bab3-42ae-8d0e-c21e8bc0ec64 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:33.102475 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d2cc337b-bab3-42ae-8d0e-c21e8bc0ec64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:33.109663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 875/1755] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:32 2021] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:33.110546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366ae17-82b2-4fa1-bfb8-ef0aebe9f2c9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:33.122076 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366ae17-82b2-4fa1-bfb8-ef0aebe9f2c9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:33.128076 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f816-fb2f-4261-8ae4-4eca0469bcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:33.128751 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f816-fb2f-4261-8ae4-4eca0469bcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:33.129036 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f816-fb2f-4261-8ae4-4eca0469bcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:33.129313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f816-fb2f-4261-8ae4-4eca0469bcf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:33.136173 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0f816-fb2f-4261-8ae4-4eca0469bcf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:33.137828 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0f816-fb2f-4261-8ae4-4eca0469bcf8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:33.156477 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 876/1756] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:33 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:33.157344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f816-fb2f-4261-8ae4-4eca0469bcf8 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:33.169817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f816-fb2f-4261-8ae4-4eca0469bcf8 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:33.175429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf20c7-d187-4d51-8153-ce35f91ebf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:33.176331 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf20c7-d187-4d51-8153-ce35f91ebf4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:33.176746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf20c7-d187-4d51-8153-ce35f91ebf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:33.177038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf20c7-d187-4d51-8153-ce35f91ebf4a admin admin] PATH_INFO: `/v3/projects/60efb185cfc8409aa05ed95d06b2b7f1/users/e8a5d2f953a945ac8808d461cfb1828d/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:33.204013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf20c7-d187-4d51-8153-ce35f91ebf4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60efb185cfc8409aa05ed95d06b2b7f1, user_id=e8a5d2f953a945ac8808d461cfb1828d, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:33.206884 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf20c7-d187-4d51-8153-ce35f91ebf4a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:33.237707 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 877/1757] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:33 2021] PUT /identity/v3/projects/60efb185cfc8409aa05ed95d06b2b7f1/users/e8a5d2f953a945ac8808d461cfb1828d/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:33.242224 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf20c7-d187-4d51-8153-ce35f91ebf4a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:33.259945 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc337b-bab3-42ae-8d0e-c21e8bc0ec64 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:33.353066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf20c7-d187-4d51-8153-ce35f91ebf4a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:33.359921 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0217a8-bc87-4428-ab07-963af74349f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:33.360950 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0217a8-bc87-4428-ab07-963af74349f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:33.362050 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0217a8-bc87-4428-ab07-963af74349f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:33.362238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0217a8-bc87-4428-ab07-963af74349f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:33.363135 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805dfe1-058a-48a7-aea2-d77346a10044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:33.363364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0217a8-bc87-4428-ab07-963af74349f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:33.363936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805dfe1-058a-48a7-aea2-d77346a10044 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:33.364233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805dfe1-058a-48a7-aea2-d77346a10044 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:33.364516 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805dfe1-058a-48a7-aea2-d77346a10044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:33.367355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0217a8-bc87-4428-ab07-963af74349f3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:33.371903 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8805dfe1-058a-48a7-aea2-d77346a10044 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:33.379390 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 878/1758] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:33 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:33.384051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0217a8-bc87-4428-ab07-963af74349f3 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:33.396843 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0217a8-bc87-4428-ab07-963af74349f3 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:33.403270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab82831-8441-42bd-b5b2-1d768e25084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:33.404590 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab82831-8441-42bd-b5b2-1d768e25084b admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:33.405632 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab82831-8441-42bd-b5b2-1d768e25084b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:33.405774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab82831-8441-42bd-b5b2-1d768e25084b admin admin] PATH_INFO: `/v3/projects/60efb185cfc8409aa05ed95d06b2b7f1/users/e8a5d2f953a945ac8808d461cfb1828d/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:33.409276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab82831-8441-42bd-b5b2-1d768e25084b admin admin] RBAC: Authorizing `identity:create_grant(project_id=60efb185cfc8409aa05ed95d06b2b7f1, user_id=e8a5d2f953a945ac8808d461cfb1828d, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:33.413716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab82831-8441-42bd-b5b2-1d768e25084b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:33.441858 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 879/1759] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:33 2021] PUT /identity/v3/projects/60efb185cfc8409aa05ed95d06b2b7f1/users/e8a5d2f953a945ac8808d461cfb1828d/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:33.446930 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08f653-6b7a-48f5-9bf8-73ad5b3fd417 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:33.450156 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08f653-6b7a-48f5-9bf8-73ad5b3fd417 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:33.450462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08f653-6b7a-48f5-9bf8-73ad5b3fd417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:33.452165 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805dfe1-058a-48a7-aea2-d77346a10044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:33.454316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805dfe1-058a-48a7-aea2-d77346a10044 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:33.476111 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 881/1760] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:33 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:32:33.485848 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-df08f653-6b7a-48f5-9bf8-73ad5b3fd417 None None] MFA Rules not processed for user `e8a5d2f953a945ac8808d461cfb1828d`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:33.487328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-df08f653-6b7a-48f5-9bf8-73ad5b3fd417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:33.590342 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 880/1761] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:33 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:33.682269 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805dfe1-058a-48a7-aea2-d77346a10044 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:33.683848 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8805dfe1-058a-48a7-aea2-d77346a10044 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:33.694143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805dfe1-058a-48a7-aea2-d77346a10044 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:33.751344 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e5f31-d2d8-487a-b6aa-559d4fdae469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:33.752191 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e5f31-d2d8-487a-b6aa-559d4fdae469 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:33.752585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e5f31-d2d8-487a-b6aa-559d4fdae469 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:33.753015 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e5f31-d2d8-487a-b6aa-559d4fdae469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:33.762875 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e5f31-d2d8-487a-b6aa-559d4fdae469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:33.764451 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e5f31-d2d8-487a-b6aa-559d4fdae469 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:33.775403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 882/1762] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:33 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:33.984366 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08f653-6b7a-48f5-9bf8-73ad5b3fd417 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:33.994044 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08f653-6b7a-48f5-9bf8-73ad5b3fd417 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:33.997767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97aaa2-9bc3-402b-84ec-8a05e681743b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:33.998650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97aaa2-9bc3-402b-84ec-8a05e681743b service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:33.998968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97aaa2-9bc3-402b-84ec-8a05e681743b service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:33.999402 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97aaa2-9bc3-402b-84ec-8a05e681743b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:34.072823 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97aaa2-9bc3-402b-84ec-8a05e681743b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:34.077393 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97aaa2-9bc3-402b-84ec-8a05e681743b service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:34.087274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 881/1763] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:33 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:37.408722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e5f31-d2d8-487a-b6aa-559d4fdae469 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:37.410212 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9a2e5f31-d2d8-487a-b6aa-559d4fdae469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:37.499756 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e5f31-d2d8-487a-b6aa-559d4fdae469 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:37.507186 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61839a61-d25c-4c63-aede-72bcabdf6dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:37.508805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839a61-d25c-4c63-aede-72bcabdf6dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:37.509381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839a61-d25c-4c63-aede-72bcabdf6dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:37.509765 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839a61-d25c-4c63-aede-72bcabdf6dc1 admin admin] PATH_INFO: `/v3/users/ef1a6a2c07744eddb2cebc47226b7f83` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:37.511560 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61839a61-d25c-4c63-aede-72bcabdf6dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1a6a2c07744eddb2cebc47226b7f83)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:37.514042 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61839a61-d25c-4c63-aede-72bcabdf6dc1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:37.663938 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-61839a61-d25c-4c63-aede-72bcabdf6dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1a6a2c07744eddb2cebc47226b7f83'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:37.678199 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-61839a61-d25c-4c63-aede-72bcabdf6dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1a6a2c07744eddb2cebc47226b7f83'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:37.695089 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-61839a61-d25c-4c63-aede-72bcabdf6dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1a6a2c07744eddb2cebc47226b7f83'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:37.723934 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-61839a61-d25c-4c63-aede-72bcabdf6dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1a6a2c07744eddb2cebc47226b7f83'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:37.724970 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-61839a61-d25c-4c63-aede-72bcabdf6dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1a6a2c07744eddb2cebc47226b7f83'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:37.742915 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 883/1764] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:37 2021] DELETE /identity/v3/users/ef1a6a2c07744eddb2cebc47226b7f83 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:37.747331 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e46d6-f2a2-447c-9265-c88acf433f65 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:37.748341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e46d6-f2a2-447c-9265-c88acf433f65 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:37.748645 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e46d6-f2a2-447c-9265-c88acf433f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:37.777245 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-700e46d6-f2a2-447c-9265-c88acf433f65 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:37.779545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-700e46d6-f2a2-447c-9265-c88acf433f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:37.834427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61839a61-d25c-4c63-aede-72bcabdf6dc1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:37.837253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-61839a61-d25c-4c63-aede-72bcabdf6dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:37.887236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 882/1765] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:37.902673 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e46d6-f2a2-447c-9265-c88acf433f65 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:37.904461 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-700e46d6-f2a2-447c-9265-c88acf433f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:37.940800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61839a61-d25c-4c63-aede-72bcabdf6dc1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:37.962034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99fcde-ddc3-490e-86d4-30a78c2e5dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:37.963411 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99fcde-ddc3-490e-86d4-30a78c2e5dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:37.963908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99fcde-ddc3-490e-86d4-30a78c2e5dff admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:37.964781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99fcde-ddc3-490e-86d4-30a78c2e5dff admin admin] PATH_INFO: `/v3/users/cf3b8037cbee477f80382d4d4490f77c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:37.966807 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99fcde-ddc3-490e-86d4-30a78c2e5dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3b8037cbee477f80382d4d4490f77c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:37.970710 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99fcde-ddc3-490e-86d4-30a78c2e5dff admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:37.981824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e46d6-f2a2-447c-9265-c88acf433f65 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:37.985634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869e51d-ecfc-4ae5-b078-6e17599b4b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:37.986294 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869e51d-ecfc-4ae5-b078-6e17599b4b55 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:37.986599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869e51d-ecfc-4ae5-b078-6e17599b4b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:37.986866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869e51d-ecfc-4ae5-b078-6e17599b4b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:37.996833 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869e51d-ecfc-4ae5-b078-6e17599b4b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:37.998381 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869e51d-ecfc-4ae5-b078-6e17599b4b55 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:38.009827 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 883/1766] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:38.031899 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1a99fcde-ddc3-490e-86d4-30a78c2e5dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3b8037cbee477f80382d4d4490f77c'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.039289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1a99fcde-ddc3-490e-86d4-30a78c2e5dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3b8037cbee477f80382d4d4490f77c'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.048433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1a99fcde-ddc3-490e-86d4-30a78c2e5dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3b8037cbee477f80382d4d4490f77c'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.068148 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1a99fcde-ddc3-490e-86d4-30a78c2e5dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3b8037cbee477f80382d4d4490f77c'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.068815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1a99fcde-ddc3-490e-86d4-30a78c2e5dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3b8037cbee477f80382d4d4490f77c'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.077811 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 884/1767] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:37 2021] DELETE /identity/v3/users/cf3b8037cbee477f80382d4d4490f77c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:32:38.374821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869e51d-ecfc-4ae5-b078-6e17599b4b55 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:38.387037 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869e51d-ecfc-4ae5-b078-6e17599b4b55 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:38.397833 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99fcde-ddc3-490e-86d4-30a78c2e5dff admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:38.402792 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1a99fcde-ddc3-490e-86d4-30a78c2e5dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:38.477554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:38.478426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:38.478708 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:38.479028 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] PATH_INFO: `/v3/projects/14e28269c5704ae5b89c74ac5ea32551` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:38.480383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e28269c5704ae5b89c74ac5ea32551)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:38.482291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:38.492731 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99fcde-ddc3-490e-86d4-30a78c2e5dff admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:38.499468 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:38.500549 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:38.500863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:38.501140 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] PATH_INFO: `/v3/projects/74f805b038f64c64830bc028c3e87755` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:38.502480 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f805b038f64c64830bc028c3e87755)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:38.504486 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:38.531409 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e28269c5704ae5b89c74ac5ea32551', 'request_id': 'req-2dd704c7-7b8b-4700-b017-95c6f24deac8'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.536958 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e28269c5704ae5b89c74ac5ea32551', 'request_id': 'req-2dd704c7-7b8b-4700-b017-95c6f24deac8'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.543156 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e28269c5704ae5b89c74ac5ea32551', 'request_id': 'req-2dd704c7-7b8b-4700-b017-95c6f24deac8'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.556269 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f805b038f64c64830bc028c3e87755', 'request_id': 'req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.557210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] The token cache is being invalidate because project 14e28269c5704ae5b89c74ac5ea32551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:38.557494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.558220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.562747 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 884/1768] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:38 2021] DELETE /identity/v3/projects/14e28269c5704ae5b89c74ac5ea32551 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:38.563101 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f805b038f64c64830bc028c3e87755', 'request_id': 'req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.563909 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:38.565452 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:38.573696 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f805b038f64c64830bc028c3e87755', 'request_id': 'req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.584322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] The token cache is being invalidate because project 74f805b038f64c64830bc028c3e87755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:38.584581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.586018 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.587838 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 885/1769] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:38 2021] DELETE /identity/v3/projects/74f805b038f64c64830bc028c3e87755 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:38.591504 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:38.593185 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:38.635335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd704c7-7b8b-4700-b017-95c6f24deac8 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:38.668817 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e4fe1-251a-45f6-bdc3-d0c7934febe6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:38.674187 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc227cb3-c53c-4a30-95b7-93319f2dfac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:38.675171 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc227cb3-c53c-4a30-95b7-93319f2dfac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:38.675536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc227cb3-c53c-4a30-95b7-93319f2dfac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:38.675893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc227cb3-c53c-4a30-95b7-93319f2dfac9 admin admin] PATH_INFO: `/v3/users/47ca5989bda54452bbd11132879e7c8b` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:38.677218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc227cb3-c53c-4a30-95b7-93319f2dfac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ca5989bda54452bbd11132879e7c8b)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:38.679440 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc227cb3-c53c-4a30-95b7-93319f2dfac9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:38.693750 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cf91c-e8ab-48e9-b74e-608cfb821f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:38.695656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cf91c-e8ab-48e9-b74e-608cfb821f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:38.695970 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cf91c-e8ab-48e9-b74e-608cfb821f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:38.696303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cf91c-e8ab-48e9-b74e-608cfb821f48 admin admin] PATH_INFO: `/v3/users/c096e62111474dafbb7da5fccbc5a90e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:38.697881 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cf91c-e8ab-48e9-b74e-608cfb821f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c096e62111474dafbb7da5fccbc5a90e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:38.699979 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cf91c-e8ab-48e9-b74e-608cfb821f48 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:38.732726 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-fc227cb3-c53c-4a30-95b7-93319f2dfac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ca5989bda54452bbd11132879e7c8b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.741220 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-fc227cb3-c53c-4a30-95b7-93319f2dfac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ca5989bda54452bbd11132879e7c8b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.751586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-fc227cb3-c53c-4a30-95b7-93319f2dfac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ca5989bda54452bbd11132879e7c8b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.752940 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a66cf91c-e8ab-48e9-b74e-608cfb821f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c096e62111474dafbb7da5fccbc5a90e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.761369 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a66cf91c-e8ab-48e9-b74e-608cfb821f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c096e62111474dafbb7da5fccbc5a90e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.762216 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a66cf91c-e8ab-48e9-b74e-608cfb821f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c096e62111474dafbb7da5fccbc5a90e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.770285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-fc227cb3-c53c-4a30-95b7-93319f2dfac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ca5989bda54452bbd11132879e7c8b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.771305 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-fc227cb3-c53c-4a30-95b7-93319f2dfac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ca5989bda54452bbd11132879e7c8b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.776097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a66cf91c-e8ab-48e9-b74e-608cfb821f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c096e62111474dafbb7da5fccbc5a90e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.777556 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a66cf91c-e8ab-48e9-b74e-608cfb821f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c096e62111474dafbb7da5fccbc5a90e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:38.781480 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 886/1770] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:38 2021] DELETE /identity/v3/users/47ca5989bda54452bbd11132879e7c8b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:32:38.798150 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 885/1771] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:38 2021] DELETE /identity/v3/users/c096e62111474dafbb7da5fccbc5a90e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:39.186347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc227cb3-c53c-4a30-95b7-93319f2dfac9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:39.187951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-fc227cb3-c53c-4a30-95b7-93319f2dfac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:39.227423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cf91c-e8ab-48e9-b74e-608cfb821f48 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:39.228964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a66cf91c-e8ab-48e9-b74e-608cfb821f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:39.310124 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cf91c-e8ab-48e9-b74e-608cfb821f48 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:39.314780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:39.315674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:39.315956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:39.316234 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] PATH_INFO: `/v3/projects/f5b03c6a07414ed0adc628acfd2718ac` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:39.317413 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b03c6a07414ed0adc628acfd2718ac)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:39.319791 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:39.339508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc227cb3-c53c-4a30-95b7-93319f2dfac9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:39.344457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:39.345616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:39.346007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:39.346359 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac admin admin] PATH_INFO: `/v3/projects/cba3190797d54c11b30220f84c593a7e` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:39.347951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba3190797d54c11b30220f84c593a7e)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:39.351387 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:39.370704 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b03c6a07414ed0adc628acfd2718ac', 'request_id': 'req-9898d16c-d6d3-46dd-8e27-4be0b2690de0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.379777 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b03c6a07414ed0adc628acfd2718ac', 'request_id': 'req-9898d16c-d6d3-46dd-8e27-4be0b2690de0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.387739 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b03c6a07414ed0adc628acfd2718ac', 'request_id': 'req-9898d16c-d6d3-46dd-8e27-4be0b2690de0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.403249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] The token cache is being invalidate because project f5b03c6a07414ed0adc628acfd2718ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:39.403432 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba3190797d54c11b30220f84c593a7e', 'request_id': 'req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.403839 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.405408 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.408912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 886/1772] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:39 2021] DELETE /identity/v3/projects/f5b03c6a07414ed0adc628acfd2718ac => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:39.410225 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba3190797d54c11b30220f84c593a7e', 'request_id': 'req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.412574 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:39.415803 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:39.421225 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba3190797d54c11b30220f84c593a7e', 'request_id': 'req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.434795 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac admin admin] The token cache is being invalidate because project cba3190797d54c11b30220f84c593a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:39.435786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.436733 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6fe585f4-f1f3-44a0-ac84-c686fcd07cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.439069 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 887/1773] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:39 2021] DELETE /identity/v3/projects/cba3190797d54c11b30220f84c593a7e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:39.451877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b6d43-f21e-4b58-91d0-bf830476da6b None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:39.452227 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b6d43-f21e-4b58-91d0-bf830476da6b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:39.453101 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b6d43-f21e-4b58-91d0-bf830476da6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:39.482092 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-b34b6d43-f21e-4b58-91d0-bf830476da6b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:39.483527 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-b34b6d43-f21e-4b58-91d0-bf830476da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:39.541392 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898d16c-d6d3-46dd-8e27-4be0b2690de0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:39.587308 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 888/1774] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:39.589628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db863ece-5e38-4def-b825-aca4434614c7 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:39.590603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db863ece-5e38-4def-b825-aca4434614c7 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:39.591096 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db863ece-5e38-4def-b825-aca4434614c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:39.635905 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-db863ece-5e38-4def-b825-aca4434614c7 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:39.639131 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-db863ece-5e38-4def-b825-aca4434614c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:39.651203 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 889/1775] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:39.654830 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db863ece-5e38-4def-b825-aca4434614c7 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:39.667251 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db863ece-5e38-4def-b825-aca4434614c7 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:39.668399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418163f-4048-40b5-8695-02902ae6cb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:39.669428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418163f-4048-40b5-8695-02902ae6cb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:39.669724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418163f-4048-40b5-8695-02902ae6cb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:39.670004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418163f-4048-40b5-8695-02902ae6cb5f admin admin] PATH_INFO: `/v3/users/00725a9f0aa24180bf0624c456c2d7eb` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:39.671519 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418163f-4048-40b5-8695-02902ae6cb5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=00725a9f0aa24180bf0624c456c2d7eb)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:39.673743 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845a161-0bb0-44c1-acf2-8c27277837c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:39.673877 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418163f-4048-40b5-8695-02902ae6cb5f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:39.674726 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845a161-0bb0-44c1-acf2-8c27277837c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:39.675190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845a161-0bb0-44c1-acf2-8c27277837c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:39.675469 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845a161-0bb0-44c1-acf2-8c27277837c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:39.676198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845a161-0bb0-44c1-acf2-8c27277837c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:32:39.676506 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845a161-0bb0-44c1-acf2-8c27277837c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:39.678167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845a161-0bb0-44c1-acf2-8c27277837c7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:39.691248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 890/1776] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:32:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:32:39.691968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845a161-0bb0-44c1-acf2-8c27277837c7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:39.693841 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8845a161-0bb0-44c1-acf2-8c27277837c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:39.707030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845a161-0bb0-44c1-acf2-8c27277837c7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:39.712971 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36637387-6cae-48b0-8aae-ab49bacb4e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:39.714358 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36637387-6cae-48b0-8aae-ab49bacb4e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:39.714358 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36637387-6cae-48b0-8aae-ab49bacb4e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:39.714586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36637387-6cae-48b0-8aae-ab49bacb4e90 admin admin] PATH_INFO: `/v3/users/e1e94038f1ec444f804362d52e797429` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:39.715799 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36637387-6cae-48b0-8aae-ab49bacb4e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e94038f1ec444f804362d52e797429)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:39.717879 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36637387-6cae-48b0-8aae-ab49bacb4e90 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:39.733093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-0418163f-4048-40b5-8695-02902ae6cb5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00725a9f0aa24180bf0624c456c2d7eb'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.739866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-0418163f-4048-40b5-8695-02902ae6cb5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00725a9f0aa24180bf0624c456c2d7eb'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.740627 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-0418163f-4048-40b5-8695-02902ae6cb5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00725a9f0aa24180bf0624c456c2d7eb'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.752992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-0418163f-4048-40b5-8695-02902ae6cb5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00725a9f0aa24180bf0624c456c2d7eb'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.753832 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-0418163f-4048-40b5-8695-02902ae6cb5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00725a9f0aa24180bf0624c456c2d7eb'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.765203 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-36637387-6cae-48b0-8aae-ab49bacb4e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e94038f1ec444f804362d52e797429'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.766813 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 887/1777] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:39 2021] DELETE /identity/v3/users/00725a9f0aa24180bf0624c456c2d7eb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:39.769716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418163f-4048-40b5-8695-02902ae6cb5f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:39.769716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0418163f-4048-40b5-8695-02902ae6cb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:39.780559 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-36637387-6cae-48b0-8aae-ab49bacb4e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e94038f1ec444f804362d52e797429'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.790023 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-36637387-6cae-48b0-8aae-ab49bacb4e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e94038f1ec444f804362d52e797429'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.808688 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-36637387-6cae-48b0-8aae-ab49bacb4e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e94038f1ec444f804362d52e797429'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.809916 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-36637387-6cae-48b0-8aae-ab49bacb4e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e94038f1ec444f804362d52e797429'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:39.816999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 891/1778] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:39 2021] DELETE /identity/v3/users/e1e94038f1ec444f804362d52e797429 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:39.822041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7bbf7-3b21-467c-9c3f-aff4a345e39a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:39.822693 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7bbf7-3b21-467c-9c3f-aff4a345e39a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:39.822693 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7bbf7-3b21-467c-9c3f-aff4a345e39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:39.838989 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418163f-4048-40b5-8695-02902ae6cb5f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:39.843326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-46f7bbf7-3b21-467c-9c3f-aff4a345e39a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:39.844652 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-46f7bbf7-3b21-467c-9c3f-aff4a345e39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:39.900285 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06051bac-2622-4ba4-bf77-d6fcb120eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:39.900964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06051bac-2622-4ba4-bf77-d6fcb120eaaa admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:39.901249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06051bac-2622-4ba4-bf77-d6fcb120eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:39.901659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06051bac-2622-4ba4-bf77-d6fcb120eaaa admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:39.902249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06051bac-2622-4ba4-bf77-d6fcb120eaaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:39.904249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06051bac-2622-4ba4-bf77-d6fcb120eaaa admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:39.914077 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 892/1779] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:39.929545 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7bbf7-3b21-467c-9c3f-aff4a345e39a None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:39.933312 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-46f7bbf7-3b21-467c-9c3f-aff4a345e39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:39.941026 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 888/1780] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:39 2021] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:39.946124 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06051bac-2622-4ba4-bf77-d6fcb120eaaa admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:39.952142 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-06051bac-2622-4ba4-bf77-d6fcb120eaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:39.997393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7bbf7-3b21-467c-9c3f-aff4a345e39a None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.027601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06051bac-2622-4ba4-bf77-d6fcb120eaaa admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.035895 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da6b01-b95d-4cb3-b74e-b58ef7dfdbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.036689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da6b01-b95d-4cb3-b74e-b58ef7dfdbc8 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.036977 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da6b01-b95d-4cb3-b74e-b58ef7dfdbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.037311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da6b01-b95d-4cb3-b74e-b58ef7dfdbc8 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.038239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da6b01-b95d-4cb3-b74e-b58ef7dfdbc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.040400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da6b01-b95d-4cb3-b74e-b58ef7dfdbc8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.053667 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7579f-5550-46d2-87dd-ce4692428fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.054458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7579f-5550-46d2-87dd-ce4692428fdd service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.054684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7579f-5550-46d2-87dd-ce4692428fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.055033 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7579f-5550-46d2-87dd-ce4692428fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.063245 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 889/1781] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:39 2021] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:32:40.064840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da6b01-b95d-4cb3-b74e-b58ef7dfdbc8 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:40.068407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-33da6b01-b95d-4cb3-b74e-b58ef7dfdbc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:40.070691 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7579f-5550-46d2-87dd-ce4692428fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.072444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7579f-5550-46d2-87dd-ce4692428fdd service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.081958 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da6b01-b95d-4cb3-b74e-b58ef7dfdbc8 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.087071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 893/1782] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:40.087473 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123fd28-394f-4c97-97dd-7adc41a294b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.087921 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7579f-5550-46d2-87dd-ce4692428fdd service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:40.088348 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123fd28-394f-4c97-97dd-7adc41a294b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.088746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123fd28-394f-4c97-97dd-7adc41a294b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.089032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123fd28-394f-4c97-97dd-7adc41a294b6 admin admin] PATH_INFO: `/v3/projects/cfa3a50d1a434ca786351515793661c7` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.090249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123fd28-394f-4c97-97dd-7adc41a294b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa3a50d1a434ca786351515793661c7)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.092205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123fd28-394f-4c97-97dd-7adc41a294b6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.097368 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7579f-5550-46d2-87dd-ce4692428fdd service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.103951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ac019-521d-42d5-a40f-125da04741ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.104629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ac019-521d-42d5-a40f-125da04741ca admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.104931 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ac019-521d-42d5-a40f-125da04741ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.105188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ac019-521d-42d5-a40f-125da04741ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.105959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ac019-521d-42d5-a40f-125da04741ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.107557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ac019-521d-42d5-a40f-125da04741ca admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.122303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 894/1783] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:40 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:40.123260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ac019-521d-42d5-a40f-125da04741ca admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:40.133593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ac019-521d-42d5-a40f-125da04741ca admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.143529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a123fd28-394f-4c97-97dd-7adc41a294b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa3a50d1a434ca786351515793661c7', 'request_id': 'req-a123fd28-394f-4c97-97dd-7adc41a294b6'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.149604 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a123fd28-394f-4c97-97dd-7adc41a294b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa3a50d1a434ca786351515793661c7', 'request_id': 'req-a123fd28-394f-4c97-97dd-7adc41a294b6'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.156707 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a123fd28-394f-4c97-97dd-7adc41a294b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa3a50d1a434ca786351515793661c7', 'request_id': 'req-a123fd28-394f-4c97-97dd-7adc41a294b6'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.172346 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a123fd28-394f-4c97-97dd-7adc41a294b6 admin admin] The token cache is being invalidate because project cfa3a50d1a434ca786351515793661c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:40.172866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a123fd28-394f-4c97-97dd-7adc41a294b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.173541 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a123fd28-394f-4c97-97dd-7adc41a294b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.181135 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 890/1784] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:40 2021] DELETE /identity/v3/projects/cfa3a50d1a434ca786351515793661c7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:40.183584 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb976eea-78ec-44f1-99b9-493b6bc19edf None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.183584 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb976eea-78ec-44f1-99b9-493b6bc19edf None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.183974 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb976eea-78ec-44f1-99b9-493b6bc19edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.196709 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2339e-e777-4c5a-8e02-700bda5b3002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.197578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2339e-e777-4c5a-8e02-700bda5b3002 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.197991 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2339e-e777-4c5a-8e02-700bda5b3002 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.198376 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2339e-e777-4c5a-8e02-700bda5b3002 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.199334 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2339e-e777-4c5a-8e02-700bda5b3002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.201522 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2339e-e777-4c5a-8e02-700bda5b3002 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.208972 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-bb976eea-78ec-44f1-99b9-493b6bc19edf None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:40.211893 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-bb976eea-78ec-44f1-99b9-493b6bc19edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:40.213447 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 895/1785] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:40 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:40.217759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2339e-e777-4c5a-8e02-700bda5b3002 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:40.219658 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-52a2339e-e777-4c5a-8e02-700bda5b3002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:40.231103 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 891/1786] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:32:40.233422 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2339e-e777-4c5a-8e02-700bda5b3002 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.234934 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb328fb-a281-4333-ab95-1c30d98d51e3 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.240636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27af8a-49a5-4e83-bf23-5944f60696b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.242471 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb328fb-a281-4333-ab95-1c30d98d51e3 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.242712 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27af8a-49a5-4e83-bf23-5944f60696b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.243046 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb328fb-a281-4333-ab95-1c30d98d51e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.243348 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27af8a-49a5-4e83-bf23-5944f60696b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.243849 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27af8a-49a5-4e83-bf23-5944f60696b7 admin admin] PATH_INFO: `/v3/projects/527d4912ba674e9397a95ac169009931/users/45b5e858be954c6e873e0fdc6fd33866/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.265597 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27af8a-49a5-4e83-bf23-5944f60696b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527d4912ba674e9397a95ac169009931, user_id=45b5e858be954c6e873e0fdc6fd33866, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.270108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27af8a-49a5-4e83-bf23-5944f60696b7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.289373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-7fb328fb-a281-4333-ab95-1c30d98d51e3 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:40.291010 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7fb328fb-a281-4333-ab95-1c30d98d51e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:40.293313 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 896/1787] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:40 2021] PUT /identity/v3/projects/527d4912ba674e9397a95ac169009931/users/45b5e858be954c6e873e0fdc6fd33866/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:40.304516 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495b01-b26f-490f-a061-59d8a27641ed None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.304763 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495b01-b26f-490f-a061-59d8a27641ed None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.305049 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495b01-b26f-490f-a061-59d8a27641ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.333342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-ac495b01-b26f-490f-a061-59d8a27641ed None None] MFA Rules not processed for user `45b5e858be954c6e873e0fdc6fd33866`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:40.334116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ac495b01-b26f-490f-a061-59d8a27641ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:40.361255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 892/1788] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:32:40.365537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb328fb-a281-4333-ab95-1c30d98d51e3 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:40.374932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb328fb-a281-4333-ab95-1c30d98d51e3 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.379952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb600db-6837-4a04-b158-6f5af4f6e5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.380800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb600db-6837-4a04-b158-6f5af4f6e5ba admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.381091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb600db-6837-4a04-b158-6f5af4f6e5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.381433 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb600db-6837-4a04-b158-6f5af4f6e5ba admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.382459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb600db-6837-4a04-b158-6f5af4f6e5ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:32:40.382775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb600db-6837-4a04-b158-6f5af4f6e5ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.384441 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb600db-6837-4a04-b158-6f5af4f6e5ba admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.408330 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 897/1789] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:40 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:40.412276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 893/1790] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:32:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:32:40.414747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac495b01-b26f-490f-a061-59d8a27641ed None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:40.419425 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb600db-6837-4a04-b158-6f5af4f6e5ba admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:40.421806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-cbb600db-6837-4a04-b158-6f5af4f6e5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:40.426260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac495b01-b26f-490f-a061-59d8a27641ed None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.432553 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dce9f4-9aa8-4445-abe7-f4224e81a083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.433064 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce9f4-9aa8-4445-abe7-f4224e81a083 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.433392 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce9f4-9aa8-4445-abe7-f4224e81a083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.433676 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce9f4-9aa8-4445-abe7-f4224e81a083 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.434369 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dce9f4-9aa8-4445-abe7-f4224e81a083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.436554 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dce9f4-9aa8-4445-abe7-f4224e81a083 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.464924 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 898/1791] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:40 2021] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:40.468986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dce9f4-9aa8-4445-abe7-f4224e81a083 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:40.470793 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-b9dce9f4-9aa8-4445-abe7-f4224e81a083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:40.489954 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb600db-6837-4a04-b158-6f5af4f6e5ba admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.538621 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dce9f4-9aa8-4445-abe7-f4224e81a083 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.539991 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882f74f-4375-496b-a529-3587f6f2946c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.540746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882f74f-4375-496b-a529-3587f6f2946c service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.541038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882f74f-4375-496b-a529-3587f6f2946c service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.541317 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882f74f-4375-496b-a529-3587f6f2946c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.543507 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.544371 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.544660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.544943 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] PATH_INFO: `/v3/projects/65ef03525d854bc7a4c64fd687607197` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.546158 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ef03525d854bc7a4c64fd687607197)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.548113 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.593034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ef03525d854bc7a4c64fd687607197', 'request_id': 'req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.595607 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882f74f-4375-496b-a529-3587f6f2946c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.597055 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882f74f-4375-496b-a529-3587f6f2946c service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.599144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ef03525d854bc7a4c64fd687607197', 'request_id': 'req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.607762 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 894/1792] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:40 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:32:40.608549 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882f74f-4375-496b-a529-3587f6f2946c service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:40.611643 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ef03525d854bc7a4c64fd687607197', 'request_id': 'req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.619001 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882f74f-4375-496b-a529-3587f6f2946c service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.624653 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] The token cache is being invalidate because project 65ef03525d854bc7a4c64fd687607197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:40.625057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.625800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.627585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 899/1793] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:40 2021] DELETE /identity/v3/projects/65ef03525d854bc7a4c64fd687607197 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:40.631788 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:40.633627 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:40.682068 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3717f-84c4-4ce3-a94e-c36634bdeb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.682747 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3717f-84c4-4ce3-a94e-c36634bdeb9a admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.683063 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3717f-84c4-4ce3-a94e-c36634bdeb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.683342 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3717f-84c4-4ce3-a94e-c36634bdeb9a admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.684644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3717f-84c4-4ce3-a94e-c36634bdeb9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.686038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3717f-84c4-4ce3-a94e-c36634bdeb9a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.713487 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4af4d-77f0-4d5d-8eff-7b2b1b360daa admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.714574 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 895/1794] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:40 2021] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:40.715542 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3717f-84c4-4ce3-a94e-c36634bdeb9a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:40.717497 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8dc3717f-84c4-4ce3-a94e-c36634bdeb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:40.718672 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8865fb-e4c6-4fda-8472-60ad09d51a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.719584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8865fb-e4c6-4fda-8472-60ad09d51a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.719866 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8865fb-e4c6-4fda-8472-60ad09d51a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.720144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8865fb-e4c6-4fda-8472-60ad09d51a81 admin admin] PATH_INFO: `/v3/users/e8a5d2f953a945ac8808d461cfb1828d` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.721358 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8865fb-e4c6-4fda-8472-60ad09d51a81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a5d2f953a945ac8808d461cfb1828d)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.723443 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8865fb-e4c6-4fda-8472-60ad09d51a81 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.739488 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3717f-84c4-4ce3-a94e-c36634bdeb9a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.746219 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8379f-2717-4415-8d86-6a4a75efcfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.751092 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8379f-2717-4415-8d86-6a4a75efcfcc admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.751945 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8379f-2717-4415-8d86-6a4a75efcfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.752249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8379f-2717-4415-8d86-6a4a75efcfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.753927 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8379f-2717-4415-8d86-6a4a75efcfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.755928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8379f-2717-4415-8d86-6a4a75efcfcc admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.770589 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 896/1795] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:40 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:40.778212 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8379f-2717-4415-8d86-6a4a75efcfcc admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:40.793448 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8379f-2717-4415-8d86-6a4a75efcfcc admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.799267 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cbeed-6481-4722-a827-9e196384c4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.800097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cbeed-6481-4722-a827-9e196384c4ed admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.800469 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cbeed-6481-4722-a827-9e196384c4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.801004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cbeed-6481-4722-a827-9e196384c4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.801844 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cbeed-6481-4722-a827-9e196384c4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.801985 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ba8865fb-e4c6-4fda-8472-60ad09d51a81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a5d2f953a945ac8808d461cfb1828d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.804207 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cbeed-6481-4722-a827-9e196384c4ed admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.811513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ba8865fb-e4c6-4fda-8472-60ad09d51a81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a5d2f953a945ac8808d461cfb1828d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.817188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 897/1796] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:40 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:32:40.823459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cbeed-6481-4722-a827-9e196384c4ed admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:40.824297 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ba8865fb-e4c6-4fda-8472-60ad09d51a81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a5d2f953a945ac8808d461cfb1828d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.840190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ba8865fb-e4c6-4fda-8472-60ad09d51a81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a5d2f953a945ac8808d461cfb1828d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.841268 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ba8865fb-e4c6-4fda-8472-60ad09d51a81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a5d2f953a945ac8808d461cfb1828d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:40.842688 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cbeed-6481-4722-a827-9e196384c4ed admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:40.849087 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 900/1797] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:40 2021] DELETE /identity/v3/users/e8a5d2f953a945ac8808d461cfb1828d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:32:40.854668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15958cb-ff53-458b-b5c6-0d6261cfb673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:40.855824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15958cb-ff53-458b-b5c6-0d6261cfb673 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.856268 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15958cb-ff53-458b-b5c6-0d6261cfb673 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.856738 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15958cb-ff53-458b-b5c6-0d6261cfb673 admin admin] PATH_INFO: `/v3/projects/d37d398ce8404717ba05b81f887372da/users/ac4522227010405f8240fe61ad589d88/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.885838 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15958cb-ff53-458b-b5c6-0d6261cfb673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37d398ce8404717ba05b81f887372da, user_id=ac4522227010405f8240fe61ad589d88, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:40.889506 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15958cb-ff53-458b-b5c6-0d6261cfb673 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:40.911431 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 898/1798] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:40 2021] PUT /identity/v3/projects/d37d398ce8404717ba05b81f887372da/users/ac4522227010405f8240fe61ad589d88/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:32:40.924428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2d96-c9c0-4298-857b-9dfb9b7466dc None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:40.924809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2d96-c9c0-4298-857b-9dfb9b7466dc None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:40.925189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2d96-c9c0-4298-857b-9dfb9b7466dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:40.966879 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-459c2d96-c9c0-4298-857b-9dfb9b7466dc None None] MFA Rules not processed for user `ac4522227010405f8240fe61ad589d88`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:40.968243 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-459c2d96-c9c0-4298-857b-9dfb9b7466dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:41.057379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 901/1799] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:40 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:41.061875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15958cb-ff53-458b-b5c6-0d6261cfb673 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.063766 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c15958cb-ff53-458b-b5c6-0d6261cfb673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:41.128782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15958cb-ff53-458b-b5c6-0d6261cfb673 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:41.134216 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984032c-a515-4b00-8713-b95dc2c81ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:41.134920 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984032c-a515-4b00-8713-b95dc2c81ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.135211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984032c-a515-4b00-8713-b95dc2c81ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.135488 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984032c-a515-4b00-8713-b95dc2c81ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.136247 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984032c-a515-4b00-8713-b95dc2c81ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:41.138120 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984032c-a515-4b00-8713-b95dc2c81ca7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:41.168240 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 899/1800] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:41 2021] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:32:41.169376 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984032c-a515-4b00-8713-b95dc2c81ca7 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.169509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c2d96-c9c0-4298-857b-9dfb9b7466dc None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.171320 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-459c2d96-c9c0-4298-857b-9dfb9b7466dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:41.186477 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c2d96-c9c0-4298-857b-9dfb9b7466dc None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:41.232219 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984032c-a515-4b00-8713-b95dc2c81ca7 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:41.237066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272dcaf-13a7-4d6f-8a72-3f8029197349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:41.238206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272dcaf-13a7-4d6f-8a72-3f8029197349 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.238495 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272dcaf-13a7-4d6f-8a72-3f8029197349 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.238770 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272dcaf-13a7-4d6f-8a72-3f8029197349 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.239489 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272dcaf-13a7-4d6f-8a72-3f8029197349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:41.241919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272dcaf-13a7-4d6f-8a72-3f8029197349 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:41.250475 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0b784-bbeb-4f69-856b-223d8286a7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:41.251374 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b784-bbeb-4f69-856b-223d8286a7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.251660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b784-bbeb-4f69-856b-223d8286a7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.251944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b784-bbeb-4f69-856b-223d8286a7f5 admin admin] PATH_INFO: `/v3/projects/60efb185cfc8409aa05ed95d06b2b7f1` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.253237 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0b784-bbeb-4f69-856b-223d8286a7f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60efb185cfc8409aa05ed95d06b2b7f1)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:41.255405 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0b784-bbeb-4f69-856b-223d8286a7f5 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:41.265153 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 900/1801] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:41 2021] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:41.269139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272dcaf-13a7-4d6f-8a72-3f8029197349 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.280771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272dcaf-13a7-4d6f-8a72-3f8029197349 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:41.286155 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9158e2c-7cf7-4adc-9c5c-64ac4ede1c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:41.287004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9158e2c-7cf7-4adc-9c5c-64ac4ede1c7b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.288713 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9158e2c-7cf7-4adc-9c5c-64ac4ede1c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.289347 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9158e2c-7cf7-4adc-9c5c-64ac4ede1c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.290176 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9158e2c-7cf7-4adc-9c5c-64ac4ede1c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:41.292042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9158e2c-7cf7-4adc-9c5c-64ac4ede1c7b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:41.303250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 901/1802] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:41 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:32:41.307110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9158e2c-7cf7-4adc-9c5c-64ac4ede1c7b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.308875 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0cd0b784-bbeb-4f69-856b-223d8286a7f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60efb185cfc8409aa05ed95d06b2b7f1', 'request_id': 'req-0cd0b784-bbeb-4f69-856b-223d8286a7f5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:41.315078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0cd0b784-bbeb-4f69-856b-223d8286a7f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60efb185cfc8409aa05ed95d06b2b7f1', 'request_id': 'req-0cd0b784-bbeb-4f69-856b-223d8286a7f5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:41.316821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9158e2c-7cf7-4adc-9c5c-64ac4ede1c7b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:41.324108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0cd0b784-bbeb-4f69-856b-223d8286a7f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60efb185cfc8409aa05ed95d06b2b7f1', 'request_id': 'req-0cd0b784-bbeb-4f69-856b-223d8286a7f5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:41.336232 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0cd0b784-bbeb-4f69-856b-223d8286a7f5 admin admin] The token cache is being invalidate because project 60efb185cfc8409aa05ed95d06b2b7f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:41.336553 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0cd0b784-bbeb-4f69-856b-223d8286a7f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:41.337264 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0cd0b784-bbeb-4f69-856b-223d8286a7f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:41.338877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 902/1803] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:41 2021] DELETE /identity/v3/projects/60efb185cfc8409aa05ed95d06b2b7f1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:41.346172 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3ab21-e312-4af9-a0ce-1a28c5764874 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.346548 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3ab21-e312-4af9-a0ce-1a28c5764874 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.346932 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3ab21-e312-4af9-a0ce-1a28c5764874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.369628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-88c3ab21-e312-4af9-a0ce-1a28c5764874 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:41.370974 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-88c3ab21-e312-4af9-a0ce-1a28c5764874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:41.377169 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9194e-9eaf-40f9-a5b8-7dd680d1be01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:41.378075 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9194e-9eaf-40f9-a5b8-7dd680d1be01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.378338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9194e-9eaf-40f9-a5b8-7dd680d1be01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.378613 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9194e-9eaf-40f9-a5b8-7dd680d1be01 admin admin] PATH_INFO: `/v3/projects/fc5d0ec46acd41918bc66c73eb490c6e/users/551c07c39ac248f38993f00f8ab189be/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.392850 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9194e-9eaf-40f9-a5b8-7dd680d1be01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5d0ec46acd41918bc66c73eb490c6e, user_id=551c07c39ac248f38993f00f8ab189be, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:41.395482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9194e-9eaf-40f9-a5b8-7dd680d1be01 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:41.409400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 902/1804] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:41 2021] PUT /identity/v3/projects/fc5d0ec46acd41918bc66c73eb490c6e/users/551c07c39ac248f38993f00f8ab189be/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:32:41.414153 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9194e-9eaf-40f9-a5b8-7dd680d1be01 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.415863 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e0b9194e-9eaf-40f9-a5b8-7dd680d1be01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:41.428578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 903/1805] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:32:41.436173 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3381b-62b0-4fd2-8e53-b164656b6275 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.436467 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3381b-62b0-4fd2-8e53-b164656b6275 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.436744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3381b-62b0-4fd2-8e53-b164656b6275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.453810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-40d3381b-62b0-4fd2-8e53-b164656b6275 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:41.455300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-40d3381b-62b0-4fd2-8e53-b164656b6275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:41.478350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9194e-9eaf-40f9-a5b8-7dd680d1be01 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:41.483126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952fb53-eb84-4eca-858e-724cf2167a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:41.483794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952fb53-eb84-4eca-858e-724cf2167a89 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.484079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952fb53-eb84-4eca-858e-724cf2167a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.484367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952fb53-eb84-4eca-858e-724cf2167a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.485106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952fb53-eb84-4eca-858e-724cf2167a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:41.486682 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952fb53-eb84-4eca-858e-724cf2167a89 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:41.496574 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 903/1806] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:41 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:32:41.500671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952fb53-eb84-4eca-858e-724cf2167a89 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.510587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952fb53-eb84-4eca-858e-724cf2167a89 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:41.515360 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2b840-87e4-403f-8e84-4027c6a56d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:41.515912 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 904/1807] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:32:41.516226 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2b840-87e4-403f-8e84-4027c6a56d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.516515 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2b840-87e4-403f-8e84-4027c6a56d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.516795 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2b840-87e4-403f-8e84-4027c6a56d9e admin admin] PATH_INFO: `/v3/projects/fc5d0ec46acd41918bc66c73eb490c6e/users/551c07c39ac248f38993f00f8ab189be/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.518801 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2b840-87e4-403f-8e84-4027c6a56d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5d0ec46acd41918bc66c73eb490c6e, user_id=551c07c39ac248f38993f00f8ab189be, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:41.519855 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3381b-62b0-4fd2-8e53-b164656b6275 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.521732 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2b840-87e4-403f-8e84-4027c6a56d9e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:41.530050 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3381b-62b0-4fd2-8e53-b164656b6275 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:41.534523 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 904/1808] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:41 2021] PUT /identity/v3/projects/fc5d0ec46acd41918bc66c73eb490c6e/users/551c07c39ac248f38993f00f8ab189be/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:32:41.544957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93fb49-0109-488a-9e6c-1771dc044dd4 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.545256 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93fb49-0109-488a-9e6c-1771dc044dd4 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.545540 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93fb49-0109-488a-9e6c-1771dc044dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.576667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-ce93fb49-0109-488a-9e6c-1771dc044dd4 None None] MFA Rules not processed for user `551c07c39ac248f38993f00f8ab189be`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:41.577975 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ce93fb49-0109-488a-9e6c-1771dc044dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:41.588586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10184875-53a3-404b-959b-d7ba883de5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:41.589294 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10184875-53a3-404b-959b-d7ba883de5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.589535 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10184875-53a3-404b-959b-d7ba883de5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.589813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10184875-53a3-404b-959b-d7ba883de5c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.590662 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10184875-53a3-404b-959b-d7ba883de5c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:32:41.591011 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10184875-53a3-404b-959b-d7ba883de5c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:41.592635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10184875-53a3-404b-959b-d7ba883de5c9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:41.610740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 905/1809] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:32:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:32:41.612340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10184875-53a3-404b-959b-d7ba883de5c9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.626576 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10184875-53a3-404b-959b-d7ba883de5c9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:41.633528 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17f062-4716-4e2a-b446-0b86e578fcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:41.634466 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17f062-4716-4e2a-b446-0b86e578fcb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.635107 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17f062-4716-4e2a-b446-0b86e578fcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.635394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17f062-4716-4e2a-b446-0b86e578fcb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.636107 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17f062-4716-4e2a-b446-0b86e578fcb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:41.638451 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17f062-4716-4e2a-b446-0b86e578fcb3 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:41.657061 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 905/1810] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:41 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:41.668790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93fb49-0109-488a-9e6c-1771dc044dd4 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.670197 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ce93fb49-0109-488a-9e6c-1771dc044dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:41.676458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 906/1811] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:41 2021] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:41.677465 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17f062-4716-4e2a-b446-0b86e578fcb3 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.730199 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93fb49-0109-488a-9e6c-1771dc044dd4 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:41.741427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17f062-4716-4e2a-b446-0b86e578fcb3 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:41.746336 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8f963-ec8d-438b-a758-6e976055a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:41.746973 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8f963-ec8d-438b-a758-6e976055a9fe admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.747263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8f963-ec8d-438b-a758-6e976055a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.747540 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8f963-ec8d-438b-a758-6e976055a9fe admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.748229 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8f963-ec8d-438b-a758-6e976055a9fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:41.750129 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8f963-ec8d-438b-a758-6e976055a9fe admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:41.770855 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 907/1812] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:41 2021] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:41.776232 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8f963-ec8d-438b-a758-6e976055a9fe admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.783349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1405b-3ecd-4c98-88dc-19d310a44381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:41.784133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1405b-3ecd-4c98-88dc-19d310a44381 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.784426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1405b-3ecd-4c98-88dc-19d310a44381 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.784735 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1405b-3ecd-4c98-88dc-19d310a44381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.785745 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8f963-ec8d-438b-a758-6e976055a9fe admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:41.790727 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb59781-adf8-4e89-a9cf-aa3597ab6491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:41.791402 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb59781-adf8-4e89-a9cf-aa3597ab6491 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.791690 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb59781-adf8-4e89-a9cf-aa3597ab6491 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.791972 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb59781-adf8-4e89-a9cf-aa3597ab6491 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.792693 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb59781-adf8-4e89-a9cf-aa3597ab6491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:41.794317 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb59781-adf8-4e89-a9cf-aa3597ab6491 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:41.804631 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 908/1813] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:32:41.808575 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb59781-adf8-4e89-a9cf-aa3597ab6491 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.818050 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb59781-adf8-4e89-a9cf-aa3597ab6491 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:41.823673 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817664f9-f88d-4982-a235-ccc37624b33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:41.824306 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817664f9-f88d-4982-a235-ccc37624b33d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.824587 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817664f9-f88d-4982-a235-ccc37624b33d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.824869 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817664f9-f88d-4982-a235-ccc37624b33d admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.825570 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817664f9-f88d-4982-a235-ccc37624b33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:41.827167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817664f9-f88d-4982-a235-ccc37624b33d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:41.838136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 909/1814] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:32:41.842154 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817664f9-f88d-4982-a235-ccc37624b33d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.843851 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1405b-3ecd-4c98-88dc-19d310a44381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:41.845312 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1405b-3ecd-4c98-88dc-19d310a44381 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:41.852399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817664f9-f88d-4982-a235-ccc37624b33d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:41.855587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 906/1815] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:41 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:32:41.857409 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10ed9e-0503-4984-a566-b314f359a947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:41.858316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10ed9e-0503-4984-a566-b314f359a947 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.858622 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10ed9e-0503-4984-a566-b314f359a947 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.858935 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10ed9e-0503-4984-a566-b314f359a947 admin admin] PATH_INFO: `/v3/projects/a2e2ff8803f54646bfc2d2412b42a919/users/ffeec23a6fb143a1aed43041e9c78417/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.874285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10ed9e-0503-4984-a566-b314f359a947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e2ff8803f54646bfc2d2412b42a919, user_id=ffeec23a6fb143a1aed43041e9c78417, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:41.876989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10ed9e-0503-4984-a566-b314f359a947 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:41.891675 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 910/1816] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:41 2021] PUT /identity/v3/projects/a2e2ff8803f54646bfc2d2412b42a919/users/ffeec23a6fb143a1aed43041e9c78417/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:32:41.902231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec9ab6-c6a5-42bb-a3f5-ba18e7bd1738 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:41.902544 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec9ab6-c6a5-42bb-a3f5-ba18e7bd1738 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:41.902802 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec9ab6-c6a5-42bb-a3f5-ba18e7bd1738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:41.928865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10ed9e-0503-4984-a566-b314f359a947 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:41.939042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-cfec9ab6-c6a5-42bb-a3f5-ba18e7bd1738 None None] MFA Rules not processed for user `ffeec23a6fb143a1aed43041e9c78417`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:41.940421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-cfec9ab6-c6a5-42bb-a3f5-ba18e7bd1738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:41.997111 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10ed9e-0503-4984-a566-b314f359a947 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:42.002092 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d69f6-b77b-490b-b5cb-0d3a8b775612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:42.002825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d69f6-b77b-490b-b5cb-0d3a8b775612 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.003254 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d69f6-b77b-490b-b5cb-0d3a8b775612 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.003607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d69f6-b77b-490b-b5cb-0d3a8b775612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.005541 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2b7d69f6-b77b-490b-b5cb-0d3a8b775612 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:42.013998 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 907/1817] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:41 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:42.019029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec9ab6-c6a5-42bb-a3f5-ba18e7bd1738 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:42.079948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d69f6-b77b-490b-b5cb-0d3a8b775612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:42.081501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d69f6-b77b-490b-b5cb-0d3a8b775612 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:42.089523 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec9ab6-c6a5-42bb-a3f5-ba18e7bd1738 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:42.098702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71d1bf-0636-4222-a773-ea3295373603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:42.099401 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71d1bf-0636-4222-a773-ea3295373603 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.099950 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71d1bf-0636-4222-a773-ea3295373603 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.100908 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71d1bf-0636-4222-a773-ea3295373603 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.101021 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 911/1818] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:41 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:42.101745 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71d1bf-0636-4222-a773-ea3295373603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:42.103648 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71d1bf-0636-4222-a773-ea3295373603 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:42.130724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 908/1819] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:42 2021] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:42.136339 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d69f6-b77b-490b-b5cb-0d3a8b775612 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:42.147547 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d69f6-b77b-490b-b5cb-0d3a8b775612 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:42.207565 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafc182-3ee5-49e8-bc39-e3c0a677f151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:42.208292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafc182-3ee5-49e8-bc39-e3c0a677f151 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.208756 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafc182-3ee5-49e8-bc39-e3c0a677f151 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.209062 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafc182-3ee5-49e8-bc39-e3c0a677f151 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.210374 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafc182-3ee5-49e8-bc39-e3c0a677f151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:42.212387 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafc182-3ee5-49e8-bc39-e3c0a677f151 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:42.234873 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 912/1820] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:42 2021] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:42.239374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71d1bf-0636-4222-a773-ea3295373603 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:42.249557 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71d1bf-0636-4222-a773-ea3295373603 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:42.254607 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055634a-6411-464f-8ad3-0c21017ca3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:42.255344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055634a-6411-464f-8ad3-0c21017ca3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.255630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055634a-6411-464f-8ad3-0c21017ca3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.255911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055634a-6411-464f-8ad3-0c21017ca3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.257586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055634a-6411-464f-8ad3-0c21017ca3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:42.259206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055634a-6411-464f-8ad3-0c21017ca3f2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:42.271166 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 909/1821] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:42 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:42.275912 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafc182-3ee5-49e8-bc39-e3c0a677f151 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:42.286981 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafc182-3ee5-49e8-bc39-e3c0a677f151 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:42.295272 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8f16d-02a7-4cf2-a9c1-b2af9acaf61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:42.295957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f16d-02a7-4cf2-a9c1-b2af9acaf61f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.296237 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f16d-02a7-4cf2-a9c1-b2af9acaf61f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.296605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f16d-02a7-4cf2-a9c1-b2af9acaf61f admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.297236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8f16d-02a7-4cf2-a9c1-b2af9acaf61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:42.299019 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8f16d-02a7-4cf2-a9c1-b2af9acaf61f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:42.309865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 913/1822] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:42 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:32:42.314052 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055634a-6411-464f-8ad3-0c21017ca3f2 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:42.324446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055634a-6411-464f-8ad3-0c21017ca3f2 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:42.329392 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a16ef3-487a-449a-bb43-6a2aaf749fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:42.330579 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a16ef3-487a-449a-bb43-6a2aaf749fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.330886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a16ef3-487a-449a-bb43-6a2aaf749fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.331167 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a16ef3-487a-449a-bb43-6a2aaf749fb7 admin admin] PATH_INFO: `/v3/projects/08b4da5c1ea04b93982268d9ba09c350/users/a10737c1918d4780a0277f4250b70da4/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.349143 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a16ef3-487a-449a-bb43-6a2aaf749fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b4da5c1ea04b93982268d9ba09c350, user_id=a10737c1918d4780a0277f4250b70da4, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:42.352798 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a16ef3-487a-449a-bb43-6a2aaf749fb7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:42.359593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8f16d-02a7-4cf2-a9c1-b2af9acaf61f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:42.373048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8f16d-02a7-4cf2-a9c1-b2af9acaf61f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:42.375465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 910/1823] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:42 2021] PUT /identity/v3/projects/08b4da5c1ea04b93982268d9ba09c350/users/a10737c1918d4780a0277f4250b70da4/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:42.386604 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082550b-7924-43c6-ba10-c3b1ceb8f4f7 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.386898 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082550b-7924-43c6-ba10-c3b1ceb8f4f7 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.387168 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082550b-7924-43c6-ba10-c3b1ceb8f4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.421771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c082550b-7924-43c6-ba10-c3b1ceb8f4f7 None None] MFA Rules not processed for user `a10737c1918d4780a0277f4250b70da4`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:42.423109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c082550b-7924-43c6-ba10-c3b1ceb8f4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:42.433524 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a1a7b-bec0-4f24-9652-4c3f07009aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:42.434399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a1a7b-bec0-4f24-9652-4c3f07009aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.434685 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a1a7b-bec0-4f24-9652-4c3f07009aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.434994 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a1a7b-bec0-4f24-9652-4c3f07009aaa admin admin] PATH_INFO: `/v3/users/ac4522227010405f8240fe61ad589d88` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.436345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a1a7b-bec0-4f24-9652-4c3f07009aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4522227010405f8240fe61ad589d88)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:42.438262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a1a7b-bec0-4f24-9652-4c3f07009aaa admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:42.486213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6d4a1a7b-bec0-4f24-9652-4c3f07009aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4522227010405f8240fe61ad589d88'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:42.489382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 911/1824] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:42 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:32:42.494698 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082550b-7924-43c6-ba10-c3b1ceb8f4f7 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:42.494818 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6d4a1a7b-bec0-4f24-9652-4c3f07009aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4522227010405f8240fe61ad589d88'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:42.503978 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6d4a1a7b-bec0-4f24-9652-4c3f07009aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4522227010405f8240fe61ad589d88'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:42.508295 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082550b-7924-43c6-ba10-c3b1ceb8f4f7 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:42.515338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8a6e8-2c82-4920-9624-cc28d151659f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:42.516265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8a6e8-2c82-4920-9624-cc28d151659f admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.516725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8a6e8-2c82-4920-9624-cc28d151659f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.517191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8a6e8-2c82-4920-9624-cc28d151659f admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.518382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8a6e8-2c82-4920-9624-cc28d151659f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:42.521725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8a6e8-2c82-4920-9624-cc28d151659f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:42.522073 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6d4a1a7b-bec0-4f24-9652-4c3f07009aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4522227010405f8240fe61ad589d88'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:42.523092 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6d4a1a7b-bec0-4f24-9652-4c3f07009aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4522227010405f8240fe61ad589d88'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:42.532765 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 914/1825] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:42 2021] DELETE /identity/v3/users/ac4522227010405f8240fe61ad589d88 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:42.537001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae3986-14e1-4c88-81dd-494468c9ffb4 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.537295 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae3986-14e1-4c88-81dd-494468c9ffb4 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.538091 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae3986-14e1-4c88-81dd-494468c9ffb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.552278 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 912/1826] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:42 2021] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:32:42.556970 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8a6e8-2c82-4920-9624-cc28d151659f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:42.557591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f7ae3986-14e1-4c88-81dd-494468c9ffb4 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:42.558663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-f0d8a6e8-2c82-4920-9624-cc28d151659f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:42.558774 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f7ae3986-14e1-4c88-81dd-494468c9ffb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:42.616514 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 915/1827] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:32:42.620445 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8a6e8-2c82-4920-9624-cc28d151659f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:42.625419 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c646781-3e07-44a4-9706-2f7708a8a22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:42.626028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae3986-14e1-4c88-81dd-494468c9ffb4 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:42.626124 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c646781-3e07-44a4-9706-2f7708a8a22d admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.626357 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c646781-3e07-44a4-9706-2f7708a8a22d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.626631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c646781-3e07-44a4-9706-2f7708a8a22d admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.627357 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c646781-3e07-44a4-9706-2f7708a8a22d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:42.627520 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f7ae3986-14e1-4c88-81dd-494468c9ffb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:42.629271 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c646781-3e07-44a4-9706-2f7708a8a22d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:42.654393 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 913/1828] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:42 2021] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:42.655420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c646781-3e07-44a4-9706-2f7708a8a22d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:42.665920 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c646781-3e07-44a4-9706-2f7708a8a22d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:42.670659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7a3ab-d6c1-4d33-8da4-0abd4cbd8d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:42.671286 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7a3ab-d6c1-4d33-8da4-0abd4cbd8d6a admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.671575 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7a3ab-d6c1-4d33-8da4-0abd4cbd8d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.671855 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7a3ab-d6c1-4d33-8da4-0abd4cbd8d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.672581 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7a3ab-d6c1-4d33-8da4-0abd4cbd8d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:42.674296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7a3ab-d6c1-4d33-8da4-0abd4cbd8d6a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:42.684548 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae3986-14e1-4c88-81dd-494468c9ffb4 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:42.684805 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 914/1829] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:42.688491 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ae48c-264f-4bef-8e98-ba4818c1f6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:42.688933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7a3ab-d6c1-4d33-8da4-0abd4cbd8d6a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:42.689163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ae48c-264f-4bef-8e98-ba4818c1f6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.689444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ae48c-264f-4bef-8e98-ba4818c1f6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.689720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ae48c-264f-4bef-8e98-ba4818c1f6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.698809 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7a3ab-d6c1-4d33-8da4-0abd4cbd8d6a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:42.699397 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ae48c-264f-4bef-8e98-ba4818c1f6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:42.700918 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ae48c-264f-4bef-8e98-ba4818c1f6b9 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:42.703854 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61824d26-d9d7-46e9-8104-7972110f2027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:42.704804 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61824d26-d9d7-46e9-8104-7972110f2027 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.705142 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61824d26-d9d7-46e9-8104-7972110f2027 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.705504 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61824d26-d9d7-46e9-8104-7972110f2027 admin admin] PATH_INFO: `/v3/projects/54793f4b5f45411cbc8b8aabc5242d3a/users/7034c195f21645159a02d2cc4f358db4/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.712323 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 916/1830] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:32:42.722596 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61824d26-d9d7-46e9-8104-7972110f2027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54793f4b5f45411cbc8b8aabc5242d3a, user_id=7034c195f21645159a02d2cc4f358db4, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:42.726305 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61824d26-d9d7-46e9-8104-7972110f2027 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:42.744570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 915/1831] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:42 2021] PUT /identity/v3/projects/54793f4b5f45411cbc8b8aabc5242d3a/users/7034c195f21645159a02d2cc4f358db4/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:32:42.745824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ae48c-264f-4bef-8e98-ba4818c1f6b9 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:42.756416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ae48c-264f-4bef-8e98-ba4818c1f6b9 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:42.819632 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cb30e-7236-4f7b-a45d-7df699d914c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:42.820351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cb30e-7236-4f7b-a45d-7df699d914c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.820600 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cb30e-7236-4f7b-a45d-7df699d914c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.820878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cb30e-7236-4f7b-a45d-7df699d914c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.821734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cb30e-7236-4f7b-a45d-7df699d914c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:42.824160 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cb30e-7236-4f7b-a45d-7df699d914c4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:42.835546 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 917/1832] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:42 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:42.840212 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61824d26-d9d7-46e9-8104-7972110f2027 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:42.851265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61824d26-d9d7-46e9-8104-7972110f2027 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:42.855941 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139b144-4766-4a20-90ee-a8a11396c382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:42.857162 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139b144-4766-4a20-90ee-a8a11396c382 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.857509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139b144-4766-4a20-90ee-a8a11396c382 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.857851 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139b144-4766-4a20-90ee-a8a11396c382 admin admin] PATH_INFO: `/v3/projects/54793f4b5f45411cbc8b8aabc5242d3a/users/7034c195f21645159a02d2cc4f358db4/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.859944 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139b144-4766-4a20-90ee-a8a11396c382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54793f4b5f45411cbc8b8aabc5242d3a, user_id=7034c195f21645159a02d2cc4f358db4, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:42.862633 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139b144-4766-4a20-90ee-a8a11396c382 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:42.873159 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 916/1833] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:42 2021] PUT /identity/v3/projects/54793f4b5f45411cbc8b8aabc5242d3a/users/7034c195f21645159a02d2cc4f358db4/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:42.883669 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f559c8e-f23c-4e30-99ef-3753c5fbb2ea None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:42.884303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f559c8e-f23c-4e30-99ef-3753c5fbb2ea None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:42.884682 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f559c8e-f23c-4e30-99ef-3753c5fbb2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:42.916676 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0f559c8e-f23c-4e30-99ef-3753c5fbb2ea None None] MFA Rules not processed for user `7034c195f21645159a02d2cc4f358db4`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:42.917879 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0f559c8e-f23c-4e30-99ef-3753c5fbb2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:42.995596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 918/1834] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:42 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:43.007779 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139b144-4766-4a20-90ee-a8a11396c382 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:43.009579 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3139b144-4766-4a20-90ee-a8a11396c382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:43.052491 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f559c8e-f23c-4e30-99ef-3753c5fbb2ea None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:43.054183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0f559c8e-f23c-4e30-99ef-3753c5fbb2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:43.069645 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139b144-4766-4a20-90ee-a8a11396c382 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:43.073646 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecb4f9-62ee-4960-b32b-287e7265ce08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:43.074378 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb4f9-62ee-4960-b32b-287e7265ce08 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:43.074736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb4f9-62ee-4960-b32b-287e7265ce08 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:43.075172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb4f9-62ee-4960-b32b-287e7265ce08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:43.084309 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-2aecb4f9-62ee-4960-b32b-287e7265ce08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:43.139008 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f559c8e-f23c-4e30-99ef-3753c5fbb2ea None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:43.144378 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:43.145273 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:43.145541 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:43.145808 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] PATH_INFO: `/v3/projects/d37d398ce8404717ba05b81f887372da` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:43.148025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37d398ce8404717ba05b81f887372da)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:43.149720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:43.150582 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecb4f9-62ee-4960-b32b-287e7265ce08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:43.152074 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecb4f9-62ee-4960-b32b-287e7265ce08 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:43.161840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 917/1835] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:43 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:43.200782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37d398ce8404717ba05b81f887372da', 'request_id': 'req-cc5d206d-4da7-4f70-b054-c0e828bff00e'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.207351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37d398ce8404717ba05b81f887372da', 'request_id': 'req-cc5d206d-4da7-4f70-b054-c0e828bff00e'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.216753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37d398ce8404717ba05b81f887372da', 'request_id': 'req-cc5d206d-4da7-4f70-b054-c0e828bff00e'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.228444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] The token cache is being invalidate because project d37d398ce8404717ba05b81f887372da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:43.228741 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.229414 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.231258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 919/1836] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:43 2021] DELETE /identity/v3/projects/d37d398ce8404717ba05b81f887372da => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:32:43.235040 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecb4f9-62ee-4960-b32b-287e7265ce08 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:43.248532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecb4f9-62ee-4960-b32b-287e7265ce08 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:43.309029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683666aa-f57d-4c1f-a08b-92c56dac260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:43.309915 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683666aa-f57d-4c1f-a08b-92c56dac260f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:43.310208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683666aa-f57d-4c1f-a08b-92c56dac260f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:43.310487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683666aa-f57d-4c1f-a08b-92c56dac260f admin admin] PATH_INFO: `/v3/users/551c07c39ac248f38993f00f8ab189be` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:43.312083 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683666aa-f57d-4c1f-a08b-92c56dac260f admin admin] RBAC: Authorizing `identity:delete_user(user_id=551c07c39ac248f38993f00f8ab189be)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:43.313699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683666aa-f57d-4c1f-a08b-92c56dac260f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:43.362005 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-683666aa-f57d-4c1f-a08b-92c56dac260f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '551c07c39ac248f38993f00f8ab189be'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.369160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-683666aa-f57d-4c1f-a08b-92c56dac260f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '551c07c39ac248f38993f00f8ab189be'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.369928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-683666aa-f57d-4c1f-a08b-92c56dac260f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '551c07c39ac248f38993f00f8ab189be'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.383050 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-683666aa-f57d-4c1f-a08b-92c56dac260f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '551c07c39ac248f38993f00f8ab189be'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.383736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-683666aa-f57d-4c1f-a08b-92c56dac260f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '551c07c39ac248f38993f00f8ab189be'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.398698 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 918/1837] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:43 2021] DELETE /identity/v3/users/551c07c39ac248f38993f00f8ab189be => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:43.667076 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:43.668552 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:43.683925 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d206d-4da7-4f70-b054-c0e828bff00e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:43.739768 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:43.740637 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:43.740925 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:43.741198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac admin admin] PATH_INFO: `/v3/projects/fc5d0ec46acd41918bc66c73eb490c6e` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:43.742375 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5d0ec46acd41918bc66c73eb490c6e)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:43.744411 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:43.788092 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5d0ec46acd41918bc66c73eb490c6e', 'request_id': 'req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.793837 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5d0ec46acd41918bc66c73eb490c6e', 'request_id': 'req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.800775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5d0ec46acd41918bc66c73eb490c6e', 'request_id': 'req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.812055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac admin admin] The token cache is being invalidate because project fc5d0ec46acd41918bc66c73eb490c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:43.813527 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.814213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-43e5c809-3a3a-49dd-b27f-cf2cb10af4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:43.815981 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 920/1838] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:43 2021] DELETE /identity/v3/projects/fc5d0ec46acd41918bc66c73eb490c6e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:43.822203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47377-43a6-495e-b5ec-d4c8c5a0b34e None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:43.822500 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47377-43a6-495e-b5ec-d4c8c5a0b34e None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:43.822781 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47377-43a6-495e-b5ec-d4c8c5a0b34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:43.841890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-4df47377-43a6-495e-b5ec-d4c8c5a0b34e None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:43.843132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-4df47377-43a6-495e-b5ec-d4c8c5a0b34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:43.903453 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 919/1839] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:32:43.911418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80109aea-7903-473e-b30f-6e3918a8516c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:43.911715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80109aea-7903-473e-b30f-6e3918a8516c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:43.911999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80109aea-7903-473e-b30f-6e3918a8516c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:43.936662 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-80109aea-7903-473e-b30f-6e3918a8516c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:43.938117 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-80109aea-7903-473e-b30f-6e3918a8516c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:43.947210 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 921/1840] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:43.951508 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47377-43a6-495e-b5ec-d4c8c5a0b34e None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:43.964231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47377-43a6-495e-b5ec-d4c8c5a0b34e None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:43.969968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38542e-618a-4d55-bb72-7afe66d9ab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:43.970639 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38542e-618a-4d55-bb72-7afe66d9ab19 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:43.970951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38542e-618a-4d55-bb72-7afe66d9ab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:43.971233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38542e-618a-4d55-bb72-7afe66d9ab19 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:43.971964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38542e-618a-4d55-bb72-7afe66d9ab19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:32:43.972271 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38542e-618a-4d55-bb72-7afe66d9ab19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:43.974220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38542e-618a-4d55-bb72-7afe66d9ab19 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:43.987812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 920/1841] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:32:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:32:43.991425 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80109aea-7903-473e-b30f-6e3918a8516c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:44.000529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80109aea-7903-473e-b30f-6e3918a8516c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:44.005361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1605d-4d72-4409-bda9-7511470a872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:44.006110 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1605d-4d72-4409-bda9-7511470a872e admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:44.006979 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1605d-4d72-4409-bda9-7511470a872e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:44.007326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1605d-4d72-4409-bda9-7511470a872e admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:44.008169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1605d-4d72-4409-bda9-7511470a872e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:44.010169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1605d-4d72-4409-bda9-7511470a872e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:44.036670 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 922/1842] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:43 2021] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:44.040941 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38542e-618a-4d55-bb72-7afe66d9ab19 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:44.050778 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38542e-618a-4d55-bb72-7afe66d9ab19 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:44.105192 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b771bf-94e1-4902-9c8b-8fa36240daa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:44.105857 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b771bf-94e1-4902-9c8b-8fa36240daa7 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:44.106140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b771bf-94e1-4902-9c8b-8fa36240daa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:44.106416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b771bf-94e1-4902-9c8b-8fa36240daa7 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:44.107213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b771bf-94e1-4902-9c8b-8fa36240daa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:44.109109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b771bf-94e1-4902-9c8b-8fa36240daa7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:44.128855 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 921/1843] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:44 2021] POST /identity/v3/users => generated 280 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:44.133908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1605d-4d72-4409-bda9-7511470a872e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:44.144722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1605d-4d72-4409-bda9-7511470a872e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:44.156676 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce4b97-0ab9-4588-aef6-e8dbc333af44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:44.157356 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce4b97-0ab9-4588-aef6-e8dbc333af44 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:44.157647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce4b97-0ab9-4588-aef6-e8dbc333af44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:44.158134 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce4b97-0ab9-4588-aef6-e8dbc333af44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:44.158906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce4b97-0ab9-4588-aef6-e8dbc333af44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:44.161839 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce4b97-0ab9-4588-aef6-e8dbc333af44 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:44.171821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 923/1844] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:44 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:44.176049 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b771bf-94e1-4902-9c8b-8fa36240daa7 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:44.188026 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b771bf-94e1-4902-9c8b-8fa36240daa7 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:44.192903 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1eda85-383b-422f-8432-6e7e671e4efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:44.193569 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eda85-383b-422f-8432-6e7e671e4efb admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:44.194446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eda85-383b-422f-8432-6e7e671e4efb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:44.194797 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eda85-383b-422f-8432-6e7e671e4efb admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:44.195599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1eda85-383b-422f-8432-6e7e671e4efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:44.197175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1eda85-383b-422f-8432-6e7e671e4efb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:44.207578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 922/1845] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:44 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:44.211759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce4b97-0ab9-4588-aef6-e8dbc333af44 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:44.221529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce4b97-0ab9-4588-aef6-e8dbc333af44 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:44.226529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21b8a5-5810-4dd9-bd46-4530fad29dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:44.227449 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21b8a5-5810-4dd9-bd46-4530fad29dda admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:44.227735 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21b8a5-5810-4dd9-bd46-4530fad29dda admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:44.228041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21b8a5-5810-4dd9-bd46-4530fad29dda admin admin] PATH_INFO: `/v3/projects/500a66777af94c80a8af3462588f699c/users/c47333e73212419b976e0d0593d34f9c/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:44.242730 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21b8a5-5810-4dd9-bd46-4530fad29dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=500a66777af94c80a8af3462588f699c, user_id=c47333e73212419b976e0d0593d34f9c, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:44.245875 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21b8a5-5810-4dd9-bd46-4530fad29dda admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:44.262819 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 924/1846] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:44 2021] PUT /identity/v3/projects/500a66777af94c80a8af3462588f699c/users/c47333e73212419b976e0d0593d34f9c/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:44.274572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893018-7cab-4be2-b35d-552acdc43601 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:44.274984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893018-7cab-4be2-b35d-552acdc43601 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:44.275272 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893018-7cab-4be2-b35d-552acdc43601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:44.301783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-a7893018-7cab-4be2-b35d-552acdc43601 None None] MFA Rules not processed for user `c47333e73212419b976e0d0593d34f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:44.303029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a7893018-7cab-4be2-b35d-552acdc43601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:44.372675 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 923/1847] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:44 2021] POST /identity/v3/auth/tokens => generated 3379 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:44.401908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21b8a5-5810-4dd9-bd46-4530fad29dda admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:44.404050 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-cf21b8a5-5810-4dd9-bd46-4530fad29dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:44.471469 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21b8a5-5810-4dd9-bd46-4530fad29dda admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:44.476069 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b257d85-a8e1-4692-85b3-3802649e2ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:44.476918 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b257d85-a8e1-4692-85b3-3802649e2ead service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:44.477208 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b257d85-a8e1-4692-85b3-3802649e2ead service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:44.477490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b257d85-a8e1-4692-85b3-3802649e2ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:44.486518 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b257d85-a8e1-4692-85b3-3802649e2ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:44.488317 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b257d85-a8e1-4692-85b3-3802649e2ead service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:44.498437 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 925/1848] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:44 2021] GET /identity/v3/auth/tokens => generated 3379 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:44.513766 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7893018-7cab-4be2-b35d-552acdc43601 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:44.582512 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7893018-7cab-4be2-b35d-552acdc43601 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:44.587805 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1c331-a7bf-4208-af08-5c029e0f0165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:44.588679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1c331-a7bf-4208-af08-5c029e0f0165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:44.588964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1c331-a7bf-4208-af08-5c029e0f0165 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:44.589244 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1c331-a7bf-4208-af08-5c029e0f0165 admin admin] PATH_INFO: `/v3/users/c47333e73212419b976e0d0593d34f9c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:44.590458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1c331-a7bf-4208-af08-5c029e0f0165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47333e73212419b976e0d0593d34f9c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:44.592416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1c331-a7bf-4208-af08-5c029e0f0165 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:44.640253 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c7d1c331-a7bf-4208-af08-5c029e0f0165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47333e73212419b976e0d0593d34f9c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:44.647582 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c7d1c331-a7bf-4208-af08-5c029e0f0165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47333e73212419b976e0d0593d34f9c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:44.648268 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c7d1c331-a7bf-4208-af08-5c029e0f0165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47333e73212419b976e0d0593d34f9c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:44.659568 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c7d1c331-a7bf-4208-af08-5c029e0f0165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47333e73212419b976e0d0593d34f9c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:44.660205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c7d1c331-a7bf-4208-af08-5c029e0f0165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47333e73212419b976e0d0593d34f9c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:44.671996 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 924/1849] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:44 2021] DELETE /identity/v3/users/c47333e73212419b976e0d0593d34f9c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:44.676549 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88efe4f-b2fb-4e1e-afe3-380d578e9faf None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:44.677020 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88efe4f-b2fb-4e1e-afe3-380d578e9faf None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:44.677130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88efe4f-b2fb-4e1e-afe3-380d578e9faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:44.694754 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-a88efe4f-b2fb-4e1e-afe3-380d578e9faf None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:44.695996 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a88efe4f-b2fb-4e1e-afe3-380d578e9faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:44.756745 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 926/1850] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:44.766594 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1c331-a7bf-4208-af08-5c029e0f0165 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:44.768105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c7d1c331-a7bf-4208-af08-5c029e0f0165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:44.827519 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1c331-a7bf-4208-af08-5c029e0f0165 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:44.831396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9110926-eb13-4aa4-ba84-d6a150477f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:44.832149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9110926-eb13-4aa4-ba84-d6a150477f2d service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:44.832436 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9110926-eb13-4aa4-ba84-d6a150477f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:44.832717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9110926-eb13-4aa4-ba84-d6a150477f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:44.842377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9110926-eb13-4aa4-ba84-d6a150477f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:44.843860 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9110926-eb13-4aa4-ba84-d6a150477f2d service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:44.854334 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 925/1851] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:45.129817 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88efe4f-b2fb-4e1e-afe3-380d578e9faf None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:45.132354 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a88efe4f-b2fb-4e1e-afe3-380d578e9faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:45.146420 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88efe4f-b2fb-4e1e-afe3-380d578e9faf None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:45.154813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:45.155781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:45.156065 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:45.156357 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4 admin admin] PATH_INFO: `/v3/projects/500a66777af94c80a8af3462588f699c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:45.157631 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=500a66777af94c80a8af3462588f699c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:45.159823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:45.217174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '500a66777af94c80a8af3462588f699c', 'request_id': 'req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:45.224158 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '500a66777af94c80a8af3462588f699c', 'request_id': 'req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:45.235159 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '500a66777af94c80a8af3462588f699c', 'request_id': 'req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:45.246247 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4 admin admin] The token cache is being invalidate because project 500a66777af94c80a8af3462588f699c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:45.246706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:45.247296 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f8a3c9a6-4b3f-4a3a-95d9-12f427759ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:45.253445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 927/1852] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:45 2021] DELETE /identity/v3/projects/500a66777af94c80a8af3462588f699c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:45.257234 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a81d35-df44-4190-8952-c5b90e8d7f15 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:45.257838 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a81d35-df44-4190-8952-c5b90e8d7f15 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:45.258134 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a81d35-df44-4190-8952-c5b90e8d7f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:45.277070 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-28a81d35-df44-4190-8952-c5b90e8d7f15 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:45.278197 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-28a81d35-df44-4190-8952-c5b90e8d7f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:45.335267 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 926/1853] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:45.343348 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456fe52-3d72-4684-a164-cf16f1cfa92c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:45.343668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456fe52-3d72-4684-a164-cf16f1cfa92c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:45.343958 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456fe52-3d72-4684-a164-cf16f1cfa92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:45.363052 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0456fe52-3d72-4684-a164-cf16f1cfa92c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:45.364281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0456fe52-3d72-4684-a164-cf16f1cfa92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:45.372836 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 928/1854] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:45.377074 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a81d35-df44-4190-8952-c5b90e8d7f15 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:45.389195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a81d35-df44-4190-8952-c5b90e8d7f15 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:45.395367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df97519-9463-44e1-88ec-2f3e84c746d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:45.396191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df97519-9463-44e1-88ec-2f3e84c746d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:45.397671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df97519-9463-44e1-88ec-2f3e84c746d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:45.397671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df97519-9463-44e1-88ec-2f3e84c746d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:45.398464 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df97519-9463-44e1-88ec-2f3e84c746d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:32:45.398679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df97519-9463-44e1-88ec-2f3e84c746d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:45.400286 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df97519-9463-44e1-88ec-2f3e84c746d1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:45.414251 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 927/1855] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:32:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:32:45.418678 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456fe52-3d72-4684-a164-cf16f1cfa92c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:45.428921 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456fe52-3d72-4684-a164-cf16f1cfa92c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:45.444588 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9261e6-4a96-4caf-b917-a5dc44f4bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:45.445596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9261e6-4a96-4caf-b917-a5dc44f4bf83 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:45.456181 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9261e6-4a96-4caf-b917-a5dc44f4bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:45.456602 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9261e6-4a96-4caf-b917-a5dc44f4bf83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:45.457818 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9261e6-4a96-4caf-b917-a5dc44f4bf83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:45.468583 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9261e6-4a96-4caf-b917-a5dc44f4bf83 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:45.510386 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 929/1856] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:45 2021] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:32:45.514402 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df97519-9463-44e1-88ec-2f3e84c746d1 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:45.533311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df97519-9463-44e1-88ec-2f3e84c746d1 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:45.634867 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b137b8d-7d04-466d-89d2-8b14c3c339b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:45.635615 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b137b8d-7d04-466d-89d2-8b14c3c339b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:45.635903 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b137b8d-7d04-466d-89d2-8b14c3c339b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:45.636762 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b137b8d-7d04-466d-89d2-8b14c3c339b3 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:45.637649 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b137b8d-7d04-466d-89d2-8b14c3c339b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:45.639465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b137b8d-7d04-466d-89d2-8b14c3c339b3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:45.660071 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 928/1857] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:45 2021] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:45.667007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9261e6-4a96-4caf-b917-a5dc44f4bf83 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:45.677908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9261e6-4a96-4caf-b917-a5dc44f4bf83 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:45.684189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b595c8-4cd3-4b12-af2d-a00340a8d86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:45.685217 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b595c8-4cd3-4b12-af2d-a00340a8d86a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:45.685714 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b595c8-4cd3-4b12-af2d-a00340a8d86a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:45.686198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b595c8-4cd3-4b12-af2d-a00340a8d86a admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:45.698818 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b595c8-4cd3-4b12-af2d-a00340a8d86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:45.701844 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b595c8-4cd3-4b12-af2d-a00340a8d86a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:45.728549 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 930/1858] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:45 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:45.735108 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b137b8d-7d04-466d-89d2-8b14c3c339b3 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:45.748986 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b137b8d-7d04-466d-89d2-8b14c3c339b3 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:45.764210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0131c1-bd6f-4f17-85dd-c8737b1fe103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:45.768634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0131c1-bd6f-4f17-85dd-c8737b1fe103 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:45.769019 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0131c1-bd6f-4f17-85dd-c8737b1fe103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:45.769873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0131c1-bd6f-4f17-85dd-c8737b1fe103 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:45.770905 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0131c1-bd6f-4f17-85dd-c8737b1fe103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:45.772672 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0131c1-bd6f-4f17-85dd-c8737b1fe103 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:45.784464 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 929/1859] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:45 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:45.787955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b595c8-4cd3-4b12-af2d-a00340a8d86a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:45.800658 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b595c8-4cd3-4b12-af2d-a00340a8d86a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:45.807326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d3280-7753-40bf-a131-dcb5bb39057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:45.809608 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3280-7753-40bf-a131-dcb5bb39057b admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:45.809897 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3280-7753-40bf-a131-dcb5bb39057b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:45.810176 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3280-7753-40bf-a131-dcb5bb39057b admin admin] PATH_INFO: `/v3/projects/55beb93ae9864e32a526c50fefedb7a3/users/bd8a3b37886944a3b97eb2f903162a15/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:45.826974 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d3280-7753-40bf-a131-dcb5bb39057b admin admin] RBAC: Authorizing `identity:create_grant(project_id=55beb93ae9864e32a526c50fefedb7a3, user_id=bd8a3b37886944a3b97eb2f903162a15, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:45.829862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d3280-7753-40bf-a131-dcb5bb39057b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:45.853290 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 931/1860] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:45 2021] PUT /identity/v3/projects/55beb93ae9864e32a526c50fefedb7a3/users/bd8a3b37886944a3b97eb2f903162a15/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:32:45.864990 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d9157-7b4d-40b7-a7db-ae7d3138f675 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:45.866023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d9157-7b4d-40b7-a7db-ae7d3138f675 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:45.866328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d9157-7b4d-40b7-a7db-ae7d3138f675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:45.905236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-230d9157-7b4d-40b7-a7db-ae7d3138f675 None None] MFA Rules not processed for user `bd8a3b37886944a3b97eb2f903162a15`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:45.906427 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-230d9157-7b4d-40b7-a7db-ae7d3138f675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:46.043593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 930/1861] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:45 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:46.048280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d3280-7753-40bf-a131-dcb5bb39057b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:46.141329 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d3280-7753-40bf-a131-dcb5bb39057b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:46.155555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5c0e4-a4db-4e46-9e95-4d769dc46452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:46.157448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5c0e4-a4db-4e46-9e95-4d769dc46452 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:46.157757 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5c0e4-a4db-4e46-9e95-4d769dc46452 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:46.158048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5c0e4-a4db-4e46-9e95-4d769dc46452 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:46.158798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5c0e4-a4db-4e46-9e95-4d769dc46452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:46.160917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5c0e4-a4db-4e46-9e95-4d769dc46452 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:46.209176 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 932/1862] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:46 2021] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:46.212466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d9157-7b4d-40b7-a7db-ae7d3138f675 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:46.229236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d9157-7b4d-40b7-a7db-ae7d3138f675 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:46.330937 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8eb27-ec56-470d-a618-a764f923bafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:46.331744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8eb27-ec56-470d-a618-a764f923bafd admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:46.332109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8eb27-ec56-470d-a618-a764f923bafd admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:46.332516 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8eb27-ec56-470d-a618-a764f923bafd admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:46.333317 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8eb27-ec56-470d-a618-a764f923bafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:46.336005 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8eb27-ec56-470d-a618-a764f923bafd admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:46.363434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 931/1863] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:46 2021] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:32:46.367896 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5c0e4-a4db-4e46-9e95-4d769dc46452 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:46.379868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5c0e4-a4db-4e46-9e95-4d769dc46452 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:46.385917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e40748-b6b9-4872-aafe-f5e6d3a83e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:46.386816 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e40748-b6b9-4872-aafe-f5e6d3a83e9e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:46.387237 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e40748-b6b9-4872-aafe-f5e6d3a83e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:46.388169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e40748-b6b9-4872-aafe-f5e6d3a83e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:46.389204 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e40748-b6b9-4872-aafe-f5e6d3a83e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:46.391417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e40748-b6b9-4872-aafe-f5e6d3a83e9e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:46.405781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 933/1864] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:46 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:32:46.410180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8eb27-ec56-470d-a618-a764f923bafd admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:46.424705 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8eb27-ec56-470d-a618-a764f923bafd admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:46.433273 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7da154-6c2e-4aed-ba2d-537fd77a47a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:46.434371 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da154-6c2e-4aed-ba2d-537fd77a47a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:46.434730 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da154-6c2e-4aed-ba2d-537fd77a47a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:46.435110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da154-6c2e-4aed-ba2d-537fd77a47a8 admin admin] PATH_INFO: `/v3/projects/e3dd6c5ef3fd452d828949dbf0b2ddfe/users/34811da4c1ee4ed48251f53f08f455eb/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:46.462148 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7da154-6c2e-4aed-ba2d-537fd77a47a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3dd6c5ef3fd452d828949dbf0b2ddfe, user_id=34811da4c1ee4ed48251f53f08f455eb, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:46.462148 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7da154-6c2e-4aed-ba2d-537fd77a47a8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:46.489270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 932/1865] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:46 2021] PUT /identity/v3/projects/e3dd6c5ef3fd452d828949dbf0b2ddfe/users/34811da4c1ee4ed48251f53f08f455eb/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:46.494939 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e40748-b6b9-4872-aafe-f5e6d3a83e9e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:46.507135 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e40748-b6b9-4872-aafe-f5e6d3a83e9e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:46.577914 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3760e8-4072-4b6b-99ec-81fe6581620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:46.578521 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3760e8-4072-4b6b-99ec-81fe6581620b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:46.578863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3760e8-4072-4b6b-99ec-81fe6581620b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:46.579140 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3760e8-4072-4b6b-99ec-81fe6581620b admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:46.579897 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3760e8-4072-4b6b-99ec-81fe6581620b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:46.581583 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3760e8-4072-4b6b-99ec-81fe6581620b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:46.593094 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 934/1866] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:46 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:46.597344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7da154-6c2e-4aed-ba2d-537fd77a47a8 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:46.610357 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7da154-6c2e-4aed-ba2d-537fd77a47a8 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:46.616901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04bc92-2d40-4231-90cb-01abc5ed57f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:46.617745 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04bc92-2d40-4231-90cb-01abc5ed57f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:46.619545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04bc92-2d40-4231-90cb-01abc5ed57f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:46.619545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04bc92-2d40-4231-90cb-01abc5ed57f4 admin admin] PATH_INFO: `/v3/projects/e3dd6c5ef3fd452d828949dbf0b2ddfe/users/34811da4c1ee4ed48251f53f08f455eb/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:46.622169 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04bc92-2d40-4231-90cb-01abc5ed57f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3dd6c5ef3fd452d828949dbf0b2ddfe, user_id=34811da4c1ee4ed48251f53f08f455eb, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:46.624873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04bc92-2d40-4231-90cb-01abc5ed57f4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:46.642081 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 933/1867] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:46 2021] PUT /identity/v3/projects/e3dd6c5ef3fd452d828949dbf0b2ddfe/users/34811da4c1ee4ed48251f53f08f455eb/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:46.652827 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238ed42-74df-43e9-920c-c8a193091984 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:46.653127 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238ed42-74df-43e9-920c-c8a193091984 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:46.653413 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238ed42-74df-43e9-920c-c8a193091984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:46.693655 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0238ed42-74df-43e9-920c-c8a193091984 None None] MFA Rules not processed for user `34811da4c1ee4ed48251f53f08f455eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:46.695907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0238ed42-74df-43e9-920c-c8a193091984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:46.838478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 935/1868] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:46 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:46.900255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04bc92-2d40-4231-90cb-01abc5ed57f4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:46.902138 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ff04bc92-2d40-4231-90cb-01abc5ed57f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:46.990042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04bc92-2d40-4231-90cb-01abc5ed57f4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:46.995662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1c6fe-d131-4f46-85f9-a48ced5e6077 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:46.996474 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1c6fe-d131-4f46-85f9-a48ced5e6077 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:46.996968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1c6fe-d131-4f46-85f9-a48ced5e6077 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:46.997537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1c6fe-d131-4f46-85f9-a48ced5e6077 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:47.066939 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1c6fe-d131-4f46-85f9-a48ced5e6077 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:47.068403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1c6fe-d131-4f46-85f9-a48ced5e6077 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:47.078649 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 934/1869] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:46 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:47.629591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238ed42-74df-43e9-920c-c8a193091984 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:47.634519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0238ed42-74df-43e9-920c-c8a193091984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:47.665768 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238ed42-74df-43e9-920c-c8a193091984 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:47.672243 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65e67e-3097-4ced-babe-7402572f3490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:47.672978 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65e67e-3097-4ced-babe-7402572f3490 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:47.673592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65e67e-3097-4ced-babe-7402572f3490 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:47.673592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65e67e-3097-4ced-babe-7402572f3490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:47.676050 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-fe65e67e-3097-4ced-babe-7402572f3490 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:47.748044 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65e67e-3097-4ced-babe-7402572f3490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:47.750423 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65e67e-3097-4ced-babe-7402572f3490 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:47.779365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 936/1870] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:47 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:48.463279 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1c6fe-d131-4f46-85f9-a48ced5e6077 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:48.472247 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1c6fe-d131-4f46-85f9-a48ced5e6077 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:48.476306 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32815376-1e12-43ff-ada2-137d781e0892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:48.476952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32815376-1e12-43ff-ada2-137d781e0892 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:48.477237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32815376-1e12-43ff-ada2-137d781e0892 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:48.477514 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32815376-1e12-43ff-ada2-137d781e0892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:48.479302 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-32815376-1e12-43ff-ada2-137d781e0892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:48.546671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32815376-1e12-43ff-ada2-137d781e0892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:48.548152 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32815376-1e12-43ff-ada2-137d781e0892 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:48.560982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 935/1871] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:48 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:55.013692 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65e67e-3097-4ced-babe-7402572f3490 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:55.015326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-fe65e67e-3097-4ced-babe-7402572f3490 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:55.040088 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bd6ff-51be-4396-b20d-913e4de8fcc7 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:55.040651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bd6ff-51be-4396-b20d-913e4de8fcc7 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:55.040651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bd6ff-51be-4396-b20d-913e4de8fcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:55.062349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-583bd6ff-51be-4396-b20d-913e4de8fcc7 None None] MFA Rules not processed for user `75a772d36dc64b34ad0e9f2748cea24f`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:55.063710 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-583bd6ff-51be-4396-b20d-913e4de8fcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:55.119428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65e67e-3097-4ced-babe-7402572f3490 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:55.124566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603be4ef-5535-409a-b815-3e3c63582c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:55.125673 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be4ef-5535-409a-b815-3e3c63582c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:55.126143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be4ef-5535-409a-b815-3e3c63582c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:55.126735 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be4ef-5535-409a-b815-3e3c63582c85 admin admin] PATH_INFO: `/v3/users/f6176ce32e2945cbac1d04222ff9fb44` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:55.128269 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603be4ef-5535-409a-b815-3e3c63582c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6176ce32e2945cbac1d04222ff9fb44)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:55.130546 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603be4ef-5535-409a-b815-3e3c63582c85 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:55.136814 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 936/1872] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:55 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:32:55.194653 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-603be4ef-5535-409a-b815-3e3c63582c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6176ce32e2945cbac1d04222ff9fb44'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.203105 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-603be4ef-5535-409a-b815-3e3c63582c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6176ce32e2945cbac1d04222ff9fb44'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.213566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-603be4ef-5535-409a-b815-3e3c63582c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6176ce32e2945cbac1d04222ff9fb44'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.242425 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-603be4ef-5535-409a-b815-3e3c63582c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6176ce32e2945cbac1d04222ff9fb44'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.243470 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-603be4ef-5535-409a-b815-3e3c63582c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6176ce32e2945cbac1d04222ff9fb44'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.250518 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 937/1873] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:55 2021] DELETE /identity/v3/users/f6176ce32e2945cbac1d04222ff9fb44 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:55.255332 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5cbb0-cfe5-4b1b-b45f-62497cb5d6a9 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:55.255623 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5cbb0-cfe5-4b1b-b45f-62497cb5d6a9 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:55.256999 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5cbb0-cfe5-4b1b-b45f-62497cb5d6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:55.277876 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-95b5cbb0-cfe5-4b1b-b45f-62497cb5d6a9 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:55.279192 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-95b5cbb0-cfe5-4b1b-b45f-62497cb5d6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:55.352693 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 937/1874] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:32:55.363698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603be4ef-5535-409a-b815-3e3c63582c85 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:55.367092 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-603be4ef-5535-409a-b815-3e3c63582c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:55.375921 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5cbb0-cfe5-4b1b-b45f-62497cb5d6a9 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:55.382775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-95b5cbb0-cfe5-4b1b-b45f-62497cb5d6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:55.410485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5cbb0-cfe5-4b1b-b45f-62497cb5d6a9 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:55.424456 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7c2cf-7521-482c-967c-464ae96ada4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:55.426459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c2cf-7521-482c-967c-464ae96ada4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:55.426872 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c2cf-7521-482c-967c-464ae96ada4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:55.427572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c2cf-7521-482c-967c-464ae96ada4a admin admin] PATH_INFO: `/v3/users/bd8a3b37886944a3b97eb2f903162a15` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:55.432841 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7c2cf-7521-482c-967c-464ae96ada4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8a3b37886944a3b97eb2f903162a15)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:55.436059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7c2cf-7521-482c-967c-464ae96ada4a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:55.483063 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603be4ef-5535-409a-b815-3e3c63582c85 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:55.487478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5b93a-4b18-4e76-8739-d97dacd4a1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:55.488133 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b93a-4b18-4e76-8739-d97dacd4a1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:55.488565 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b93a-4b18-4e76-8739-d97dacd4a1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:55.489008 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b93a-4b18-4e76-8739-d97dacd4a1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:55.502376 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5b93a-4b18-4e76-8739-d97dacd4a1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:55.503986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5b93a-4b18-4e76-8739-d97dacd4a1c4 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:55.508062 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4be7c2cf-7521-482c-967c-464ae96ada4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8a3b37886944a3b97eb2f903162a15'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.514282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 938/1875] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:55.517961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4be7c2cf-7521-482c-967c-464ae96ada4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8a3b37886944a3b97eb2f903162a15'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.518729 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4be7c2cf-7521-482c-967c-464ae96ada4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8a3b37886944a3b97eb2f903162a15'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.537074 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4be7c2cf-7521-482c-967c-464ae96ada4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8a3b37886944a3b97eb2f903162a15'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.538451 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4be7c2cf-7521-482c-967c-464ae96ada4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8a3b37886944a3b97eb2f903162a15'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.557791 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 938/1876] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:55 2021] DELETE /identity/v3/users/bd8a3b37886944a3b97eb2f903162a15 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:55.562656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337110-d9a3-4862-bb0c-0d842f384379 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:55.563026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337110-d9a3-4862-bb0c-0d842f384379 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:55.563311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337110-d9a3-4862-bb0c-0d842f384379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:55.581600 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f4337110-d9a3-4862-bb0c-0d842f384379 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:55.582728 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f4337110-d9a3-4862-bb0c-0d842f384379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:55.657897 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 939/1877] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:32:55.674097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7c2cf-7521-482c-967c-464ae96ada4a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:55.675907 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-4be7c2cf-7521-482c-967c-464ae96ada4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:55.752057 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7c2cf-7521-482c-967c-464ae96ada4a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:55.756773 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659faf1-f7b0-4ba4-b1d4-d5c012979d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:55.757988 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659faf1-f7b0-4ba4-b1d4-d5c012979d6f service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:55.758379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659faf1-f7b0-4ba4-b1d4-d5c012979d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:55.758761 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659faf1-f7b0-4ba4-b1d4-d5c012979d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:55.770886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659faf1-f7b0-4ba4-b1d4-d5c012979d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:55.773988 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659faf1-f7b0-4ba4-b1d4-d5c012979d6f service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:55.787785 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 939/1878] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:55.848533 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4337110-d9a3-4862-bb0c-0d842f384379 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:55.850271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f4337110-d9a3-4862-bb0c-0d842f384379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:55.863773 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4337110-d9a3-4862-bb0c-0d842f384379 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:55.870601 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:55.871546 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:55.871906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:55.872480 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] PATH_INFO: `/v3/projects/36ebdcfef58f4767b9c9a70cf47d910e` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:55.873879 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ebdcfef58f4767b9c9a70cf47d910e)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:55.876641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:55.938968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ebdcfef58f4767b9c9a70cf47d910e', 'request_id': 'req-9fc61339-8bab-42bf-afbd-2952b6b6326a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.946203 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ebdcfef58f4767b9c9a70cf47d910e', 'request_id': 'req-9fc61339-8bab-42bf-afbd-2952b6b6326a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.960130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ebdcfef58f4767b9c9a70cf47d910e', 'request_id': 'req-9fc61339-8bab-42bf-afbd-2952b6b6326a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.973933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] The token cache is being invalidate because project 36ebdcfef58f4767b9c9a70cf47d910e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:55.974254 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.975361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:55.977420 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 940/1879] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:55 2021] DELETE /identity/v3/projects/36ebdcfef58f4767b9c9a70cf47d910e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:55.981408 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659faf1-f7b0-4ba4-b1d4-d5c012979d6f service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:55.994230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659faf1-f7b0-4ba4-b1d4-d5c012979d6f service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:56.072348 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c9ddc-c1c8-4176-b253-0dcb028f4bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:56.073243 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c9ddc-c1c8-4176-b253-0dcb028f4bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:56.073524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c9ddc-c1c8-4176-b253-0dcb028f4bca admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:56.074344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c9ddc-c1c8-4176-b253-0dcb028f4bca admin admin] PATH_INFO: `/v3/users/2d8c41ae0a7a463ebc1dd260a81c0a6e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:56.075595 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c9ddc-c1c8-4176-b253-0dcb028f4bca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8c41ae0a7a463ebc1dd260a81c0a6e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:56.078400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c9ddc-c1c8-4176-b253-0dcb028f4bca admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:56.150485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1f8c9ddc-c1c8-4176-b253-0dcb028f4bca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8c41ae0a7a463ebc1dd260a81c0a6e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.158631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1f8c9ddc-c1c8-4176-b253-0dcb028f4bca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8c41ae0a7a463ebc1dd260a81c0a6e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.159642 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1f8c9ddc-c1c8-4176-b253-0dcb028f4bca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8c41ae0a7a463ebc1dd260a81c0a6e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.178369 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1f8c9ddc-c1c8-4176-b253-0dcb028f4bca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8c41ae0a7a463ebc1dd260a81c0a6e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.179570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1f8c9ddc-c1c8-4176-b253-0dcb028f4bca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8c41ae0a7a463ebc1dd260a81c0a6e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.192763 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:56.195289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:56.204919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 940/1880] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:55 2021] DELETE /identity/v3/users/2d8c41ae0a7a463ebc1dd260a81c0a6e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:56.208827 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc61339-8bab-42bf-afbd-2952b6b6326a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:56.297687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:56.298555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:56.299002 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:56.299284 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] PATH_INFO: `/v3/projects/55beb93ae9864e32a526c50fefedb7a3` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:56.300640 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55beb93ae9864e32a526c50fefedb7a3)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:56.302558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:56.388253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55beb93ae9864e32a526c50fefedb7a3', 'request_id': 'req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.398766 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55beb93ae9864e32a526c50fefedb7a3', 'request_id': 'req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.414402 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55beb93ae9864e32a526c50fefedb7a3', 'request_id': 'req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.429382 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] The token cache is being invalidate because project 55beb93ae9864e32a526c50fefedb7a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:56.429682 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.430371 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.433145 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 941/1881] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:56 2021] DELETE /identity/v3/projects/55beb93ae9864e32a526c50fefedb7a3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:56.437133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c9ddc-c1c8-4176-b253-0dcb028f4bca admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:56.439351 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-1f8c9ddc-c1c8-4176-b253-0dcb028f4bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:56.455506 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c9ddc-c1c8-4176-b253-0dcb028f4bca admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:56.531116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7a07b-734e-4233-83a6-efc766899eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:56.532427 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7a07b-734e-4233-83a6-efc766899eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:56.532697 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7a07b-734e-4233-83a6-efc766899eee admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:56.532906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7a07b-734e-4233-83a6-efc766899eee admin admin] PATH_INFO: `/v3/users/34811da4c1ee4ed48251f53f08f455eb` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:56.534118 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7a07b-734e-4233-83a6-efc766899eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=34811da4c1ee4ed48251f53f08f455eb)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:56.536161 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7a07b-734e-4233-83a6-efc766899eee admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:56.552027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:56.554740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:56.579894 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc65cb4-f33e-454d-8bb6-74aeb50cc154 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:56.590013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f893d7-2d3f-4896-884d-87622533eef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:56.590957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f893d7-2d3f-4896-884d-87622533eef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:56.591384 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f893d7-2d3f-4896-884d-87622533eef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:56.591808 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f893d7-2d3f-4896-884d-87622533eef4 admin admin] PATH_INFO: `/v3/projects/d4310ecf05f94b28a5d466c433715c82` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:56.593140 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f893d7-2d3f-4896-884d-87622533eef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4310ecf05f94b28a5d466c433715c82)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:56.595332 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f893d7-2d3f-4896-884d-87622533eef4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:56.628716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-94a7a07b-734e-4233-83a6-efc766899eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34811da4c1ee4ed48251f53f08f455eb'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.645593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-94a7a07b-734e-4233-83a6-efc766899eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34811da4c1ee4ed48251f53f08f455eb'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.646312 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-94a7a07b-734e-4233-83a6-efc766899eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34811da4c1ee4ed48251f53f08f455eb'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.659658 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-94a7a07b-734e-4233-83a6-efc766899eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34811da4c1ee4ed48251f53f08f455eb'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.660370 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-94a7a07b-734e-4233-83a6-efc766899eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34811da4c1ee4ed48251f53f08f455eb'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.663226 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-e4f893d7-2d3f-4896-884d-87622533eef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4310ecf05f94b28a5d466c433715c82', 'request_id': 'req-e4f893d7-2d3f-4896-884d-87622533eef4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.671125 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-e4f893d7-2d3f-4896-884d-87622533eef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4310ecf05f94b28a5d466c433715c82', 'request_id': 'req-e4f893d7-2d3f-4896-884d-87622533eef4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.674397 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 941/1882] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:56 2021] DELETE /identity/v3/users/34811da4c1ee4ed48251f53f08f455eb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:56.680945 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-e4f893d7-2d3f-4896-884d-87622533eef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4310ecf05f94b28a5d466c433715c82', 'request_id': 'req-e4f893d7-2d3f-4896-884d-87622533eef4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.693071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-e4f893d7-2d3f-4896-884d-87622533eef4 admin admin] The token cache is being invalidate because project d4310ecf05f94b28a5d466c433715c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:56.693898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-e4f893d7-2d3f-4896-884d-87622533eef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.696871 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-e4f893d7-2d3f-4896-884d-87622533eef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:56.698451 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 942/1883] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:56 2021] DELETE /identity/v3/projects/d4310ecf05f94b28a5d466c433715c82 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:56.703970 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773470-6d47-44b4-a576-9ab62c839fdb None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:56.704264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773470-6d47-44b4-a576-9ab62c839fdb None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:56.704548 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773470-6d47-44b4-a576-9ab62c839fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:56.723130 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-24773470-6d47-44b4-a576-9ab62c839fdb None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:56.724350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-24773470-6d47-44b4-a576-9ab62c839fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:56.796000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 942/1884] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:56.804119 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2b4a8-948c-4b54-a02b-a70424c25f86 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:56.804415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2b4a8-948c-4b54-a02b-a70424c25f86 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:56.804699 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2b4a8-948c-4b54-a02b-a70424c25f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:56.834684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-1be2b4a8-948c-4b54-a02b-a70424c25f86 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:56.836136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1be2b4a8-948c-4b54-a02b-a70424c25f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:56.846392 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 943/1885] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:56.851312 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24773470-6d47-44b4-a576-9ab62c839fdb None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:56.861379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24773470-6d47-44b4-a576-9ab62c839fdb None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:56.867594 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4ec94-6593-413d-8605-2af94d08b080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:56.868596 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4ec94-6593-413d-8605-2af94d08b080 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:56.868936 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4ec94-6593-413d-8605-2af94d08b080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:56.869193 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4ec94-6593-413d-8605-2af94d08b080 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:56.870065 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4ec94-6593-413d-8605-2af94d08b080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:32:56.870461 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4ec94-6593-413d-8605-2af94d08b080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:56.872156 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4ec94-6593-413d-8605-2af94d08b080 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:56.886708 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 943/1886] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:32:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:32:56.891872 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2b4a8-948c-4b54-a02b-a70424c25f86 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:56.903740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2b4a8-948c-4b54-a02b-a70424c25f86 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:56.909820 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9dd74-ace3-4d35-8227-9290430c5fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:56.910581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9dd74-ace3-4d35-8227-9290430c5fcc admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:56.910989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9dd74-ace3-4d35-8227-9290430c5fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:56.911361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9dd74-ace3-4d35-8227-9290430c5fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:56.912183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9dd74-ace3-4d35-8227-9290430c5fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:56.914603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9dd74-ace3-4d35-8227-9290430c5fcc admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:56.919706 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4ec94-6593-413d-8605-2af94d08b080 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:56.921699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-51e4ec94-6593-413d-8605-2af94d08b080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:56.937858 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4ec94-6593-413d-8605-2af94d08b080 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:56.951825 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0a656-4992-4516-ac48-82712271e05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:56.951825 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0a656-4992-4516-ac48-82712271e05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:56.951825 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0a656-4992-4516-ac48-82712271e05b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:56.952191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0a656-4992-4516-ac48-82712271e05b admin admin] PATH_INFO: `/v3/users/45b5e858be954c6e873e0fdc6fd33866` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:56.953892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0a656-4992-4516-ac48-82712271e05b admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b5e858be954c6e873e0fdc6fd33866)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:56.957874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0a656-4992-4516-ac48-82712271e05b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:56.969239 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 944/1887] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:56 2021] POST /identity/v3/projects => generated 365 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:56.974433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9dd74-ace3-4d35-8227-9290430c5fcc admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:57.040331 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d9a0a656-4992-4516-ac48-82712271e05b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b5e858be954c6e873e0fdc6fd33866'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:57.049818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d9a0a656-4992-4516-ac48-82712271e05b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b5e858be954c6e873e0fdc6fd33866'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:57.050618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d9a0a656-4992-4516-ac48-82712271e05b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b5e858be954c6e873e0fdc6fd33866'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:57.065592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d9a0a656-4992-4516-ac48-82712271e05b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b5e858be954c6e873e0fdc6fd33866'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:57.075059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d9a0a656-4992-4516-ac48-82712271e05b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b5e858be954c6e873e0fdc6fd33866'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:57.082777 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 944/1888] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:56 2021] DELETE /identity/v3/users/45b5e858be954c6e873e0fdc6fd33866 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:32:57.086416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0a656-4992-4516-ac48-82712271e05b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:57.086416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d9a0a656-4992-4516-ac48-82712271e05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:57.092535 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9dd74-ace3-4d35-8227-9290430c5fcc admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:57.156140 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d95ad8-f548-4a8e-beaf-8ba6310fbc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:57.158631 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d95ad8-f548-4a8e-beaf-8ba6310fbc65 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.158970 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d95ad8-f548-4a8e-beaf-8ba6310fbc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.159750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d95ad8-f548-4a8e-beaf-8ba6310fbc65 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.159953 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d95ad8-f548-4a8e-beaf-8ba6310fbc65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:57.162016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d95ad8-f548-4a8e-beaf-8ba6310fbc65 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:57.163666 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0a656-4992-4516-ac48-82712271e05b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:57.168441 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:57.169344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.169635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.169909 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] PATH_INFO: `/v3/projects/e3dd6c5ef3fd452d828949dbf0b2ddfe` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.171363 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3dd6c5ef3fd452d828949dbf0b2ddfe)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:57.173400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:57.190797 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 945/1889] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:56 2021] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:57.192190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58454dbf-7292-4c88-b59e-20ad8dd638b8 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.192811 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58454dbf-7292-4c88-b59e-20ad8dd638b8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.193371 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58454dbf-7292-4c88-b59e-20ad8dd638b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.224239 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-58454dbf-7292-4c88-b59e-20ad8dd638b8 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:57.226404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-58454dbf-7292-4c88-b59e-20ad8dd638b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:57.235573 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 946/1890] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:57.236624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58454dbf-7292-4c88-b59e-20ad8dd638b8 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:57.238100 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-58454dbf-7292-4c88-b59e-20ad8dd638b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:57.251569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58454dbf-7292-4c88-b59e-20ad8dd638b8 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:57.267517 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3dd6c5ef3fd452d828949dbf0b2ddfe', 'request_id': 'req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:57.279211 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3dd6c5ef3fd452d828949dbf0b2ddfe', 'request_id': 'req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:57.286527 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3dd6c5ef3fd452d828949dbf0b2ddfe', 'request_id': 'req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:57.312254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] The token cache is being invalidate because project e3dd6c5ef3fd452d828949dbf0b2ddfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:57.312817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:57.313960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:57.323725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 945/1891] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:57 2021] DELETE /identity/v3/projects/e3dd6c5ef3fd452d828949dbf0b2ddfe => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:57.324890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:57.326258 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:57.332137 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fbd3a-3260-4649-990d-51383bc2e83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:57.332828 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fbd3a-3260-4649-990d-51383bc2e83f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.333120 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fbd3a-3260-4649-990d-51383bc2e83f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.333404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fbd3a-3260-4649-990d-51383bc2e83f admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.334694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fbd3a-3260-4649-990d-51383bc2e83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:57.336467 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fbd3a-3260-4649-990d-51383bc2e83f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:57.346596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 947/1892] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:57 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:57.347878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7a1d4-3d2c-4d0c-a377-eb2e6cca5fc4 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.348178 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7a1d4-3d2c-4d0c-a377-eb2e6cca5fc4 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.348468 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7a1d4-3d2c-4d0c-a377-eb2e6cca5fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.368045 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-6af7a1d4-3d2c-4d0c-a377-eb2e6cca5fc4 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:57.369060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6af7a1d4-3d2c-4d0c-a377-eb2e6cca5fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:57.377927 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 948/1893] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:57.386235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7a1d4-3d2c-4d0c-a377-eb2e6cca5fc4 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:57.387946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6af7a1d4-3d2c-4d0c-a377-eb2e6cca5fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:57.393351 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529efc7-5278-4c55-ae71-b1f1c66eaf4d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:57.399683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5fc7e-7a33-4832-b80a-813422b5c12d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:57.400561 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5fc7e-7a33-4832-b80a-813422b5c12d service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.401023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5fc7e-7a33-4832-b80a-813422b5c12d service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.401377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5fc7e-7a33-4832-b80a-813422b5c12d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.402255 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7a1d4-3d2c-4d0c-a377-eb2e6cca5fc4 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:57.403885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-88c5fc7e-7a33-4832-b80a-813422b5c12d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:57.407770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b219197-7eb6-40be-bf8f-a5056dfb111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:57.408581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219197-7eb6-40be-bf8f-a5056dfb111f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.409014 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219197-7eb6-40be-bf8f-a5056dfb111f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.409394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219197-7eb6-40be-bf8f-a5056dfb111f admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.410258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b219197-7eb6-40be-bf8f-a5056dfb111f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:57.412189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b219197-7eb6-40be-bf8f-a5056dfb111f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:57.416479 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5fc7e-7a33-4832-b80a-813422b5c12d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:57.417926 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5fc7e-7a33-4832-b80a-813422b5c12d service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:57.422784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 949/1894] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:57 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:57.424256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f349b8-4d45-41e9-ad6a-f8ffb3fb0473 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.424724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f349b8-4d45-41e9-ad6a-f8ffb3fb0473 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.425209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f349b8-4d45-41e9-ad6a-f8ffb3fb0473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.429159 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 946/1895] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:57.429910 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5fc7e-7a33-4832-b80a-813422b5c12d service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:57.439303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5fc7e-7a33-4832-b80a-813422b5c12d service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:57.446923 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f1f349b8-4d45-41e9-ad6a-f8ffb3fb0473 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:57.448409 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f1f349b8-4d45-41e9-ad6a-f8ffb3fb0473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:57.451623 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7e2e3-488c-4ff1-a4fd-c9ca95a4d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:57.452525 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7e2e3-488c-4ff1-a4fd-c9ca95a4d28a admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.453343 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7e2e3-488c-4ff1-a4fd-c9ca95a4d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.453343 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7e2e3-488c-4ff1-a4fd-c9ca95a4d28a admin admin] PATH_INFO: `/v3/projects/c6b9b9f210a741939078e7a54ed995f7/users/1a16d1a0ff59497fa4d87a86d4e16f3a/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.470450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7e2e3-488c-4ff1-a4fd-c9ca95a4d28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b9b9f210a741939078e7a54ed995f7, user_id=1a16d1a0ff59497fa4d87a86d4e16f3a, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:57.473268 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7e2e3-488c-4ff1-a4fd-c9ca95a4d28a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:57.475842 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 950/1896] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:57.476772 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f349b8-4d45-41e9-ad6a-f8ffb3fb0473 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:57.488044 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f349b8-4d45-41e9-ad6a-f8ffb3fb0473 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:57.498122 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 947/1897] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:57 2021] PUT /identity/v3/projects/c6b9b9f210a741939078e7a54ed995f7/users/1a16d1a0ff59497fa4d87a86d4e16f3a/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:57.510530 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf3969-68ef-4185-bfb3-5c4da2d9795a None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.510872 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf3969-68ef-4185-bfb3-5c4da2d9795a None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.511159 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf3969-68ef-4185-bfb3-5c4da2d9795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.543509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-b2cf3969-68ef-4185-bfb3-5c4da2d9795a None None] MFA Rules not processed for user `1a16d1a0ff59497fa4d87a86d4e16f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:57.545072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b2cf3969-68ef-4185-bfb3-5c4da2d9795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:57.576843 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58787b17-1829-41fa-bdc9-ab8fc42f5888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:57.577982 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58787b17-1829-41fa-bdc9-ab8fc42f5888 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.578533 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58787b17-1829-41fa-bdc9-ab8fc42f5888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.579093 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58787b17-1829-41fa-bdc9-ab8fc42f5888 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.580476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58787b17-1829-41fa-bdc9-ab8fc42f5888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:32:57.580868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58787b17-1829-41fa-bdc9-ab8fc42f5888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:57.584802 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58787b17-1829-41fa-bdc9-ab8fc42f5888 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:57.611806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 951/1898] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:32:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:32:57.617157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58787b17-1829-41fa-bdc9-ab8fc42f5888 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:57.630799 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58787b17-1829-41fa-bdc9-ab8fc42f5888 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:57.637491 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca76ef-b785-452e-abb8-2560e2860cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:57.638406 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca76ef-b785-452e-abb8-2560e2860cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.638799 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca76ef-b785-452e-abb8-2560e2860cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.639209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca76ef-b785-452e-abb8-2560e2860cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.640602 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca76ef-b785-452e-abb8-2560e2860cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:57.651070 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca76ef-b785-452e-abb8-2560e2860cf8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:57.659047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 948/1899] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:57 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:57.666274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf3969-68ef-4185-bfb3-5c4da2d9795a None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:57.685741 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf3969-68ef-4185-bfb3-5c4da2d9795a None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:57.694146 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e0e28-4391-462f-814b-8a21d7429059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:57.695152 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e0e28-4391-462f-814b-8a21d7429059 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.695778 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e0e28-4391-462f-814b-8a21d7429059 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.697103 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e0e28-4391-462f-814b-8a21d7429059 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.697948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e0e28-4391-462f-814b-8a21d7429059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:57.700193 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e0e28-4391-462f-814b-8a21d7429059 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:57.703591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 952/1900] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:57 2021] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:57.707539 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca76ef-b785-452e-abb8-2560e2860cf8 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:57.739765 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 949/1901] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:57 2021] POST /identity/v3/projects => generated 365 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:57.743792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e0e28-4391-462f-814b-8a21d7429059 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:57.821740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca76ef-b785-452e-abb8-2560e2860cf8 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:57.840486 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e0e28-4391-462f-814b-8a21d7429059 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:57.846666 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01fceb-b106-43ec-b7af-90ade84dc928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:57.848047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01fceb-b106-43ec-b7af-90ade84dc928 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.848431 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01fceb-b106-43ec-b7af-90ade84dc928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.848868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01fceb-b106-43ec-b7af-90ade84dc928 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.850541 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01fceb-b106-43ec-b7af-90ade84dc928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:57.857003 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01fceb-b106-43ec-b7af-90ade84dc928 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:57.887901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 950/1902] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:57 2021] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:57.891774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01fceb-b106-43ec-b7af-90ade84dc928 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:57.893817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-df01fceb-b106-43ec-b7af-90ade84dc928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:57.904514 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1b401-1b6f-48c2-8090-073feb4fc622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:57.905258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1b401-1b6f-48c2-8090-073feb4fc622 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.905490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1b401-1b6f-48c2-8090-073feb4fc622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.905903 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1b401-1b6f-48c2-8090-073feb4fc622 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.906384 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01fceb-b106-43ec-b7af-90ade84dc928 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:57.906620 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1b401-1b6f-48c2-8090-073feb4fc622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:57.908690 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1b401-1b6f-48c2-8090-073feb4fc622 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:57.911166 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:57.912651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.912941 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.913220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] PATH_INFO: `/v3/projects/527d4912ba674e9397a95ac169009931` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.914426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527d4912ba674e9397a95ac169009931)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:57.916411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:57.933502 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 953/1903] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:57 2021] POST /identity/v3/users => generated 285 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:32:57.934629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1b401-1b6f-48c2-8090-073feb4fc622 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:57.946243 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1b401-1b6f-48c2-8090-073feb4fc622 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:57.951598 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a553a63-1f42-4115-b038-195945c2c8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:57.952292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a553a63-1f42-4115-b038-195945c2c8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:57.952513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a553a63-1f42-4115-b038-195945c2c8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:57.952796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a553a63-1f42-4115-b038-195945c2c8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:57.954125 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a553a63-1f42-4115-b038-195945c2c8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:57.955779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a553a63-1f42-4115-b038-195945c2c8b0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:57.971686 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 954/1904] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:57 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:57.972705 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a553a63-1f42-4115-b038-195945c2c8b0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:57.985403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a553a63-1f42-4115-b038-195945c2c8b0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:57.993022 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527d4912ba674e9397a95ac169009931', 'request_id': 'req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:58.002589 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527d4912ba674e9397a95ac169009931', 'request_id': 'req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:58.011768 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527d4912ba674e9397a95ac169009931', 'request_id': 'req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:58.038004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] The token cache is being invalidate because project 527d4912ba674e9397a95ac169009931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:58.038389 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:58.039209 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:58.041109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 951/1905] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:57 2021] DELETE /identity/v3/projects/527d4912ba674e9397a95ac169009931 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:58.041905 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:58.043951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:58.079604 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f714ee7-bc12-48fc-ba18-ba3e97a95aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:58.080494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714ee7-bc12-48fc-ba18-ba3e97a95aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.080726 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714ee7-bc12-48fc-ba18-ba3e97a95aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.081011 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714ee7-bc12-48fc-ba18-ba3e97a95aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.081883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f714ee7-bc12-48fc-ba18-ba3e97a95aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:58.083687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f714ee7-bc12-48fc-ba18-ba3e97a95aa9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:58.095616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 955/1906] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:57 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:58.100200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f714ee7-bc12-48fc-ba18-ba3e97a95aa9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:58.103138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1f714ee7-bc12-48fc-ba18-ba3e97a95aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:58.117549 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f714ee7-bc12-48fc-ba18-ba3e97a95aa9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:58.124501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142040-ea50-4ab7-8fdf-5f344c863e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:58.125643 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142040-ea50-4ab7-8fdf-5f344c863e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.125782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664a742-b9ed-47c2-9bfb-cfe86a8dea87 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:58.126588 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142040-ea50-4ab7-8fdf-5f344c863e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.127117 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142040-ea50-4ab7-8fdf-5f344c863e0d admin admin] PATH_INFO: `/v3/users/ffeec23a6fb143a1aed43041e9c78417` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.128622 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0142040-ea50-4ab7-8fdf-5f344c863e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffeec23a6fb143a1aed43041e9c78417)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:58.131925 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6a58f-2607-4631-8e3b-e5586ff91fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:58.132771 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0142040-ea50-4ab7-8fdf-5f344c863e0d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:58.132886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6a58f-2607-4631-8e3b-e5586ff91fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.133249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6a58f-2607-4631-8e3b-e5586ff91fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.133543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6a58f-2607-4631-8e3b-e5586ff91fb4 admin admin] PATH_INFO: `/v3/projects/88c69aaa94bf4a6c9f3723e8fb6b4937/users/26ea9d3353ae49d8b4824c0abd7b79cf/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.153934 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6a58f-2607-4631-8e3b-e5586ff91fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c69aaa94bf4a6c9f3723e8fb6b4937, user_id=26ea9d3353ae49d8b4824c0abd7b79cf, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:58.157374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6a58f-2607-4631-8e3b-e5586ff91fb4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:58.178829 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 952/1907] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:58 2021] PUT /identity/v3/projects/88c69aaa94bf4a6c9f3723e8fb6b4937/users/26ea9d3353ae49d8b4824c0abd7b79cf/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:58.180635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a3d6c-43de-42b7-a598-48fa1451afac None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.180935 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a3d6c-43de-42b7-a598-48fa1451afac None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.181218 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a3d6c-43de-42b7-a598-48fa1451afac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.193574 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-e0142040-ea50-4ab7-8fdf-5f344c863e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffeec23a6fb143a1aed43041e9c78417'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:58.203945 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-e0142040-ea50-4ab7-8fdf-5f344c863e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffeec23a6fb143a1aed43041e9c78417'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:58.207743 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-cd4a3d6c-43de-42b7-a598-48fa1451afac None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:58.209244 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-cd4a3d6c-43de-42b7-a598-48fa1451afac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:58.217815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-e0142040-ea50-4ab7-8fdf-5f344c863e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffeec23a6fb143a1aed43041e9c78417'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:58.237325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-e0142040-ea50-4ab7-8fdf-5f344c863e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffeec23a6fb143a1aed43041e9c78417'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:58.238126 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-e0142040-ea50-4ab7-8fdf-5f344c863e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffeec23a6fb143a1aed43041e9c78417'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:58.247711 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 956/1908] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:58 2021] DELETE /identity/v3/users/ffeec23a6fb143a1aed43041e9c78417 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:58.248950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142040-ea50-4ab7-8fdf-5f344c863e0d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:58.251352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e0142040-ea50-4ab7-8fdf-5f344c863e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:58.297344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 953/1909] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:58.298201 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a3d6c-43de-42b7-a598-48fa1451afac None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:58.300754 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-cd4a3d6c-43de-42b7-a598-48fa1451afac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:58.317122 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a3d6c-43de-42b7-a598-48fa1451afac None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:58.337271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142040-ea50-4ab7-8fdf-5f344c863e0d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:58.344049 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9a8b3-0a86-44c5-87f9-4b6c6ded3894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:58.345167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a8b3-0a86-44c5-87f9-4b6c6ded3894 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.345465 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a8b3-0a86-44c5-87f9-4b6c6ded3894 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.345756 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a8b3-0a86-44c5-87f9-4b6c6ded3894 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.346579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9a8b3-0a86-44c5-87f9-4b6c6ded3894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:58.357254 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9a8b3-0a86-44c5-87f9-4b6c6ded3894 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:58.360609 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 957/1910] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:58 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:58.364648 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e24b-9f14-4a35-857f-a88f8b4eecc6 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.364953 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e24b-9f14-4a35-857f-a88f8b4eecc6 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.365763 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e24b-9f14-4a35-857f-a88f8b4eecc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.382900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d54a4-ec9d-4b99-b0cf-13706f02dfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:58.384609 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-5df8e24b-9f14-4a35-857f-a88f8b4eecc6 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:58.384783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d54a4-ec9d-4b99-b0cf-13706f02dfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.385072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d54a4-ec9d-4b99-b0cf-13706f02dfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.385352 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d54a4-ec9d-4b99-b0cf-13706f02dfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.385847 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-5df8e24b-9f14-4a35-857f-a88f8b4eecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:58.386230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d54a4-ec9d-4b99-b0cf-13706f02dfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:58.388005 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d54a4-ec9d-4b99-b0cf-13706f02dfa4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:58.394584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 958/1911] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:58.395673 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588428b8-3cce-4831-8cff-35224c5c2b9f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.395966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588428b8-3cce-4831-8cff-35224c5c2b9f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.396246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588428b8-3cce-4831-8cff-35224c5c2b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.403965 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 954/1912] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:58 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:58.405101 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d54a4-ec9d-4b99-b0cf-13706f02dfa4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:58.416320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d54a4-ec9d-4b99-b0cf-13706f02dfa4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:58.419449 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-588428b8-3cce-4831-8cff-35224c5c2b9f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:58.420655 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-588428b8-3cce-4831-8cff-35224c5c2b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:58.421967 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9847b-0e01-4e37-9308-8b2446421248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:58.422877 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9847b-0e01-4e37-9308-8b2446421248 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.423176 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9847b-0e01-4e37-9308-8b2446421248 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.423457 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9847b-0e01-4e37-9308-8b2446421248 admin admin] PATH_INFO: `/v3/projects/5684b0dc6ed242a791b9afaaceac1828/users/b18017f455214415bb241cda6cb137fc/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.430234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 959/1913] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:58.431373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588428b8-3cce-4831-8cff-35224c5c2b9f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:58.432843 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-588428b8-3cce-4831-8cff-35224c5c2b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:58.452502 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9847b-0e01-4e37-9308-8b2446421248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5684b0dc6ed242a791b9afaaceac1828, user_id=b18017f455214415bb241cda6cb137fc, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:58.455219 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9847b-0e01-4e37-9308-8b2446421248 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:58.469672 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 955/1914] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:58 2021] PUT /identity/v3/projects/5684b0dc6ed242a791b9afaaceac1828/users/b18017f455214415bb241cda6cb137fc/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:58.470415 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9847b-0e01-4e37-9308-8b2446421248 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:58.495235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588428b8-3cce-4831-8cff-35224c5c2b9f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:58.540233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9847b-0e01-4e37-9308-8b2446421248 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:58.545102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d852b-1460-4d00-8388-b8e65dbcdb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:58.545995 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d852b-1460-4d00-8388-b8e65dbcdb6d admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.546328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d852b-1460-4d00-8388-b8e65dbcdb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.546552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d852b-1460-4d00-8388-b8e65dbcdb6d admin admin] PATH_INFO: `/v3/projects/88c69aaa94bf4a6c9f3723e8fb6b4937/users/26ea9d3353ae49d8b4824c0abd7b79cf/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.547628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da3d7d-d745-46eb-b75b-380ad7b1ca51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:58.548278 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da3d7d-d745-46eb-b75b-380ad7b1ca51 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.548563 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da3d7d-d745-46eb-b75b-380ad7b1ca51 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.548676 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d852b-1460-4d00-8388-b8e65dbcdb6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c69aaa94bf4a6c9f3723e8fb6b4937, user_id=26ea9d3353ae49d8b4824c0abd7b79cf, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:58.548851 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da3d7d-d745-46eb-b75b-380ad7b1ca51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.551438 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d852b-1460-4d00-8388-b8e65dbcdb6d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:58.562256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da3d7d-d745-46eb-b75b-380ad7b1ca51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:58.562459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 956/1915] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:58 2021] PUT /identity/v3/projects/88c69aaa94bf4a6c9f3723e8fb6b4937/users/26ea9d3353ae49d8b4824c0abd7b79cf/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:58.563877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da3d7d-d745-46eb-b75b-380ad7b1ca51 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:58.567696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d852b-1460-4d00-8388-b8e65dbcdb6d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:58.575642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 960/1916] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:58.577136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09168f4-dc08-4f1e-b793-e5a9416488fe None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.577624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09168f4-dc08-4f1e-b793-e5a9416488fe None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.578295 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09168f4-dc08-4f1e-b793-e5a9416488fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.611610 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-e09168f4-dc08-4f1e-b793-e5a9416488fe None None] MFA Rules not processed for user `b18017f455214415bb241cda6cb137fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:58.613407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e09168f4-dc08-4f1e-b793-e5a9416488fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:58.649245 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d852b-1460-4d00-8388-b8e65dbcdb6d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:58.655987 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e872c9e-721a-4835-bb52-9b3d49dd7ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:58.656980 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e872c9e-721a-4835-bb52-9b3d49dd7ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.657262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e872c9e-721a-4835-bb52-9b3d49dd7ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.657967 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e872c9e-721a-4835-bb52-9b3d49dd7ba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.658343 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e872c9e-721a-4835-bb52-9b3d49dd7ba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:32:58.658931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e872c9e-721a-4835-bb52-9b3d49dd7ba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:58.660995 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e872c9e-721a-4835-bb52-9b3d49dd7ba6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:58.678277 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 957/1917] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:32:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:32:58.679449 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eebe8-19bb-4d36-9698-fff5abd8f049 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.680199 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eebe8-19bb-4d36-9698-fff5abd8f049 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.680480 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eebe8-19bb-4d36-9698-fff5abd8f049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.718700 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-b37eebe8-19bb-4d36-9698-fff5abd8f049 None None] MFA Rules not processed for user `26ea9d3353ae49d8b4824c0abd7b79cf`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:58.719739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 961/1918] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:58 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:58.726170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b37eebe8-19bb-4d36-9698-fff5abd8f049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:58.728046 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09168f4-dc08-4f1e-b793-e5a9416488fe None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:58.745064 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09168f4-dc08-4f1e-b793-e5a9416488fe None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:58.760067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f3871-c8a0-4285-a0a2-6889596af9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:58.760897 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f3871-c8a0-4285-a0a2-6889596af9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.761186 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f3871-c8a0-4285-a0a2-6889596af9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.761461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f3871-c8a0-4285-a0a2-6889596af9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.762160 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f3871-c8a0-4285-a0a2-6889596af9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:58.766097 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f3871-c8a0-4285-a0a2-6889596af9b2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:58.820026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 962/1919] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:32:58 2021] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:58.821603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f3871-c8a0-4285-a0a2-6889596af9b2 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:58.823710 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-bd3f3871-c8a0-4285-a0a2-6889596af9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:58.829328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 958/1920] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:58 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:58.829328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37eebe8-19bb-4d36-9698-fff5abd8f049 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:58.843309 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37eebe8-19bb-4d36-9698-fff5abd8f049 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:58.906259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f3871-c8a0-4285-a0a2-6889596af9b2 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:58.922563 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9c3d8-4217-47a9-981e-78f0a422ae5d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cab78404d3c4980a4b99da09edab426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:58.923517 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9c3d8-4217-47a9-981e-78f0a422ae5d service glance] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.923956 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9c3d8-4217-47a9-981e-78f0a422ae5d service glance] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.924306 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9c3d8-4217-47a9-981e-78f0a422ae5d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.948434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb84db1-5927-405d-b04a-4364393d6357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:58.949136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb84db1-5927-405d-b04a-4364393d6357 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:58.949420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb84db1-5927-405d-b04a-4364393d6357 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:58.949697 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb84db1-5927-405d-b04a-4364393d6357 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:58.951023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb84db1-5927-405d-b04a-4364393d6357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:58.953270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb84db1-5927-405d-b04a-4364393d6357 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:58.989726 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 959/1921] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:32:58 2021] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:32:58.990482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb84db1-5927-405d-b04a-4364393d6357 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:58.993326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-1eb84db1-5927-405d-b04a-4364393d6357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:59.022769 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9c3d8-4217-47a9-981e-78f0a422ae5d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:59.024413 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9c3d8-4217-47a9-981e-78f0a422ae5d service glance] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:59.034659 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 963/1922] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:58 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:59.036276 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9c3d8-4217-47a9-981e-78f0a422ae5d service glance] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:59.038112 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0ca9c3d8-4217-47a9-981e-78f0a422ae5d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:59.060384 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb84db1-5927-405d-b04a-4364393d6357 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:59.066345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9c3d8-4217-47a9-981e-78f0a422ae5d service glance] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:59.071675 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505d86a-bc60-4f22-b5e1-02a7e86bc5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:59.072132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505d86a-bc60-4f22-b5e1-02a7e86bc5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:59.072327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505d86a-bc60-4f22-b5e1-02a7e86bc5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:59.072610 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505d86a-bc60-4f22-b5e1-02a7e86bc5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:59.074901 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:59.075786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:59.076075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:59.076351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] PATH_INFO: `/v3/projects/a2e2ff8803f54646bfc2d2412b42a919` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:59.077824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e2ff8803f54646bfc2d2412b42a919)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:59.080333 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:59.154336 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e2ff8803f54646bfc2d2412b42a919', 'request_id': 'req-017eda46-88ba-470f-a26e-8a878074eed2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:59.165340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e2ff8803f54646bfc2d2412b42a919', 'request_id': 'req-017eda46-88ba-470f-a26e-8a878074eed2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:59.165731 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505d86a-bc60-4f22-b5e1-02a7e86bc5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:59.167562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505d86a-bc60-4f22-b5e1-02a7e86bc5f6 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:59.185059 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e2ff8803f54646bfc2d2412b42a919', 'request_id': 'req-017eda46-88ba-470f-a26e-8a878074eed2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:59.188948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 960/1923] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:58 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:59.189845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505d86a-bc60-4f22-b5e1-02a7e86bc5f6 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:59.200817 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] The token cache is being invalidate because project a2e2ff8803f54646bfc2d2412b42a919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:32:59.201245 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:59.201451 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505d86a-bc60-4f22-b5e1-02a7e86bc5f6 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:59.202540 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:59.207031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 964/1924] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:59 2021] DELETE /identity/v3/projects/a2e2ff8803f54646bfc2d2412b42a919 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:59.208623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:59.211500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:59.292304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118f708-c7ae-4950-aaf0-9bb850d2a469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:59.293112 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f708-c7ae-4950-aaf0-9bb850d2a469 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:59.293452 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f708-c7ae-4950-aaf0-9bb850d2a469 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:59.293782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f708-c7ae-4950-aaf0-9bb850d2a469 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:59.294783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118f708-c7ae-4950-aaf0-9bb850d2a469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:59.301191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118f708-c7ae-4950-aaf0-9bb850d2a469 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:59.310826 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eda46-88ba-470f-a26e-8a878074eed2 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:59.328670 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea3130-cc58-4650-84be-ec7903388678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:59.329319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 961/1925] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:59 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:59.329800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea3130-cc58-4650-84be-ec7903388678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:59.331220 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea3130-cc58-4650-84be-ec7903388678 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:59.331641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea3130-cc58-4650-84be-ec7903388678 admin admin] PATH_INFO: `/v3/users/a10737c1918d4780a0277f4250b70da4` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:59.333302 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea3130-cc58-4650-84be-ec7903388678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10737c1918d4780a0277f4250b70da4)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:59.335810 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118f708-c7ae-4950-aaf0-9bb850d2a469 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:59.342792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3118f708-c7ae-4950-aaf0-9bb850d2a469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:59.353903 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea3130-cc58-4650-84be-ec7903388678 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:59.363341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118f708-c7ae-4950-aaf0-9bb850d2a469 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:59.370956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a7345-d5ea-478f-93b8-a110c67b5550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:59.371324 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a7345-d5ea-478f-93b8-a110c67b5550 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:59.371715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a7345-d5ea-478f-93b8-a110c67b5550 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:59.372149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a7345-d5ea-478f-93b8-a110c67b5550 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:59.372997 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a7345-d5ea-478f-93b8-a110c67b5550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:59.374860 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a7345-d5ea-478f-93b8-a110c67b5550 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:59.393324 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 962/1926] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:32:59 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:32:59.394569 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a7345-d5ea-478f-93b8-a110c67b5550 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:59.407633 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a7345-d5ea-478f-93b8-a110c67b5550 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:59.416308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aa3d2-a986-406e-ab8c-d2bf34dce213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:59.418205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aa3d2-a986-406e-ab8c-d2bf34dce213 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:59.424657 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aa3d2-a986-406e-ab8c-d2bf34dce213 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:59.425522 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aa3d2-a986-406e-ab8c-d2bf34dce213 admin admin] PATH_INFO: `/v3/projects/bfce037592134840ab857fb86ab0fb06/users/19adaca24f4a40959ac6c04457122230/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:59.456354 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-60ea3130-cc58-4650-84be-ec7903388678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10737c1918d4780a0277f4250b70da4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:59.466534 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-60ea3130-cc58-4650-84be-ec7903388678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10737c1918d4780a0277f4250b70da4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:59.469104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4aa3d2-a986-406e-ab8c-d2bf34dce213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfce037592134840ab857fb86ab0fb06, user_id=19adaca24f4a40959ac6c04457122230, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:59.472980 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4aa3d2-a986-406e-ab8c-d2bf34dce213 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:59.478952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-60ea3130-cc58-4650-84be-ec7903388678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10737c1918d4780a0277f4250b70da4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:59.495033 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 963/1927] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:32:59 2021] PUT /identity/v3/projects/bfce037592134840ab857fb86ab0fb06/users/19adaca24f4a40959ac6c04457122230/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:59.498597 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aa3d2-a986-406e-ab8c-d2bf34dce213 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:59.505068 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-60ea3130-cc58-4650-84be-ec7903388678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10737c1918d4780a0277f4250b70da4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:59.505446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0f4aa3d2-a986-406e-ab8c-d2bf34dce213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:59.506509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-60ea3130-cc58-4650-84be-ec7903388678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10737c1918d4780a0277f4250b70da4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:32:59.515678 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 965/1928] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:32:59 2021] DELETE /identity/v3/users/a10737c1918d4780a0277f4250b70da4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:32:59.517225 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d674a04-7df7-455a-9594-06fd8ab53e61 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:59.517628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d674a04-7df7-455a-9594-06fd8ab53e61 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:59.518041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d674a04-7df7-455a-9594-06fd8ab53e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:59.559846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-3d674a04-7df7-455a-9594-06fd8ab53e61 None None] MFA Rules not processed for user `19adaca24f4a40959ac6c04457122230`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:32:59.561429 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-3d674a04-7df7-455a-9594-06fd8ab53e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:59.626175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aa3d2-a986-406e-ab8c-d2bf34dce213 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:59.650685 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 966/1929] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:32:59 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:32:59.699569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d674a04-7df7-455a-9594-06fd8ab53e61 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:59.701156 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-3d674a04-7df7-455a-9594-06fd8ab53e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:59.745653 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ddd93-a6f6-4fa3-9eb4-884fe4e3bd03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:59.746561 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ddd93-a6f6-4fa3-9eb4-884fe4e3bd03 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:59.747080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ddd93-a6f6-4fa3-9eb4-884fe4e3bd03 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:59.747455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ddd93-a6f6-4fa3-9eb4-884fe4e3bd03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:59.749919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9f8ddd93-a6f6-4fa3-9eb4-884fe4e3bd03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:32:59.802337 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d674a04-7df7-455a-9594-06fd8ab53e61 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:32:59.814630 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0732b9-0e45-44fd-92d8-e3fa4039ea3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:32:59.816523 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0732b9-0e45-44fd-92d8-e3fa4039ea3e service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:32:59.816886 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0732b9-0e45-44fd-92d8-e3fa4039ea3e service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:32:59.819233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0732b9-0e45-44fd-92d8-e3fa4039ea3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:32:59.834483 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0732b9-0e45-44fd-92d8-e3fa4039ea3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:59.837408 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0732b9-0e45-44fd-92d8-e3fa4039ea3e service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:59.846922 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ddd93-a6f6-4fa3-9eb4-884fe4e3bd03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:32:59.848901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ddd93-a6f6-4fa3-9eb4-884fe4e3bd03 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:32:59.849355 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 967/1930] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:59 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:32:59.860840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 964/1931] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:32:59 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:32:59.899640 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0732b9-0e45-44fd-92d8-e3fa4039ea3e service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:32:59.901442 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-fe0732b9-0e45-44fd-92d8-e3fa4039ea3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:00.055623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0732b9-0e45-44fd-92d8-e3fa4039ea3e service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:00.075406 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:00.076448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:00.076628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:00.076848 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] PATH_INFO: `/v3/projects/08b4da5c1ea04b93982268d9ba09c350` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:00.078087 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b4da5c1ea04b93982268d9ba09c350)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:00.080712 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:00.148193 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b4da5c1ea04b93982268d9ba09c350', 'request_id': 'req-d203dad9-b7e5-4e6d-87aa-497cd2b30215'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:00.156031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b4da5c1ea04b93982268d9ba09c350', 'request_id': 'req-d203dad9-b7e5-4e6d-87aa-497cd2b30215'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:00.173846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b4da5c1ea04b93982268d9ba09c350', 'request_id': 'req-d203dad9-b7e5-4e6d-87aa-497cd2b30215'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:00.195929 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] The token cache is being invalidate because project 08b4da5c1ea04b93982268d9ba09c350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:00.196325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:00.197523 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:00.199550 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 968/1932] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:32:59 2021] DELETE /identity/v3/projects/08b4da5c1ea04b93982268d9ba09c350 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:00.203770 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ddd93-a6f6-4fa3-9eb4-884fe4e3bd03 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:00.218548 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ddd93-a6f6-4fa3-9eb4-884fe4e3bd03 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:00.330172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd9dca-c15e-4d2b-bb0e-392bafb32b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:00.331101 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9dca-c15e-4d2b-bb0e-392bafb32b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:00.331383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9dca-c15e-4d2b-bb0e-392bafb32b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:00.331667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9dca-c15e-4d2b-bb0e-392bafb32b0e admin admin] PATH_INFO: `/v3/users/7034c195f21645159a02d2cc4f358db4` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:00.335091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd9dca-c15e-4d2b-bb0e-392bafb32b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7034c195f21645159a02d2cc4f358db4)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:00.339024 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd9dca-c15e-4d2b-bb0e-392bafb32b0e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:00.433637 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-efcd9dca-c15e-4d2b-bb0e-392bafb32b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7034c195f21645159a02d2cc4f358db4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:00.449283 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-efcd9dca-c15e-4d2b-bb0e-392bafb32b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7034c195f21645159a02d2cc4f358db4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:00.450281 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-efcd9dca-c15e-4d2b-bb0e-392bafb32b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7034c195f21645159a02d2cc4f358db4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:00.469181 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-efcd9dca-c15e-4d2b-bb0e-392bafb32b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7034c195f21645159a02d2cc4f358db4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:00.469877 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-efcd9dca-c15e-4d2b-bb0e-392bafb32b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7034c195f21645159a02d2cc4f358db4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:00.489474 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 965/1933] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:00 2021] DELETE /identity/v3/users/7034c195f21645159a02d2cc4f358db4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:00.983638 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:00.985151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:01.000726 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203dad9-b7e5-4e6d-87aa-497cd2b30215 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:01.058959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f234da-6c5b-4a95-aeb7-a28f9897d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:01.059875 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f234da-6c5b-4a95-aeb7-a28f9897d142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:01.060161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f234da-6c5b-4a95-aeb7-a28f9897d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:01.060440 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f234da-6c5b-4a95-aeb7-a28f9897d142 admin admin] PATH_INFO: `/v3/projects/54793f4b5f45411cbc8b8aabc5242d3a` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:01.061646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f234da-6c5b-4a95-aeb7-a28f9897d142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54793f4b5f45411cbc8b8aabc5242d3a)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:01.063634 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f234da-6c5b-4a95-aeb7-a28f9897d142 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:01.108711 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-12f234da-6c5b-4a95-aeb7-a28f9897d142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54793f4b5f45411cbc8b8aabc5242d3a', 'request_id': 'req-12f234da-6c5b-4a95-aeb7-a28f9897d142'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:01.114562 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-12f234da-6c5b-4a95-aeb7-a28f9897d142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54793f4b5f45411cbc8b8aabc5242d3a', 'request_id': 'req-12f234da-6c5b-4a95-aeb7-a28f9897d142'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:01.122909 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-12f234da-6c5b-4a95-aeb7-a28f9897d142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54793f4b5f45411cbc8b8aabc5242d3a', 'request_id': 'req-12f234da-6c5b-4a95-aeb7-a28f9897d142'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:01.133798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-12f234da-6c5b-4a95-aeb7-a28f9897d142 admin admin] The token cache is being invalidate because project 54793f4b5f45411cbc8b8aabc5242d3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:01.134183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-12f234da-6c5b-4a95-aeb7-a28f9897d142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:01.134980 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-12f234da-6c5b-4a95-aeb7-a28f9897d142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:01.141314 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 969/1934] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:00 2021] DELETE /identity/v3/projects/54793f4b5f45411cbc8b8aabc5242d3a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:01.143014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86a720-f07b-4d91-a1e8-f67318d63c5f None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:01.143313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86a720-f07b-4d91-a1e8-f67318d63c5f None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:01.143608 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86a720-f07b-4d91-a1e8-f67318d63c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:01.161480 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-5b86a720-f07b-4d91-a1e8-f67318d63c5f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:01.163591 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-5b86a720-f07b-4d91-a1e8-f67318d63c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:01.223014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 966/1935] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:33:01.231463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420712a-bf47-49ee-b00e-dd37cc067281 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:01.231765 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420712a-bf47-49ee-b00e-dd37cc067281 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:01.232068 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420712a-bf47-49ee-b00e-dd37cc067281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:01.250995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f420712a-bf47-49ee-b00e-dd37cc067281 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:01.252446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f420712a-bf47-49ee-b00e-dd37cc067281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:01.260933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 970/1936] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:01.265201 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86a720-f07b-4d91-a1e8-f67318d63c5f None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:01.275387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86a720-f07b-4d91-a1e8-f67318d63c5f None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:01.279977 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85552278-835b-4195-a026-f062914b5562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:01.280630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85552278-835b-4195-a026-f062914b5562 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:01.280914 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85552278-835b-4195-a026-f062914b5562 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:01.281187 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85552278-835b-4195-a026-f062914b5562 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:01.281962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85552278-835b-4195-a026-f062914b5562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:33:01.282264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85552278-835b-4195-a026-f062914b5562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:01.283890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85552278-835b-4195-a026-f062914b5562 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:01.298776 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 967/1937] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:33:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:33:01.300532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420712a-bf47-49ee-b00e-dd37cc067281 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:01.311136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420712a-bf47-49ee-b00e-dd37cc067281 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:01.315914 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdb323-5c7a-409b-8839-8bc6864711ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:01.316577 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdb323-5c7a-409b-8839-8bc6864711ea admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:01.316870 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdb323-5c7a-409b-8839-8bc6864711ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:01.317156 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdb323-5c7a-409b-8839-8bc6864711ea admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:01.317860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdb323-5c7a-409b-8839-8bc6864711ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:01.320121 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdb323-5c7a-409b-8839-8bc6864711ea admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:01.350349 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 971/1938] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:01 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:33:01.351772 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85552278-835b-4195-a026-f062914b5562 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:01.361983 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85552278-835b-4195-a026-f062914b5562 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:01.428660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11910de-0511-4d3b-805a-bd75a8eef226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:01.429346 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11910de-0511-4d3b-805a-bd75a8eef226 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:01.430243 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11910de-0511-4d3b-805a-bd75a8eef226 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:01.430243 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11910de-0511-4d3b-805a-bd75a8eef226 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:01.430581 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11910de-0511-4d3b-805a-bd75a8eef226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:01.432531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11910de-0511-4d3b-805a-bd75a8eef226 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:01.453380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 968/1939] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:01 2021] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:01.457597 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdb323-5c7a-409b-8839-8bc6864711ea admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:01.468279 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdb323-5c7a-409b-8839-8bc6864711ea admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:01.472930 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013db85-5e15-4f7d-b248-04bfd47221b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:01.473642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013db85-5e15-4f7d-b248-04bfd47221b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:01.473868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013db85-5e15-4f7d-b248-04bfd47221b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:01.474141 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013db85-5e15-4f7d-b248-04bfd47221b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:01.475613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013db85-5e15-4f7d-b248-04bfd47221b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:01.477226 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013db85-5e15-4f7d-b248-04bfd47221b1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:01.488459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 972/1940] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:01.492744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11910de-0511-4d3b-805a-bd75a8eef226 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:01.505467 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11910de-0511-4d3b-805a-bd75a8eef226 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:01.510617 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37f709-f4f1-4a31-aa09-65607b1e0f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:01.511334 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37f709-f4f1-4a31-aa09-65607b1e0f6d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:01.511626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37f709-f4f1-4a31-aa09-65607b1e0f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:01.511913 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37f709-f4f1-4a31-aa09-65607b1e0f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:01.512647 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37f709-f4f1-4a31-aa09-65607b1e0f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:01.514282 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37f709-f4f1-4a31-aa09-65607b1e0f6d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:01.525414 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 969/1941] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:01 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:01.529744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013db85-5e15-4f7d-b248-04bfd47221b1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:01.542017 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013db85-5e15-4f7d-b248-04bfd47221b1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:01.546745 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc1fb8-341d-4e5e-8671-82f4f32267f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:01.547679 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc1fb8-341d-4e5e-8671-82f4f32267f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:01.547969 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc1fb8-341d-4e5e-8671-82f4f32267f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:01.548393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc1fb8-341d-4e5e-8671-82f4f32267f9 admin admin] PATH_INFO: `/v3/projects/148b1eb8db104096ae5c8041e2945bae/users/2a11b68cbc0e410dab2a5630f95b9802/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:01.681801 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc1fb8-341d-4e5e-8671-82f4f32267f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=148b1eb8db104096ae5c8041e2945bae, user_id=2a11b68cbc0e410dab2a5630f95b9802, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:01.684695 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc1fb8-341d-4e5e-8671-82f4f32267f9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:01.699700 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 973/1942] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:01 2021] PUT /identity/v3/projects/148b1eb8db104096ae5c8041e2945bae/users/2a11b68cbc0e410dab2a5630f95b9802/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:01.711238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411009b-57ee-4dbb-b109-ba4cc25cef5c None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:01.711606 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411009b-57ee-4dbb-b109-ba4cc25cef5c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:01.711967 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411009b-57ee-4dbb-b109-ba4cc25cef5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:01.741593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-7411009b-57ee-4dbb-b109-ba4cc25cef5c None None] MFA Rules not processed for user `2a11b68cbc0e410dab2a5630f95b9802`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:01.743019 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7411009b-57ee-4dbb-b109-ba4cc25cef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:01.817231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 970/1943] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:01 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:33:01.827798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc1fb8-341d-4e5e-8671-82f4f32267f9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:01.829481 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4ecc1fb8-341d-4e5e-8671-82f4f32267f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:01.892076 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc1fb8-341d-4e5e-8671-82f4f32267f9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:01.895870 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96ef5b-a6c3-4cc4-be6b-305cee1dc968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:01.897268 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ef5b-a6c3-4cc4-be6b-305cee1dc968 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:01.897647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ef5b-a6c3-4cc4-be6b-305cee1dc968 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:01.897926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96ef5b-a6c3-4cc4-be6b-305cee1dc968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:01.906391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96ef5b-a6c3-4cc4-be6b-305cee1dc968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:01.907858 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96ef5b-a6c3-4cc4-be6b-305cee1dc968 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:01.917030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 974/1944] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:01 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:04.390068 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e2be0-b83a-4e58-b6c9-a983f416ef50 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:04.390626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e2be0-b83a-4e58-b6c9-a983f416ef50 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:04.390626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e2be0-b83a-4e58-b6c9-a983f416ef50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:04.408907 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-e74e2be0-b83a-4e58-b6c9-a983f416ef50 None None] MFA Rules not processed for user `2a11b68cbc0e410dab2a5630f95b9802`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:04.410120 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e74e2be0-b83a-4e58-b6c9-a983f416ef50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:04.417763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 971/1945] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:04 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:13.940352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96ef5b-a6c3-4cc4-be6b-305cee1dc968 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:13.941836 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1d96ef5b-a6c3-4cc4-be6b-305cee1dc968 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:14.009624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96ef5b-a6c3-4cc4-be6b-305cee1dc968 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:14.014306 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722eec7a-538e-4f5d-9f7f-2ffbb12cdd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:14.015224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722eec7a-538e-4f5d-9f7f-2ffbb12cdd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:14.015522 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722eec7a-538e-4f5d-9f7f-2ffbb12cdd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:14.015802 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722eec7a-538e-4f5d-9f7f-2ffbb12cdd29 admin admin] PATH_INFO: `/v3/users/1a16d1a0ff59497fa4d87a86d4e16f3a` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:14.017388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722eec7a-538e-4f5d-9f7f-2ffbb12cdd29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a16d1a0ff59497fa4d87a86d4e16f3a)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:14.019375 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722eec7a-538e-4f5d-9f7f-2ffbb12cdd29 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:14.066271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-722eec7a-538e-4f5d-9f7f-2ffbb12cdd29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a16d1a0ff59497fa4d87a86d4e16f3a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.073472 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-722eec7a-538e-4f5d-9f7f-2ffbb12cdd29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a16d1a0ff59497fa4d87a86d4e16f3a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.080455 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-722eec7a-538e-4f5d-9f7f-2ffbb12cdd29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a16d1a0ff59497fa4d87a86d4e16f3a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.093625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-722eec7a-538e-4f5d-9f7f-2ffbb12cdd29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a16d1a0ff59497fa4d87a86d4e16f3a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.094781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-722eec7a-538e-4f5d-9f7f-2ffbb12cdd29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a16d1a0ff59497fa4d87a86d4e16f3a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.102348 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 975/1946] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:13 2021] DELETE /identity/v3/users/1a16d1a0ff59497fa4d87a86d4e16f3a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:14.113234 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034522e-072d-4529-9082-cea711e7d2b4 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:14.114312 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034522e-072d-4529-9082-cea711e7d2b4 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:14.114806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034522e-072d-4529-9082-cea711e7d2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:14.153204 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-5034522e-072d-4529-9082-cea711e7d2b4 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:14.154449 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-5034522e-072d-4529-9082-cea711e7d2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:14.230116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 972/1947] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:14.237164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722eec7a-538e-4f5d-9f7f-2ffbb12cdd29 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:14.238581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-722eec7a-538e-4f5d-9f7f-2ffbb12cdd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:14.296649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722eec7a-538e-4f5d-9f7f-2ffbb12cdd29 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:14.300654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7822a-1285-4089-b6bb-0668e210c5bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:14.301312 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7822a-1285-4089-b6bb-0668e210c5bb service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:14.301792 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7822a-1285-4089-b6bb-0668e210c5bb service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:14.302084 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7822a-1285-4089-b6bb-0668e210c5bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:14.311456 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7822a-1285-4089-b6bb-0668e210c5bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:14.312912 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7822a-1285-4089-b6bb-0668e210c5bb service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:14.323224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 976/1948] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:14.585458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034522e-072d-4529-9082-cea711e7d2b4 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:14.587716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-5034522e-072d-4529-9082-cea711e7d2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:14.603877 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034522e-072d-4529-9082-cea711e7d2b4 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:14.611797 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:14.613010 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:14.613377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:14.615184 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] PATH_INFO: `/v3/projects/c6b9b9f210a741939078e7a54ed995f7` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:14.616671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b9b9f210a741939078e7a54ed995f7)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:14.618632 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:14.677645 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b9b9f210a741939078e7a54ed995f7', 'request_id': 'req-18f16bd2-2b53-48a0-9b02-530791cbbd0a'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.685327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b9b9f210a741939078e7a54ed995f7', 'request_id': 'req-18f16bd2-2b53-48a0-9b02-530791cbbd0a'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.700854 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b9b9f210a741939078e7a54ed995f7', 'request_id': 'req-18f16bd2-2b53-48a0-9b02-530791cbbd0a'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.719772 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] The token cache is being invalidate because project c6b9b9f210a741939078e7a54ed995f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:14.720508 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.721407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.727416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 973/1949] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:14 2021] DELETE /identity/v3/projects/c6b9b9f210a741939078e7a54ed995f7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:14.731664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7822a-1285-4089-b6bb-0668e210c5bb service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:14.742104 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7822a-1285-4089-b6bb-0668e210c5bb service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:14.797581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a95dea-3e72-4d60-95fc-47ab7589981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:14.798555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a95dea-3e72-4d60-95fc-47ab7589981c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:14.798866 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a95dea-3e72-4d60-95fc-47ab7589981c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:14.799154 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a95dea-3e72-4d60-95fc-47ab7589981c admin admin] PATH_INFO: `/v3/users/26ea9d3353ae49d8b4824c0abd7b79cf` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:14.800336 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a95dea-3e72-4d60-95fc-47ab7589981c admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ea9d3353ae49d8b4824c0abd7b79cf)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:14.802253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a95dea-3e72-4d60-95fc-47ab7589981c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:14.846611 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-36a95dea-3e72-4d60-95fc-47ab7589981c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ea9d3353ae49d8b4824c0abd7b79cf'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.854004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-36a95dea-3e72-4d60-95fc-47ab7589981c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ea9d3353ae49d8b4824c0abd7b79cf'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.862248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-36a95dea-3e72-4d60-95fc-47ab7589981c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ea9d3353ae49d8b4824c0abd7b79cf'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.876782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-36a95dea-3e72-4d60-95fc-47ab7589981c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ea9d3353ae49d8b4824c0abd7b79cf'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.877608 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-36a95dea-3e72-4d60-95fc-47ab7589981c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ea9d3353ae49d8b4824c0abd7b79cf'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:14.887165 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 977/1950] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:14 2021] DELETE /identity/v3/users/26ea9d3353ae49d8b4824c0abd7b79cf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:15.174354 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:15.175990 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:15.189699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f16bd2-2b53-48a0-9b02-530791cbbd0a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:15.248251 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d42461-c198-4feb-bc19-0866e8413fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:15.249118 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d42461-c198-4feb-bc19-0866e8413fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:15.249403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d42461-c198-4feb-bc19-0866e8413fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:15.249683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d42461-c198-4feb-bc19-0866e8413fd0 admin admin] PATH_INFO: `/v3/projects/88c69aaa94bf4a6c9f3723e8fb6b4937` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:15.250887 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d42461-c198-4feb-bc19-0866e8413fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c69aaa94bf4a6c9f3723e8fb6b4937)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:15.252797 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d42461-c198-4feb-bc19-0866e8413fd0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:15.298366 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-70d42461-c198-4feb-bc19-0866e8413fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c69aaa94bf4a6c9f3723e8fb6b4937', 'request_id': 'req-70d42461-c198-4feb-bc19-0866e8413fd0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:15.303760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-70d42461-c198-4feb-bc19-0866e8413fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c69aaa94bf4a6c9f3723e8fb6b4937', 'request_id': 'req-70d42461-c198-4feb-bc19-0866e8413fd0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:15.309789 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-70d42461-c198-4feb-bc19-0866e8413fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c69aaa94bf4a6c9f3723e8fb6b4937', 'request_id': 'req-70d42461-c198-4feb-bc19-0866e8413fd0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:15.322864 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-70d42461-c198-4feb-bc19-0866e8413fd0 admin admin] The token cache is being invalidate because project 88c69aaa94bf4a6c9f3723e8fb6b4937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:15.323174 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-70d42461-c198-4feb-bc19-0866e8413fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:15.323795 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-70d42461-c198-4feb-bc19-0866e8413fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:15.325325 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 974/1951] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:15 2021] DELETE /identity/v3/projects/88c69aaa94bf4a6c9f3723e8fb6b4937 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:15.331016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85162c15-d2d8-4467-89d9-cf6656a5efec None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:15.331483 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85162c15-d2d8-4467-89d9-cf6656a5efec None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:15.331572 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85162c15-d2d8-4467-89d9-cf6656a5efec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:15.349343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-85162c15-d2d8-4467-89d9-cf6656a5efec None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:15.351709 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-85162c15-d2d8-4467-89d9-cf6656a5efec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:15.409584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 978/1952] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:15.418177 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee564f-678f-47ab-877e-6d1afee058da None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:15.418468 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee564f-678f-47ab-877e-6d1afee058da None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:15.418753 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee564f-678f-47ab-877e-6d1afee058da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:15.438871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c1ee564f-678f-47ab-877e-6d1afee058da None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:15.440124 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c1ee564f-678f-47ab-877e-6d1afee058da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:15.451109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 975/1953] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:15.453888 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85162c15-d2d8-4467-89d9-cf6656a5efec None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:15.466781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85162c15-d2d8-4467-89d9-cf6656a5efec None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:15.480161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48685557-0c65-45ac-b3ef-859aac39d8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:15.480959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48685557-0c65-45ac-b3ef-859aac39d8fa admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:15.481495 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48685557-0c65-45ac-b3ef-859aac39d8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:15.481857 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48685557-0c65-45ac-b3ef-859aac39d8fa admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:15.482678 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48685557-0c65-45ac-b3ef-859aac39d8fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:33:15.483109 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48685557-0c65-45ac-b3ef-859aac39d8fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:15.484808 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48685557-0c65-45ac-b3ef-859aac39d8fa admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:15.500394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 979/1954] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:33:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:33:15.502812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee564f-678f-47ab-877e-6d1afee058da None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:15.513541 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee564f-678f-47ab-877e-6d1afee058da None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:15.518512 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fc14f-8e75-4a1b-a7e9-3252a24dd188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:15.520633 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc14f-8e75-4a1b-a7e9-3252a24dd188 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:15.520937 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc14f-8e75-4a1b-a7e9-3252a24dd188 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:15.521221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc14f-8e75-4a1b-a7e9-3252a24dd188 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:15.522539 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fc14f-8e75-4a1b-a7e9-3252a24dd188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:15.524587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fc14f-8e75-4a1b-a7e9-3252a24dd188 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:15.554726 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 976/1955] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:15 2021] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:33:15.556297 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48685557-0c65-45ac-b3ef-859aac39d8fa admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:15.566996 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48685557-0c65-45ac-b3ef-859aac39d8fa admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:15.625473 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fb779-bb62-41b4-b036-3342cf733e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:15.626439 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fb779-bb62-41b4-b036-3342cf733e5a admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:15.626439 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fb779-bb62-41b4-b036-3342cf733e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:15.626605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fb779-bb62-41b4-b036-3342cf733e5a admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:15.627346 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fb779-bb62-41b4-b036-3342cf733e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:15.629345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fb779-bb62-41b4-b036-3342cf733e5a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:15.656735 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 980/1956] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:15 2021] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:33:15.657922 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fc14f-8e75-4a1b-a7e9-3252a24dd188 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:15.668923 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fc14f-8e75-4a1b-a7e9-3252a24dd188 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:15.673521 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562edd7a-3ec5-4284-9813-8d5db4e00c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:15.674195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562edd7a-3ec5-4284-9813-8d5db4e00c4b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:15.674483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562edd7a-3ec5-4284-9813-8d5db4e00c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:15.674763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562edd7a-3ec5-4284-9813-8d5db4e00c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:15.675654 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562edd7a-3ec5-4284-9813-8d5db4e00c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:15.677245 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562edd7a-3ec5-4284-9813-8d5db4e00c4b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:15.691807 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 977/1957] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:15 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:33:15.692968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fb779-bb62-41b4-b036-3342cf733e5a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:15.704270 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fb779-bb62-41b4-b036-3342cf733e5a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:15.709124 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf73f03-cd98-49da-b8f1-467c485ab8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:15.710344 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf73f03-cd98-49da-b8f1-467c485ab8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:15.710628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf73f03-cd98-49da-b8f1-467c485ab8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:15.710937 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf73f03-cd98-49da-b8f1-467c485ab8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:15.711670 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf73f03-cd98-49da-b8f1-467c485ab8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:15.713269 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf73f03-cd98-49da-b8f1-467c485ab8a6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:15.728295 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 981/1958] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:15 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:15.730795 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562edd7a-3ec5-4284-9813-8d5db4e00c4b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:15.741602 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562edd7a-3ec5-4284-9813-8d5db4e00c4b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:15.746444 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af90961-6550-4135-a2dc-4d46ddb6b904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:15.747374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af90961-6550-4135-a2dc-4d46ddb6b904 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:15.747659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af90961-6550-4135-a2dc-4d46ddb6b904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:15.747933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af90961-6550-4135-a2dc-4d46ddb6b904 admin admin] PATH_INFO: `/v3/projects/6be5050608e34182bb7fd71ef392b76f/users/21c7d0648f4c4268bfbcb40ccce872ee/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:15.766657 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af90961-6550-4135-a2dc-4d46ddb6b904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be5050608e34182bb7fd71ef392b76f, user_id=21c7d0648f4c4268bfbcb40ccce872ee, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:15.769556 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af90961-6550-4135-a2dc-4d46ddb6b904 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:15.782448 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 978/1959] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:15 2021] PUT /identity/v3/projects/6be5050608e34182bb7fd71ef392b76f/users/21c7d0648f4c4268bfbcb40ccce872ee/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:33:15.793892 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bb0f1-7bd9-44f3-b020-e03218632172 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:15.794182 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bb0f1-7bd9-44f3-b020-e03218632172 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:15.794463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bb0f1-7bd9-44f3-b020-e03218632172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:15.828013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-8a9bb0f1-7bd9-44f3-b020-e03218632172 None None] MFA Rules not processed for user `21c7d0648f4c4268bfbcb40ccce872ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:15.829729 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8a9bb0f1-7bd9-44f3-b020-e03218632172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:15.902047 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 982/1960] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:15 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:15.906367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af90961-6550-4135-a2dc-4d46ddb6b904 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:15.976710 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af90961-6550-4135-a2dc-4d46ddb6b904 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:15.981690 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d28dc9-9157-4244-9a0e-95e8ccf740a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:15.985595 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d28dc9-9157-4244-9a0e-95e8ccf740a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:15.986097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d28dc9-9157-4244-9a0e-95e8ccf740a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:15.986441 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d28dc9-9157-4244-9a0e-95e8ccf740a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:15.987214 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d28dc9-9157-4244-9a0e-95e8ccf740a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:15.989179 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d28dc9-9157-4244-9a0e-95e8ccf740a6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:16.022874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 979/1961] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:15 2021] POST /identity/v3/projects => generated 399 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:16.024285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bb0f1-7bd9-44f3-b020-e03218632172 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:16.035651 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bb0f1-7bd9-44f3-b020-e03218632172 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:16.092560 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0f35a-c39d-43a5-8f66-258c53cbac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:16.093272 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0f35a-c39d-43a5-8f66-258c53cbac07 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:16.093557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0f35a-c39d-43a5-8f66-258c53cbac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:16.093834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0f35a-c39d-43a5-8f66-258c53cbac07 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:16.094539 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0f35a-c39d-43a5-8f66-258c53cbac07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:16.096605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0f35a-c39d-43a5-8f66-258c53cbac07 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:16.119266 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 983/1962] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:16 2021] POST /identity/v3/users => generated 306 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:16.123319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d28dc9-9157-4244-9a0e-95e8ccf740a6 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:16.133326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d28dc9-9157-4244-9a0e-95e8ccf740a6 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:16.138190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30daa86-94d0-4d2c-aa4f-b5c552d5938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:16.138889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30daa86-94d0-4d2c-aa4f-b5c552d5938c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:16.139178 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30daa86-94d0-4d2c-aa4f-b5c552d5938c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:16.139455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30daa86-94d0-4d2c-aa4f-b5c552d5938c admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:16.140175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30daa86-94d0-4d2c-aa4f-b5c552d5938c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:16.141853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30daa86-94d0-4d2c-aa4f-b5c552d5938c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:16.152027 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 980/1963] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:16 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:16.156153 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0f35a-c39d-43a5-8f66-258c53cbac07 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:16.166291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0f35a-c39d-43a5-8f66-258c53cbac07 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:16.171055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca46be-eb2e-4941-abbc-85247cd44b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:16.171985 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca46be-eb2e-4941-abbc-85247cd44b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:16.172276 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca46be-eb2e-4941-abbc-85247cd44b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:16.172558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca46be-eb2e-4941-abbc-85247cd44b83 admin admin] PATH_INFO: `/v3/projects/56481d867c5c45c6beb77bdf211d8d7c/users/cc16176b1f43459f8fac9f2a5ba4a234/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:16.187530 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca46be-eb2e-4941-abbc-85247cd44b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56481d867c5c45c6beb77bdf211d8d7c, user_id=cc16176b1f43459f8fac9f2a5ba4a234, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:16.190323 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca46be-eb2e-4941-abbc-85247cd44b83 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:16.203878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 984/1964] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:16 2021] PUT /identity/v3/projects/56481d867c5c45c6beb77bdf211d8d7c/users/cc16176b1f43459f8fac9f2a5ba4a234/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:33:16.207872 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30daa86-94d0-4d2c-aa4f-b5c552d5938c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:16.218614 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30daa86-94d0-4d2c-aa4f-b5c552d5938c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:16.273806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073acb6c-40ce-40af-b241-ea788024d2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:16.274476 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073acb6c-40ce-40af-b241-ea788024d2fb admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:16.274764 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073acb6c-40ce-40af-b241-ea788024d2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:16.275093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073acb6c-40ce-40af-b241-ea788024d2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:16.275812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073acb6c-40ce-40af-b241-ea788024d2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:16.277525 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073acb6c-40ce-40af-b241-ea788024d2fb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:16.288528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 981/1965] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:16 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:16.292642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca46be-eb2e-4941-abbc-85247cd44b83 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:16.303473 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca46be-eb2e-4941-abbc-85247cd44b83 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:16.308056 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c7ca0-ee20-4200-a865-3dcbae905e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:16.308935 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c7ca0-ee20-4200-a865-3dcbae905e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:16.309221 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c7ca0-ee20-4200-a865-3dcbae905e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:16.309502 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c7ca0-ee20-4200-a865-3dcbae905e51 admin admin] PATH_INFO: `/v3/projects/56481d867c5c45c6beb77bdf211d8d7c/users/cc16176b1f43459f8fac9f2a5ba4a234/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:16.311489 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c7ca0-ee20-4200-a865-3dcbae905e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56481d867c5c45c6beb77bdf211d8d7c, user_id=cc16176b1f43459f8fac9f2a5ba4a234, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:16.314275 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c7ca0-ee20-4200-a865-3dcbae905e51 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:16.324873 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 985/1966] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:16 2021] PUT /identity/v3/projects/56481d867c5c45c6beb77bdf211d8d7c/users/cc16176b1f43459f8fac9f2a5ba4a234/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:16.336159 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1b9a0-26e3-4592-b4f8-7d99f6c1fe85 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:16.336452 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1b9a0-26e3-4592-b4f8-7d99f6c1fe85 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:16.336735 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1b9a0-26e3-4592-b4f8-7d99f6c1fe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:16.364482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-06d1b9a0-26e3-4592-b4f8-7d99f6c1fe85 None None] MFA Rules not processed for user `cc16176b1f43459f8fac9f2a5ba4a234`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:16.365789 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-06d1b9a0-26e3-4592-b4f8-7d99f6c1fe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:16.434619 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 982/1967] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:16 2021] POST /identity/v3/auth/tokens => generated 3486 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:16.444667 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c7ca0-ee20-4200-a865-3dcbae905e51 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:16.446383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4b3c7ca0-ee20-4200-a865-3dcbae905e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:16.504089 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c7ca0-ee20-4200-a865-3dcbae905e51 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:16.508381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a15329-cae0-4867-b228-d86aa2e7a010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:16.509128 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a15329-cae0-4867-b228-d86aa2e7a010 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:16.509336 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a15329-cae0-4867-b228-d86aa2e7a010 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:16.509629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a15329-cae0-4867-b228-d86aa2e7a010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:16.519012 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a15329-cae0-4867-b228-d86aa2e7a010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:16.520440 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a15329-cae0-4867-b228-d86aa2e7a010 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:16.530920 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 986/1968] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:16 2021] GET /identity/v3/auth/tokens => generated 3486 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:16.609589 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1b9a0-26e3-4592-b4f8-7d99f6c1fe85 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:16.619545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1b9a0-26e3-4592-b4f8-7d99f6c1fe85 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:16.623194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579ac9d-1413-4410-b103-086063ebf84b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:16.623833 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579ac9d-1413-4410-b103-086063ebf84b service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:16.624120 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579ac9d-1413-4410-b103-086063ebf84b service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:16.624398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579ac9d-1413-4410-b103-086063ebf84b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:16.680484 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579ac9d-1413-4410-b103-086063ebf84b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:16.681968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579ac9d-1413-4410-b103-086063ebf84b service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:16.690830 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 983/1969] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:16 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:22.621967 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a15329-cae0-4867-b228-d86aa2e7a010 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:22.626697 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-78a15329-cae0-4867-b228-d86aa2e7a010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:22.690457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a15329-cae0-4867-b228-d86aa2e7a010 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:22.696027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090eda0-e362-446b-a319-6cc519515c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:22.696892 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090eda0-e362-446b-a319-6cc519515c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:22.697174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090eda0-e362-446b-a319-6cc519515c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:22.697448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090eda0-e362-446b-a319-6cc519515c4e admin admin] PATH_INFO: `/v3/users/de9afb44d4b74521af5386541a1ad201` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:22.698623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090eda0-e362-446b-a319-6cc519515c4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=de9afb44d4b74521af5386541a1ad201)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:22.700569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090eda0-e362-446b-a319-6cc519515c4e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:22.752770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9090eda0-e362-446b-a319-6cc519515c4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9afb44d4b74521af5386541a1ad201'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:22.754533 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9090eda0-e362-446b-a319-6cc519515c4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9afb44d4b74521af5386541a1ad201'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:22.763527 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9090eda0-e362-446b-a319-6cc519515c4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9afb44d4b74521af5386541a1ad201'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:22.775651 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9090eda0-e362-446b-a319-6cc519515c4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9afb44d4b74521af5386541a1ad201'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:22.776292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9090eda0-e362-446b-a319-6cc519515c4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9afb44d4b74521af5386541a1ad201'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:22.782319 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 987/1970] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:22 2021] DELETE /identity/v3/users/de9afb44d4b74521af5386541a1ad201 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:22.991689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579ac9d-1413-4410-b103-086063ebf84b service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:23.004419 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579ac9d-1413-4410-b103-086063ebf84b service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:23.065326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4d0fd-e13e-4c63-be88-68cd45559cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:23.066104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4d0fd-e13e-4c63-be88-68cd45559cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:23.066394 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4d0fd-e13e-4c63-be88-68cd45559cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:23.066675 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4d0fd-e13e-4c63-be88-68cd45559cc4 admin admin] PATH_INFO: `/v3/projects/e1b8447dba624010956c4df7b5b4b2d2` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:23.067912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4d0fd-e13e-4c63-be88-68cd45559cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b8447dba624010956c4df7b5b4b2d2)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:23.070023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4d0fd-e13e-4c63-be88-68cd45559cc4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:23.115704 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-12b4d0fd-e13e-4c63-be88-68cd45559cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b8447dba624010956c4df7b5b4b2d2', 'request_id': 'req-12b4d0fd-e13e-4c63-be88-68cd45559cc4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:23.121460 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-12b4d0fd-e13e-4c63-be88-68cd45559cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b8447dba624010956c4df7b5b4b2d2', 'request_id': 'req-12b4d0fd-e13e-4c63-be88-68cd45559cc4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:23.127533 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-12b4d0fd-e13e-4c63-be88-68cd45559cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b8447dba624010956c4df7b5b4b2d2', 'request_id': 'req-12b4d0fd-e13e-4c63-be88-68cd45559cc4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:23.139836 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-12b4d0fd-e13e-4c63-be88-68cd45559cc4 admin admin] The token cache is being invalidate because project e1b8447dba624010956c4df7b5b4b2d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:23.140129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-12b4d0fd-e13e-4c63-be88-68cd45559cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:23.140757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-12b4d0fd-e13e-4c63-be88-68cd45559cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:23.142298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 984/1971] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:22 2021] DELETE /identity/v3/projects/e1b8447dba624010956c4df7b5b4b2d2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:23.148847 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feb5c1-2194-48b5-8d53-57033fbf517a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:23.149132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feb5c1-2194-48b5-8d53-57033fbf517a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:23.149408 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feb5c1-2194-48b5-8d53-57033fbf517a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:23.167651 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-85feb5c1-2194-48b5-8d53-57033fbf517a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:23.168835 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-85feb5c1-2194-48b5-8d53-57033fbf517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:23.225244 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 988/1972] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:23.233905 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea4329-1f0d-413b-869d-a171ec85cb17 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:23.234231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea4329-1f0d-413b-869d-a171ec85cb17 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:23.234518 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea4329-1f0d-413b-869d-a171ec85cb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:23.253071 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-03ea4329-1f0d-413b-869d-a171ec85cb17 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:23.254382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-03ea4329-1f0d-413b-869d-a171ec85cb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:23.263605 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 985/1973] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:23.267980 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85feb5c1-2194-48b5-8d53-57033fbf517a None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:23.277904 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85feb5c1-2194-48b5-8d53-57033fbf517a None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:23.282734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965f6d8-d9dc-45d4-9a38-06e5a197bdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:23.283436 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965f6d8-d9dc-45d4-9a38-06e5a197bdfb admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:23.283722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965f6d8-d9dc-45d4-9a38-06e5a197bdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:23.284000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965f6d8-d9dc-45d4-9a38-06e5a197bdfb admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:23.284818 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965f6d8-d9dc-45d4-9a38-06e5a197bdfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:33:23.285294 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965f6d8-d9dc-45d4-9a38-06e5a197bdfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:23.287138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965f6d8-d9dc-45d4-9a38-06e5a197bdfb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:23.299684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 989/1974] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:33:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:33:23.304629 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea4329-1f0d-413b-869d-a171ec85cb17 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:23.313650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea4329-1f0d-413b-869d-a171ec85cb17 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:23.318733 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03542699-1db7-4e81-a9c7-382f5c65e89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:23.322816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03542699-1db7-4e81-a9c7-382f5c65e89d admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:23.323136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03542699-1db7-4e81-a9c7-382f5c65e89d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:23.323420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03542699-1db7-4e81-a9c7-382f5c65e89d admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:23.324174 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03542699-1db7-4e81-a9c7-382f5c65e89d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:23.326078 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03542699-1db7-4e81-a9c7-382f5c65e89d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:23.353350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 986/1975] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:23 2021] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:23.357401 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965f6d8-d9dc-45d4-9a38-06e5a197bdfb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:23.367558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965f6d8-d9dc-45d4-9a38-06e5a197bdfb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:23.424732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37219562-3f86-4adf-b91c-3b5f65ceb374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:23.425411 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37219562-3f86-4adf-b91c-3b5f65ceb374 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:23.425717 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37219562-3f86-4adf-b91c-3b5f65ceb374 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:23.425985 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37219562-3f86-4adf-b91c-3b5f65ceb374 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:23.426686 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37219562-3f86-4adf-b91c-3b5f65ceb374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:23.428838 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37219562-3f86-4adf-b91c-3b5f65ceb374 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:23.449546 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 990/1976] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:23 2021] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:23.453549 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03542699-1db7-4e81-a9c7-382f5c65e89d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:23.466363 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03542699-1db7-4e81-a9c7-382f5c65e89d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:23.471401 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f129967-3029-4e1a-bf18-9cd3b8e9ba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:23.472069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f129967-3029-4e1a-bf18-9cd3b8e9ba18 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:23.472383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f129967-3029-4e1a-bf18-9cd3b8e9ba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:23.472683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f129967-3029-4e1a-bf18-9cd3b8e9ba18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:23.473407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f129967-3029-4e1a-bf18-9cd3b8e9ba18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:23.475815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f129967-3029-4e1a-bf18-9cd3b8e9ba18 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:23.490190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 987/1977] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:23.493360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37219562-3f86-4adf-b91c-3b5f65ceb374 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:23.503869 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37219562-3f86-4adf-b91c-3b5f65ceb374 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:23.513476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e1019-216a-4fc0-aa61-fb9d1e1ac038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:23.514155 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e1019-216a-4fc0-aa61-fb9d1e1ac038 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:23.514443 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e1019-216a-4fc0-aa61-fb9d1e1ac038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:23.514725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e1019-216a-4fc0-aa61-fb9d1e1ac038 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:23.515523 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e1019-216a-4fc0-aa61-fb9d1e1ac038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:23.517192 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e1019-216a-4fc0-aa61-fb9d1e1ac038 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:23.531744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 991/1978] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:23.535900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f129967-3029-4e1a-bf18-9cd3b8e9ba18 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:23.547012 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f129967-3029-4e1a-bf18-9cd3b8e9ba18 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:23.552502 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c19582-d5e7-49e9-9a42-a2e3e3db1972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:23.553883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c19582-d5e7-49e9-9a42-a2e3e3db1972 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:23.554279 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c19582-d5e7-49e9-9a42-a2e3e3db1972 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:23.554636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c19582-d5e7-49e9-9a42-a2e3e3db1972 admin admin] PATH_INFO: `/v3/projects/17f63693c005407298128e59530b73b0/users/c68e7e8eb2b64d7587248e836633c2b5/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:23.578141 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c19582-d5e7-49e9-9a42-a2e3e3db1972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f63693c005407298128e59530b73b0, user_id=c68e7e8eb2b64d7587248e836633c2b5, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:23.580911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c19582-d5e7-49e9-9a42-a2e3e3db1972 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:23.596956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 988/1979] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:23 2021] PUT /identity/v3/projects/17f63693c005407298128e59530b73b0/users/c68e7e8eb2b64d7587248e836633c2b5/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:23.607467 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241953b-5ad4-4b24-9edb-96a56bbffa3f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:23.607932 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241953b-5ad4-4b24-9edb-96a56bbffa3f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:23.608540 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241953b-5ad4-4b24-9edb-96a56bbffa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:23.640671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-9241953b-5ad4-4b24-9edb-96a56bbffa3f None None] MFA Rules not processed for user `c68e7e8eb2b64d7587248e836633c2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:23.641881 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9241953b-5ad4-4b24-9edb-96a56bbffa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:23.713742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 992/1980] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:23 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:23.725048 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c19582-d5e7-49e9-9a42-a2e3e3db1972 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:23.727090 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e3c19582-d5e7-49e9-9a42-a2e3e3db1972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:23.805073 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c19582-d5e7-49e9-9a42-a2e3e3db1972 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:23.810644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a409466-0f40-4f77-9ce6-24eec3d954fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:23.811327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a409466-0f40-4f77-9ce6-24eec3d954fa service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:23.811611 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a409466-0f40-4f77-9ce6-24eec3d954fa service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:23.811888 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a409466-0f40-4f77-9ce6-24eec3d954fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:23.820160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a409466-0f40-4f77-9ce6-24eec3d954fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:23.821753 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a409466-0f40-4f77-9ce6-24eec3d954fa service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:23.830581 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 989/1981] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:23 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:24.029958 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241953b-5ad4-4b24-9edb-96a56bbffa3f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:24.098530 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241953b-5ad4-4b24-9edb-96a56bbffa3f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:24.111330 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaecc72-3422-468a-b053-f559cbabdb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:24.112426 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaecc72-3422-468a-b053-f559cbabdb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:24.112901 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaecc72-3422-468a-b053-f559cbabdb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:24.113426 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaecc72-3422-468a-b053-f559cbabdb0c admin admin] PATH_INFO: `/v3/users/c68e7e8eb2b64d7587248e836633c2b5` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:24.115293 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaecc72-3422-468a-b053-f559cbabdb0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68e7e8eb2b64d7587248e836633c2b5)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:24.119439 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaecc72-3422-468a-b053-f559cbabdb0c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:24.127146 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a409466-0f40-4f77-9ce6-24eec3d954fa service nova] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:24.129103 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6a409466-0f40-4f77-9ce6-24eec3d954fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:24.161319 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a409466-0f40-4f77-9ce6-24eec3d954fa service nova] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:24.168218 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861200f-4a5b-4bba-a4ea-9c2a2b7fea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:24.169356 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861200f-4a5b-4bba-a4ea-9c2a2b7fea58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:24.169657 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861200f-4a5b-4bba-a4ea-9c2a2b7fea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:24.170011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861200f-4a5b-4bba-a4ea-9c2a2b7fea58 admin admin] PATH_INFO: `/v3/users/21c7d0648f4c4268bfbcb40ccce872ee` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:24.171583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861200f-4a5b-4bba-a4ea-9c2a2b7fea58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c7d0648f4c4268bfbcb40ccce872ee)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:24.173847 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861200f-4a5b-4bba-a4ea-9c2a2b7fea58 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:24.196472 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-feaecc72-3422-468a-b053-f559cbabdb0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68e7e8eb2b64d7587248e836633c2b5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:24.204467 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-feaecc72-3422-468a-b053-f559cbabdb0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68e7e8eb2b64d7587248e836633c2b5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:24.213739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-feaecc72-3422-468a-b053-f559cbabdb0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68e7e8eb2b64d7587248e836633c2b5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:24.232590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-feaecc72-3422-468a-b053-f559cbabdb0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68e7e8eb2b64d7587248e836633c2b5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:24.233324 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-feaecc72-3422-468a-b053-f559cbabdb0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68e7e8eb2b64d7587248e836633c2b5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:24.239241 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 993/1982] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:24 2021] DELETE /identity/v3/users/c68e7e8eb2b64d7587248e836633c2b5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:24.243669 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2861200f-4a5b-4bba-a4ea-9c2a2b7fea58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c7d0648f4c4268bfbcb40ccce872ee'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:24.245053 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736082-5fae-4fdc-91ab-e8d8c9c768bb None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:24.245344 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736082-5fae-4fdc-91ab-e8d8c9c768bb None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:24.245633 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736082-5fae-4fdc-91ab-e8d8c9c768bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:24.250784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2861200f-4a5b-4bba-a4ea-9c2a2b7fea58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c7d0648f4c4268bfbcb40ccce872ee'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:24.251566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2861200f-4a5b-4bba-a4ea-9c2a2b7fea58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c7d0648f4c4268bfbcb40ccce872ee'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:24.264090 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2861200f-4a5b-4bba-a4ea-9c2a2b7fea58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c7d0648f4c4268bfbcb40ccce872ee'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:24.264893 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2861200f-4a5b-4bba-a4ea-9c2a2b7fea58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c7d0648f4c4268bfbcb40ccce872ee'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:24.265954 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-69736082-5fae-4fdc-91ab-e8d8c9c768bb None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:24.267342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-69736082-5fae-4fdc-91ab-e8d8c9c768bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:24.280014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 990/1983] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:24 2021] DELETE /identity/v3/users/21c7d0648f4c4268bfbcb40ccce872ee => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:33:24.284978 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd86ee-d280-4442-878f-6380b157c9d5 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:24.285626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd86ee-d280-4442-878f-6380b157c9d5 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:24.285873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd86ee-d280-4442-878f-6380b157c9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:24.307190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-4ddd86ee-d280-4442-878f-6380b157c9d5 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:24.308530 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-4ddd86ee-d280-4442-878f-6380b157c9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:24.345442 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 994/1984] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:33:24.356893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69736082-5fae-4fdc-91ab-e8d8c9c768bb None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:24.358435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-69736082-5fae-4fdc-91ab-e8d8c9c768bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:24.377042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 991/1985] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:33:24.391493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd86ee-d280-4442-878f-6380b157c9d5 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:24.392931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-4ddd86ee-d280-4442-878f-6380b157c9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:24.448037 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69736082-5fae-4fdc-91ab-e8d8c9c768bb None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:24.494035 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd86ee-d280-4442-878f-6380b157c9d5 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:24.501025 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f368288-f88a-491a-8a6d-f24d0cfa4077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:24.502069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368288-f88a-491a-8a6d-f24d0cfa4077 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:24.502562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368288-f88a-491a-8a6d-f24d0cfa4077 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:24.503257 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368288-f88a-491a-8a6d-f24d0cfa4077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:24.514489 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f368288-f88a-491a-8a6d-f24d0cfa4077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:24.515985 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f368288-f88a-491a-8a6d-f24d0cfa4077 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:24.518282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe28010-4529-4528-89ee-3f4817c6f932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:24.519304 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe28010-4529-4528-89ee-3f4817c6f932 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:24.520158 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe28010-4529-4528-89ee-3f4817c6f932 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:24.520654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe28010-4529-4528-89ee-3f4817c6f932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:24.526447 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 992/1986] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:33:24.528055 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fc892-3fd3-47d5-b874-eb2ca98ee1f9 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:24.528358 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fc892-3fd3-47d5-b874-eb2ca98ee1f9 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:24.528632 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fc892-3fd3-47d5-b874-eb2ca98ee1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:24.544500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe28010-4529-4528-89ee-3f4817c6f932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:24.546102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe28010-4529-4528-89ee-3f4817c6f932 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:24.551824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-0f3fc892-3fd3-47d5-b874-eb2ca98ee1f9 None None] MFA Rules not processed for user `75a772d36dc64b34ad0e9f2748cea24f`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:24.554139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0f3fc892-3fd3-47d5-b874-eb2ca98ee1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:24.564062 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 995/1987] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:24.624056 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 993/1988] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:24 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:24.983867 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe28010-4529-4528-89ee-3f4817c6f932 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:24.985796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-fbe28010-4529-4528-89ee-3f4817c6f932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:25.009064 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe28010-4529-4528-89ee-3f4817c6f932 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:25.019142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:25.020626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:25.020910 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:25.021188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] PATH_INFO: `/v3/projects/6be5050608e34182bb7fd71ef392b76f` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:25.022950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be5050608e34182bb7fd71ef392b76f)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:25.025322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:25.094116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be5050608e34182bb7fd71ef392b76f', 'request_id': 'req-8198b1fd-36a5-4a79-9afe-59cce92a29d4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.104258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be5050608e34182bb7fd71ef392b76f', 'request_id': 'req-8198b1fd-36a5-4a79-9afe-59cce92a29d4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.114337 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be5050608e34182bb7fd71ef392b76f', 'request_id': 'req-8198b1fd-36a5-4a79-9afe-59cce92a29d4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.136055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] The token cache is being invalidate because project 6be5050608e34182bb7fd71ef392b76f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:25.136433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.137231 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.141898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 996/1989] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:24 2021] DELETE /identity/v3/projects/6be5050608e34182bb7fd71ef392b76f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:25.143193 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fc892-3fd3-47d5-b874-eb2ca98ee1f9 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:25.149487 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:25.151727 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:25.161160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fc892-3fd3-47d5-b874-eb2ca98ee1f9 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:25.259725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198b1fd-36a5-4a79-9afe-59cce92a29d4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:25.267445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9318a-ed39-4966-808b-06cfe35dc291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:25.268673 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9318a-ed39-4966-808b-06cfe35dc291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:25.268974 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9318a-ed39-4966-808b-06cfe35dc291 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:25.269260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9318a-ed39-4966-808b-06cfe35dc291 admin admin] PATH_INFO: `/v3/projects/17f63693c005407298128e59530b73b0` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:25.271248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9318a-ed39-4966-808b-06cfe35dc291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f63693c005407298128e59530b73b0)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:25.273578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9318a-ed39-4966-808b-06cfe35dc291 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:25.277600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fdfd8-904a-4456-83fe-6ea15bb6d651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:25.278575 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fdfd8-904a-4456-83fe-6ea15bb6d651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:25.278891 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fdfd8-904a-4456-83fe-6ea15bb6d651 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:25.279231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fdfd8-904a-4456-83fe-6ea15bb6d651 admin admin] PATH_INFO: `/v3/users/cc16176b1f43459f8fac9f2a5ba4a234` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:25.280532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fdfd8-904a-4456-83fe-6ea15bb6d651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc16176b1f43459f8fac9f2a5ba4a234)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:25.282602 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fdfd8-904a-4456-83fe-6ea15bb6d651 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:25.344230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1df9318a-ed39-4966-808b-06cfe35dc291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f63693c005407298128e59530b73b0', 'request_id': 'req-1df9318a-ed39-4966-808b-06cfe35dc291'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.352369 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1df9318a-ed39-4966-808b-06cfe35dc291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f63693c005407298128e59530b73b0', 'request_id': 'req-1df9318a-ed39-4966-808b-06cfe35dc291'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.361183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1df9318a-ed39-4966-808b-06cfe35dc291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f63693c005407298128e59530b73b0', 'request_id': 'req-1df9318a-ed39-4966-808b-06cfe35dc291'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.361673 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-5b2fdfd8-904a-4456-83fe-6ea15bb6d651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc16176b1f43459f8fac9f2a5ba4a234'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.368972 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-5b2fdfd8-904a-4456-83fe-6ea15bb6d651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc16176b1f43459f8fac9f2a5ba4a234'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.370047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-5b2fdfd8-904a-4456-83fe-6ea15bb6d651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc16176b1f43459f8fac9f2a5ba4a234'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.375319 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1df9318a-ed39-4966-808b-06cfe35dc291 admin admin] The token cache is being invalidate because project 17f63693c005407298128e59530b73b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:25.375916 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1df9318a-ed39-4966-808b-06cfe35dc291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.377416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1df9318a-ed39-4966-808b-06cfe35dc291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.379528 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 997/1990] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:25 2021] DELETE /identity/v3/projects/17f63693c005407298128e59530b73b0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:25.386555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313ea78-64fc-4a10-9489-0fc840ca0544 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:25.386957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313ea78-64fc-4a10-9489-0fc840ca0544 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:25.387158 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313ea78-64fc-4a10-9489-0fc840ca0544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:25.389702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-5b2fdfd8-904a-4456-83fe-6ea15bb6d651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc16176b1f43459f8fac9f2a5ba4a234'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.390740 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-5b2fdfd8-904a-4456-83fe-6ea15bb6d651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc16176b1f43459f8fac9f2a5ba4a234'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.408566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-8313ea78-64fc-4a10-9489-0fc840ca0544 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:25.410053 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8313ea78-64fc-4a10-9489-0fc840ca0544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:25.413637 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 994/1991] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:25 2021] DELETE /identity/v3/users/cc16176b1f43459f8fac9f2a5ba4a234 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:25.483313 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 998/1992] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:25.495254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14d9e8-b275-4071-94aa-f392705b936b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:25.496444 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14d9e8-b275-4071-94aa-f392705b936b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:25.496838 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14d9e8-b275-4071-94aa-f392705b936b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:25.528436 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-8a14d9e8-b275-4071-94aa-f392705b936b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:25.529722 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8a14d9e8-b275-4071-94aa-f392705b936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:25.546855 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 995/1993] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:25.550699 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313ea78-64fc-4a10-9489-0fc840ca0544 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:25.563662 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313ea78-64fc-4a10-9489-0fc840ca0544 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:25.568842 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec7bda-27f1-4779-8bbe-0ee9175d67e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:25.570345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec7bda-27f1-4779-8bbe-0ee9175d67e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:25.570468 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec7bda-27f1-4779-8bbe-0ee9175d67e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:25.570823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec7bda-27f1-4779-8bbe-0ee9175d67e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:25.571797 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec7bda-27f1-4779-8bbe-0ee9175d67e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:33:25.572180 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec7bda-27f1-4779-8bbe-0ee9175d67e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:25.574016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec7bda-27f1-4779-8bbe-0ee9175d67e4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:25.587784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 999/1994] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:33:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:33:25.591589 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14d9e8-b275-4071-94aa-f392705b936b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:25.603571 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14d9e8-b275-4071-94aa-f392705b936b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:25.612546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bfec6-b492-4cfc-9e86-a43295d689ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:25.613219 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bfec6-b492-4cfc-9e86-a43295d689ff admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:25.613557 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bfec6-b492-4cfc-9e86-a43295d689ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:25.614089 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bfec6-b492-4cfc-9e86-a43295d689ff admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:25.614489 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bfec6-b492-4cfc-9e86-a43295d689ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:25.616485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bfec6-b492-4cfc-9e86-a43295d689ff admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:25.653677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 996/1995] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:25 2021] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:25.654931 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec7bda-27f1-4779-8bbe-0ee9175d67e4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:25.669523 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec7bda-27f1-4779-8bbe-0ee9175d67e4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:25.740097 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ea00d-42d1-4e05-9d52-4cbbb5f03312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:25.741518 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ea00d-42d1-4e05-9d52-4cbbb5f03312 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:25.741874 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ea00d-42d1-4e05-9d52-4cbbb5f03312 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:25.742288 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ea00d-42d1-4e05-9d52-4cbbb5f03312 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:25.743180 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ea00d-42d1-4e05-9d52-4cbbb5f03312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:25.745593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ea00d-42d1-4e05-9d52-4cbbb5f03312 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:25.776146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1000/1996] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:25 2021] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:25.780665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bfec6-b492-4cfc-9e86-a43295d689ff admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:25.792547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bfec6-b492-4cfc-9e86-a43295d689ff admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:25.800786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ea00d-42d1-4e05-9d52-4cbbb5f03312 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:25.801958 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786895a-3240-4d52-9945-b6686f51404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:25.804846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-973ea00d-42d1-4e05-9d52-4cbbb5f03312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:25.812298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786895a-3240-4d52-9945-b6686f51404f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:25.812668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786895a-3240-4d52-9945-b6686f51404f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:25.812952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786895a-3240-4d52-9945-b6686f51404f admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:25.813766 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786895a-3240-4d52-9945-b6686f51404f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:25.815539 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786895a-3240-4d52-9945-b6686f51404f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:25.821871 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ea00d-42d1-4e05-9d52-4cbbb5f03312 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:25.827882 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:25.828840 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:25.829133 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:25.829520 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa admin admin] PATH_INFO: `/v3/projects/56481d867c5c45c6beb77bdf211d8d7c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:25.831152 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=56481d867c5c45c6beb77bdf211d8d7c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:25.833790 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:25.851055 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 997/1997] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:25 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:25.855008 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786895a-3240-4d52-9945-b6686f51404f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:25.868181 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786895a-3240-4d52-9945-b6686f51404f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:25.875128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc998cf-fa55-4009-9ed6-56e5b9ef02fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:25.875636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc998cf-fa55-4009-9ed6-56e5b9ef02fb admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:25.875998 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc998cf-fa55-4009-9ed6-56e5b9ef02fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:25.876306 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc998cf-fa55-4009-9ed6-56e5b9ef02fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:25.877101 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc998cf-fa55-4009-9ed6-56e5b9ef02fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:25.878701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc998cf-fa55-4009-9ed6-56e5b9ef02fb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:25.895786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 998/1998] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:25 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:33:25.897691 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc998cf-fa55-4009-9ed6-56e5b9ef02fb admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:25.911275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc998cf-fa55-4009-9ed6-56e5b9ef02fb admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:25.916647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56481d867c5c45c6beb77bdf211d8d7c', 'request_id': 'req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.932052 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56481d867c5c45c6beb77bdf211d8d7c', 'request_id': 'req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.946783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56481d867c5c45c6beb77bdf211d8d7c', 'request_id': 'req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.976911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa admin admin] The token cache is being invalidate because project 56481d867c5c45c6beb77bdf211d8d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:25.977386 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.978392 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-3f862bd2-624b-4429-a5a3-7e250f3ce7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:25.984489 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1001/1999] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:25 2021] DELETE /identity/v3/projects/56481d867c5c45c6beb77bdf211d8d7c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:33:25.991782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cab40-787e-4275-b828-0b92c6495e94 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:25.992279 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cab40-787e-4275-b828-0b92c6495e94 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:25.992566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cab40-787e-4275-b828-0b92c6495e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.005777 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f130dc5-08ab-4fe1-87cd-a93c2592bd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:26.007233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f130dc5-08ab-4fe1-87cd-a93c2592bd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.007624 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f130dc5-08ab-4fe1-87cd-a93c2592bd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.007921 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f130dc5-08ab-4fe1-87cd-a93c2592bd5b admin admin] PATH_INFO: `/v3/projects/ad239f03f79248c591f23e62a13748f4/users/5d532bf166464524a9ef77f3277bf582/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.013303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-e84cab40-787e-4275-b828-0b92c6495e94 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:26.014595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e84cab40-787e-4275-b828-0b92c6495e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:26.030583 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1002/2000] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:26.032603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4bdc3-f328-46e3-9d0a-f5d678385d7d None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.033057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4bdc3-f328-46e3-9d0a-f5d678385d7d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.033478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4bdc3-f328-46e3-9d0a-f5d678385d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.035178 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f130dc5-08ab-4fe1-87cd-a93c2592bd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad239f03f79248c591f23e62a13748f4, user_id=5d532bf166464524a9ef77f3277bf582, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:26.039855 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f130dc5-08ab-4fe1-87cd-a93c2592bd5b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:26.064387 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-d3f4bdc3-f328-46e3-9d0a-f5d678385d7d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:26.065842 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d3f4bdc3-f328-46e3-9d0a-f5d678385d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:26.067715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 999/2001] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:25 2021] PUT /identity/v3/projects/ad239f03f79248c591f23e62a13748f4/users/5d532bf166464524a9ef77f3277bf582/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:26.078261 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74513cce-6642-4c64-9193-fd5d83807e42 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.078551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74513cce-6642-4c64-9193-fd5d83807e42 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.078870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74513cce-6642-4c64-9193-fd5d83807e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.117782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-74513cce-6642-4c64-9193-fd5d83807e42 None None] MFA Rules not processed for user `5d532bf166464524a9ef77f3277bf582`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:26.120002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-74513cce-6642-4c64-9193-fd5d83807e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:26.137695 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1003/2002] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:33:26.143609 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4bdc3-f328-46e3-9d0a-f5d678385d7d None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:26.155215 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4bdc3-f328-46e3-9d0a-f5d678385d7d None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:26.160611 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd6d9f-3470-4cd8-87e3-9b49be4e44dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:26.161456 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd6d9f-3470-4cd8-87e3-9b49be4e44dc admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.161739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd6d9f-3470-4cd8-87e3-9b49be4e44dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.162107 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd6d9f-3470-4cd8-87e3-9b49be4e44dc admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.163636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd6d9f-3470-4cd8-87e3-9b49be4e44dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:33:26.163986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd6d9f-3470-4cd8-87e3-9b49be4e44dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:26.165971 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd6d9f-3470-4cd8-87e3-9b49be4e44dc admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:26.181889 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1004/2003] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:33:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:33:26.188369 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd6d9f-3470-4cd8-87e3-9b49be4e44dc admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:26.201641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd6d9f-3470-4cd8-87e3-9b49be4e44dc admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:26.207606 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c5b3e-0fe9-4b95-8b9e-5e160ce80c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:26.208344 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c5b3e-0fe9-4b95-8b9e-5e160ce80c89 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.208706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c5b3e-0fe9-4b95-8b9e-5e160ce80c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.209060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c5b3e-0fe9-4b95-8b9e-5e160ce80c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.211120 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c5b3e-0fe9-4b95-8b9e-5e160ce80c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:26.213255 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c5b3e-0fe9-4b95-8b9e-5e160ce80c89 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:26.221098 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1000/2004] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:26 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:26.228309 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74513cce-6642-4c64-9193-fd5d83807e42 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:26.230000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-74513cce-6642-4c64-9193-fd5d83807e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:26.245034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1005/2005] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:26 2021] POST /identity/v3/projects => generated 409 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:26.249616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c5b3e-0fe9-4b95-8b9e-5e160ce80c89 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:26.261836 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74513cce-6642-4c64-9193-fd5d83807e42 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:26.348112 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc0f8c-258d-4de0-9a31-f1259d019ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:26.349359 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc0f8c-258d-4de0-9a31-f1259d019ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.350087 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc0f8c-258d-4de0-9a31-f1259d019ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.351248 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc0f8c-258d-4de0-9a31-f1259d019ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.352463 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc0f8c-258d-4de0-9a31-f1259d019ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:26.354807 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc0f8c-258d-4de0-9a31-f1259d019ee4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:26.377613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c5b3e-0fe9-4b95-8b9e-5e160ce80c89 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:26.400805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219884b5-5e73-40da-987f-65f5d12bbb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:26.401502 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219884b5-5e73-40da-987f-65f5d12bbb7d admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.401785 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219884b5-5e73-40da-987f-65f5d12bbb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.402069 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219884b5-5e73-40da-987f-65f5d12bbb7d admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.403006 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219884b5-5e73-40da-987f-65f5d12bbb7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:26.407802 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219884b5-5e73-40da-987f-65f5d12bbb7d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:26.411689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1001/2006] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:26 2021] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:26.413699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc0f8c-258d-4de0-9a31-f1259d019ee4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:26.454344 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1006/2007] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:26 2021] POST /identity/v3/users => generated 305 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:26.460149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219884b5-5e73-40da-987f-65f5d12bbb7d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:26.472664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219884b5-5e73-40da-987f-65f5d12bbb7d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:26.514725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc0f8c-258d-4de0-9a31-f1259d019ee4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:26.519652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8972cb-875a-4b27-8c03-19990294b7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:26.520327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8972cb-875a-4b27-8c03-19990294b7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.520619 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8972cb-875a-4b27-8c03-19990294b7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.520883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8972cb-875a-4b27-8c03-19990294b7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.521572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8972cb-875a-4b27-8c03-19990294b7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:26.524204 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8972cb-875a-4b27-8c03-19990294b7a3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:26.531458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c17864-f822-48cf-9aae-d84b07e7c761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:26.532132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c17864-f822-48cf-9aae-d84b07e7c761 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.532417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c17864-f822-48cf-9aae-d84b07e7c761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.532698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c17864-f822-48cf-9aae-d84b07e7c761 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.533566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c17864-f822-48cf-9aae-d84b07e7c761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:26.535494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c17864-f822-48cf-9aae-d84b07e7c761 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:26.544478 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1002/2008] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:26 2021] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:26.546955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1007/2009] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:26 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:26.550445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c17864-f822-48cf-9aae-d84b07e7c761 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:26.550561 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8972cb-875a-4b27-8c03-19990294b7a3 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:26.561159 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c17864-f822-48cf-9aae-d84b07e7c761 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:26.564763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8972cb-875a-4b27-8c03-19990294b7a3 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:26.567515 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2ac11-b38c-4263-b087-5dd96a0f2f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:26.568108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ac11-b38c-4263-b087-5dd96a0f2f84 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.568398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ac11-b38c-4263-b087-5dd96a0f2f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.568675 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ac11-b38c-4263-b087-5dd96a0f2f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.569901 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2ac11-b38c-4263-b087-5dd96a0f2f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:26.571834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2ac11-b38c-4263-b087-5dd96a0f2f84 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:26.574332 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaed375-249c-420f-b691-c2d635a836de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:26.575085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed375-249c-420f-b691-c2d635a836de admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.575378 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed375-249c-420f-b691-c2d635a836de admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.575778 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed375-249c-420f-b691-c2d635a836de admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.576409 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaed375-249c-420f-b691-c2d635a836de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:26.578033 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaed375-249c-420f-b691-c2d635a836de admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:26.582355 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1008/2010] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:26 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:26.587797 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2ac11-b38c-4263-b087-5dd96a0f2f84 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:26.590623 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1003/2011] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:26 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:26.594570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaed375-249c-420f-b691-c2d635a836de admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:26.604778 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2ac11-b38c-4263-b087-5dd96a0f2f84 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:26.608998 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaed375-249c-420f-b691-c2d635a836de admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:26.614863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e27ce-21c6-4bd8-a4bd-fc8ce5744c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:26.615183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439b99a-189f-4428-8d4f-e8207c8ca877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:26.616031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e27ce-21c6-4bd8-a4bd-fc8ce5744c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.616282 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439b99a-189f-4428-8d4f-e8207c8ca877 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.616499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e27ce-21c6-4bd8-a4bd-fc8ce5744c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.616735 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439b99a-189f-4428-8d4f-e8207c8ca877 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.616837 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439b99a-189f-4428-8d4f-e8207c8ca877 admin admin] PATH_INFO: `/v3/projects/432e64b4b0dc48ae9ff6ad2c992190b9/users/7f9dd6a047e14991b0a2264dde88d8e0/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.617046 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e27ce-21c6-4bd8-a4bd-fc8ce5744c92 admin admin] PATH_INFO: `/v3/projects/d35bd39581784b3c8f95b7ff1d8f5346/users/3df38fa7077d432fbfd51cc1bbef5f69/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.633448 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439b99a-189f-4428-8d4f-e8207c8ca877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432e64b4b0dc48ae9ff6ad2c992190b9, user_id=7f9dd6a047e14991b0a2264dde88d8e0, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:26.634118 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e27ce-21c6-4bd8-a4bd-fc8ce5744c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35bd39581784b3c8f95b7ff1d8f5346, user_id=3df38fa7077d432fbfd51cc1bbef5f69, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:26.636412 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439b99a-189f-4428-8d4f-e8207c8ca877 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:26.637028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e27ce-21c6-4bd8-a4bd-fc8ce5744c92 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:26.654757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1004/2012] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:26 2021] PUT /identity/v3/projects/432e64b4b0dc48ae9ff6ad2c992190b9/users/7f9dd6a047e14991b0a2264dde88d8e0/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:33:26.655233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1009/2013] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:26 2021] PUT /identity/v3/projects/d35bd39581784b3c8f95b7ff1d8f5346/users/3df38fa7077d432fbfd51cc1bbef5f69/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:33:26.659983 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439b99a-189f-4428-8d4f-e8207c8ca877 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:26.666996 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d968f4-121e-45dc-b94f-5ba527b88d61 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.667295 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d968f4-121e-45dc-b94f-5ba527b88d61 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.667579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d968f4-121e-45dc-b94f-5ba527b88d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.699583 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-b5d968f4-121e-45dc-b94f-5ba527b88d61 None None] MFA Rules not processed for user `3df38fa7077d432fbfd51cc1bbef5f69`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:26.701047 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-b5d968f4-121e-45dc-b94f-5ba527b88d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:26.730558 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439b99a-189f-4428-8d4f-e8207c8ca877 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:26.781922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1010/2014] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:26 2021] POST /identity/v3/auth/tokens => generated 3429 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:26.797490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d968f4-121e-45dc-b94f-5ba527b88d61 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:26.802524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85f7ac-84a8-4593-8b16-b1d706db30cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:26.803938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85f7ac-84a8-4593-8b16-b1d706db30cb admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.804404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85f7ac-84a8-4593-8b16-b1d706db30cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.804710 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85f7ac-84a8-4593-8b16-b1d706db30cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.807995 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85f7ac-84a8-4593-8b16-b1d706db30cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:26.809799 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85f7ac-84a8-4593-8b16-b1d706db30cb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:26.828334 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1005/2015] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:26 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:33:26.843465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85f7ac-84a8-4593-8b16-b1d706db30cb admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:26.860010 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85f7ac-84a8-4593-8b16-b1d706db30cb admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:26.865553 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6841a3a-5217-422e-a955-9adec506bad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:26.867200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6841a3a-5217-422e-a955-9adec506bad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.867501 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6841a3a-5217-422e-a955-9adec506bad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.867938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6841a3a-5217-422e-a955-9adec506bad2 admin admin] PATH_INFO: `/v3/projects/432e64b4b0dc48ae9ff6ad2c992190b9/users/7f9dd6a047e14991b0a2264dde88d8e0/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.870137 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6841a3a-5217-422e-a955-9adec506bad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432e64b4b0dc48ae9ff6ad2c992190b9, user_id=7f9dd6a047e14991b0a2264dde88d8e0, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:26.873103 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6841a3a-5217-422e-a955-9adec506bad2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:26.885509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d968f4-121e-45dc-b94f-5ba527b88d61 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:26.892218 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1006/2016] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:26 2021] PUT /identity/v3/projects/432e64b4b0dc48ae9ff6ad2c992190b9/users/7f9dd6a047e14991b0a2264dde88d8e0/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:33:26.903164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fc68f-76df-4eac-b4a8-3c94ef260fd1 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.903462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fc68f-76df-4eac-b4a8-3c94ef260fd1 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.903748 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fc68f-76df-4eac-b4a8-3c94ef260fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.930885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-b36fc68f-76df-4eac-b4a8-3c94ef260fd1 None None] MFA Rules not processed for user `7f9dd6a047e14991b0a2264dde88d8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:26.932194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b36fc68f-76df-4eac-b4a8-3c94ef260fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:26.949411 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93471953-f4f4-4b28-bde1-26d256974b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:26.950084 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471953-f4f4-4b28-bde1-26d256974b59 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:26.950370 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471953-f4f4-4b28-bde1-26d256974b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:26.950651 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471953-f4f4-4b28-bde1-26d256974b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:26.951444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93471953-f4f4-4b28-bde1-26d256974b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:26.953792 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93471953-f4f4-4b28-bde1-26d256974b59 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:26.987282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1011/2017] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:26 2021] POST /identity/v3/projects => generated 409 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:26.990721 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93471953-f4f4-4b28-bde1-26d256974b59 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:27.041024 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1007/2018] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:26 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:33:27.054614 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fc68f-76df-4eac-b4a8-3c94ef260fd1 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:27.059754 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b36fc68f-76df-4eac-b4a8-3c94ef260fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:27.104630 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93471953-f4f4-4b28-bde1-26d256974b59 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:27.117730 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11be6a4-ce77-4eb8-b4be-1203c0e33b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:27.119645 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11be6a4-ce77-4eb8-b4be-1203c0e33b47 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:27.131115 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11be6a4-ce77-4eb8-b4be-1203c0e33b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:27.131544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11be6a4-ce77-4eb8-b4be-1203c0e33b47 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:27.132368 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11be6a4-ce77-4eb8-b4be-1203c0e33b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:27.134419 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11be6a4-ce77-4eb8-b4be-1203c0e33b47 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:27.152301 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fc68f-76df-4eac-b4a8-3c94ef260fd1 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:27.165992 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1012/2019] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:26 2021] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:27.170325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11be6a4-ce77-4eb8-b4be-1203c0e33b47 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:27.183133 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11be6a4-ce77-4eb8-b4be-1203c0e33b47 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:27.189300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b45b0-d5ec-4dbe-b63f-fe90874bce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:27.190366 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b45b0-d5ec-4dbe-b63f-fe90874bce9b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:27.190729 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b45b0-d5ec-4dbe-b63f-fe90874bce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:27.191128 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b45b0-d5ec-4dbe-b63f-fe90874bce9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:27.192108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b45b0-d5ec-4dbe-b63f-fe90874bce9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:27.195095 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b45b0-d5ec-4dbe-b63f-fe90874bce9b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:27.218945 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1013/2020] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:27 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:27.221770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b45b0-d5ec-4dbe-b63f-fe90874bce9b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:27.237887 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b45b0-d5ec-4dbe-b63f-fe90874bce9b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:27.238904 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a974eb-b56d-44ca-a422-c00f167b7a41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:27.240813 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a974eb-b56d-44ca-a422-c00f167b7a41 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:27.241571 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a974eb-b56d-44ca-a422-c00f167b7a41 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:27.242116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a974eb-b56d-44ca-a422-c00f167b7a41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:27.253159 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821d162-e41a-4f86-b835-26c9806d03a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:27.254141 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821d162-e41a-4f86-b835-26c9806d03a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:27.254431 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821d162-e41a-4f86-b835-26c9806d03a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:27.254711 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821d162-e41a-4f86-b835-26c9806d03a4 admin admin] PATH_INFO: `/v3/projects/99c76c9221a04a85bb9fafe60d6da736/users/265246eda9474bc48b0a42d1e69469ff/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:27.275351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821d162-e41a-4f86-b835-26c9806d03a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c76c9221a04a85bb9fafe60d6da736, user_id=265246eda9474bc48b0a42d1e69469ff, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:27.278057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821d162-e41a-4f86-b835-26c9806d03a4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:27.291804 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1014/2021] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:27 2021] PUT /identity/v3/projects/99c76c9221a04a85bb9fafe60d6da736/users/265246eda9474bc48b0a42d1e69469ff/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:27.296732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821d162-e41a-4f86-b835-26c9806d03a4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:27.329974 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a974eb-b56d-44ca-a422-c00f167b7a41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:27.331796 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a974eb-b56d-44ca-a422-c00f167b7a41 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:27.349530 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1008/2022] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:27 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:27.373034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821d162-e41a-4f86-b835-26c9806d03a4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:27.378622 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd30ca-3a13-4d1a-9461-811b9db9079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:27.379543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd30ca-3a13-4d1a-9461-811b9db9079b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:27.380000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd30ca-3a13-4d1a-9461-811b9db9079b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:27.381079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd30ca-3a13-4d1a-9461-811b9db9079b admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:27.382806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd30ca-3a13-4d1a-9461-811b9db9079b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:27.384584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd30ca-3a13-4d1a-9461-811b9db9079b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:27.395941 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1015/2023] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:27 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:27.400855 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a974eb-b56d-44ca-a422-c00f167b7a41 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:27.419818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a974eb-b56d-44ca-a422-c00f167b7a41 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:27.427927 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12ced2-5880-4c47-bc17-efe5446a4c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:27.429648 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12ced2-5880-4c47-bc17-efe5446a4c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:27.429940 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12ced2-5880-4c47-bc17-efe5446a4c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:27.430317 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12ced2-5880-4c47-bc17-efe5446a4c36 admin admin] PATH_INFO: `/v3/projects/99c76c9221a04a85bb9fafe60d6da736/users/265246eda9474bc48b0a42d1e69469ff/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:27.432478 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12ced2-5880-4c47-bc17-efe5446a4c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c76c9221a04a85bb9fafe60d6da736, user_id=265246eda9474bc48b0a42d1e69469ff, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:27.435190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12ced2-5880-4c47-bc17-efe5446a4c36 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:27.464949 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1009/2024] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:27 2021] PUT /identity/v3/projects/99c76c9221a04a85bb9fafe60d6da736/users/265246eda9474bc48b0a42d1e69469ff/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:27.481736 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe000c4e-d777-444d-8a24-214696ff4594 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:27.483058 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe000c4e-d777-444d-8a24-214696ff4594 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:27.483361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe000c4e-d777-444d-8a24-214696ff4594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:27.533057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-fe000c4e-d777-444d-8a24-214696ff4594 None None] MFA Rules not processed for user `265246eda9474bc48b0a42d1e69469ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:27.534374 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-fe000c4e-d777-444d-8a24-214696ff4594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:27.648343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1016/2025] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:27 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:27.689256 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12ced2-5880-4c47-bc17-efe5446a4c36 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:27.692230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-bd12ced2-5880-4c47-bc17-efe5446a4c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:27.730280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe000c4e-d777-444d-8a24-214696ff4594 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:27.766709 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12ced2-5880-4c47-bc17-efe5446a4c36 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:27.770864 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ea67e-00cf-4d72-aa30-20a7301622a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:27.771606 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ea67e-00cf-4d72-aa30-20a7301622a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:27.771965 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ea67e-00cf-4d72-aa30-20a7301622a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:27.773558 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ea67e-00cf-4d72-aa30-20a7301622a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:27.783637 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ea67e-00cf-4d72-aa30-20a7301622a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:27.784926 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ea67e-00cf-4d72-aa30-20a7301622a7 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:27.795134 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1010/2026] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:27 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:27.822025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe000c4e-d777-444d-8a24-214696ff4594 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:27.830446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1c8f4-1752-474a-b0ae-32166ab16bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:27.831531 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1c8f4-1752-474a-b0ae-32166ab16bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:27.831967 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1c8f4-1752-474a-b0ae-32166ab16bda admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:27.832351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1c8f4-1752-474a-b0ae-32166ab16bda admin admin] PATH_INFO: `/v3/users/5d532bf166464524a9ef77f3277bf582` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:27.833991 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1c8f4-1752-474a-b0ae-32166ab16bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d532bf166464524a9ef77f3277bf582)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:27.836395 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1c8f4-1752-474a-b0ae-32166ab16bda admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:27.916055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-edc1c8f4-1752-474a-b0ae-32166ab16bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d532bf166464524a9ef77f3277bf582'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:27.925365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-edc1c8f4-1752-474a-b0ae-32166ab16bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d532bf166464524a9ef77f3277bf582'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:27.943057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-edc1c8f4-1752-474a-b0ae-32166ab16bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d532bf166464524a9ef77f3277bf582'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:27.965255 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-edc1c8f4-1752-474a-b0ae-32166ab16bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d532bf166464524a9ef77f3277bf582'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:27.966432 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-edc1c8f4-1752-474a-b0ae-32166ab16bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d532bf166464524a9ef77f3277bf582'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:27.994410 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1017/2027] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:27 2021] DELETE /identity/v3/users/5d532bf166464524a9ef77f3277bf582 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:33:27.999768 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef68da-37ed-41da-80c3-3e40aad77750 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:28.000891 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef68da-37ed-41da-80c3-3e40aad77750 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:28.001025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1c8f4-1752-474a-b0ae-32166ab16bda admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:28.001169 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef68da-37ed-41da-80c3-3e40aad77750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:28.002432 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-edc1c8f4-1752-474a-b0ae-32166ab16bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:28.030788 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-8cef68da-37ed-41da-80c3-3e40aad77750 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:28.048173 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8cef68da-37ed-41da-80c3-3e40aad77750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:28.076649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1c8f4-1752-474a-b0ae-32166ab16bda admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:28.081063 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87824375-1c95-408b-9f55-9e1178274a6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:28.081862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87824375-1c95-408b-9f55-9e1178274a6e service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:28.082489 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87824375-1c95-408b-9f55-9e1178274a6e service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:28.082489 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87824375-1c95-408b-9f55-9e1178274a6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:28.085529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-87824375-1c95-408b-9f55-9e1178274a6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:28.157169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87824375-1c95-408b-9f55-9e1178274a6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:28.158934 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87824375-1c95-408b-9f55-9e1178274a6e service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:28.167298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1011/2028] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:28.178311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef68da-37ed-41da-80c3-3e40aad77750 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:28.180160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8cef68da-37ed-41da-80c3-3e40aad77750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:28.180588 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1018/2029] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:27 2021] GET /identity/v3/auth/tokens => generated 3429 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:28.257285 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef68da-37ed-41da-80c3-3e40aad77750 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:28.261058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e47d2b-95c7-42bc-8882-34ab1f679857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:28.261753 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e47d2b-95c7-42bc-8882-34ab1f679857 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:28.262048 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e47d2b-95c7-42bc-8882-34ab1f679857 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:28.262328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e47d2b-95c7-42bc-8882-34ab1f679857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:28.275731 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e47d2b-95c7-42bc-8882-34ab1f679857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:28.277481 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e47d2b-95c7-42bc-8882-34ab1f679857 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:28.288306 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1012/2030] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:28.728618 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87824375-1c95-408b-9f55-9e1178274a6e service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:28.730149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-87824375-1c95-408b-9f55-9e1178274a6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:28.767535 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87824375-1c95-408b-9f55-9e1178274a6e service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:28.773611 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:28.774518 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:28.774823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:28.775111 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] PATH_INFO: `/v3/projects/ad239f03f79248c591f23e62a13748f4` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:28.776292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad239f03f79248c591f23e62a13748f4)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:28.778263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:28.842624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad239f03f79248c591f23e62a13748f4', 'request_id': 'req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:28.849021 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad239f03f79248c591f23e62a13748f4', 'request_id': 'req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:28.859399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad239f03f79248c591f23e62a13748f4', 'request_id': 'req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:28.870556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] The token cache is being invalidate because project ad239f03f79248c591f23e62a13748f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:28.870927 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:28.871579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:28.873091 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1019/2031] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:28 2021] DELETE /identity/v3/projects/ad239f03f79248c591f23e62a13748f4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:28.877236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e47d2b-95c7-42bc-8882-34ab1f679857 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:28.886908 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e47d2b-95c7-42bc-8882-34ab1f679857 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:28.943072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acdce5-22d3-4ae1-92a5-289969b7abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:28.944096 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acdce5-22d3-4ae1-92a5-289969b7abc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:28.944471 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acdce5-22d3-4ae1-92a5-289969b7abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:28.944867 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acdce5-22d3-4ae1-92a5-289969b7abc1 admin admin] PATH_INFO: `/v3/users/7f9dd6a047e14991b0a2264dde88d8e0` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:28.946133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acdce5-22d3-4ae1-92a5-289969b7abc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9dd6a047e14991b0a2264dde88d8e0)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:28.948123 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acdce5-22d3-4ae1-92a5-289969b7abc1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:29.001655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-16acdce5-22d3-4ae1-92a5-289969b7abc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9dd6a047e14991b0a2264dde88d8e0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:29.008519 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-16acdce5-22d3-4ae1-92a5-289969b7abc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9dd6a047e14991b0a2264dde88d8e0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:29.009213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-16acdce5-22d3-4ae1-92a5-289969b7abc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9dd6a047e14991b0a2264dde88d8e0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:29.020510 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-16acdce5-22d3-4ae1-92a5-289969b7abc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9dd6a047e14991b0a2264dde88d8e0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:29.021163 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-16acdce5-22d3-4ae1-92a5-289969b7abc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9dd6a047e14991b0a2264dde88d8e0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:29.034110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1013/2032] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:28 2021] DELETE /identity/v3/users/7f9dd6a047e14991b0a2264dde88d8e0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:29.335827 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:29.337646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:29.352234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc41fcc-f026-4ae7-ac9d-b673f5f56a99 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:29.417153 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6a68e-7408-4d7c-9678-add31cfaa52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:29.418016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a68e-7408-4d7c-9678-add31cfaa52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:29.418300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a68e-7408-4d7c-9678-add31cfaa52a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:29.418578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a68e-7408-4d7c-9678-add31cfaa52a admin admin] PATH_INFO: `/v3/projects/432e64b4b0dc48ae9ff6ad2c992190b9` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:29.419871 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6a68e-7408-4d7c-9678-add31cfaa52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=432e64b4b0dc48ae9ff6ad2c992190b9)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:29.421776 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6a68e-7408-4d7c-9678-add31cfaa52a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:29.471860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bbb6a68e-7408-4d7c-9678-add31cfaa52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432e64b4b0dc48ae9ff6ad2c992190b9', 'request_id': 'req-bbb6a68e-7408-4d7c-9678-add31cfaa52a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:29.479401 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bbb6a68e-7408-4d7c-9678-add31cfaa52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432e64b4b0dc48ae9ff6ad2c992190b9', 'request_id': 'req-bbb6a68e-7408-4d7c-9678-add31cfaa52a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:29.488406 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bbb6a68e-7408-4d7c-9678-add31cfaa52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432e64b4b0dc48ae9ff6ad2c992190b9', 'request_id': 'req-bbb6a68e-7408-4d7c-9678-add31cfaa52a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:29.500376 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bbb6a68e-7408-4d7c-9678-add31cfaa52a admin admin] The token cache is being invalidate because project 432e64b4b0dc48ae9ff6ad2c992190b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:29.500720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bbb6a68e-7408-4d7c-9678-add31cfaa52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:29.501360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bbb6a68e-7408-4d7c-9678-add31cfaa52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:29.503221 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1020/2033] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:29 2021] DELETE /identity/v3/projects/432e64b4b0dc48ae9ff6ad2c992190b9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:29.508776 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6e7d-5d06-4128-87d5-3495170eb2c9 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:29.509268 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6e7d-5d06-4128-87d5-3495170eb2c9 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:29.509523 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6e7d-5d06-4128-87d5-3495170eb2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:29.527783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-188a6e7d-5d06-4128-87d5-3495170eb2c9 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:29.528966 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-188a6e7d-5d06-4128-87d5-3495170eb2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:29.590664 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1014/2034] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:29.599378 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e47de-1c2e-4f72-9a77-c598dc5bdd9a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:29.600475 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e47de-1c2e-4f72-9a77-c598dc5bdd9a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:29.600766 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e47de-1c2e-4f72-9a77-c598dc5bdd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:29.624230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f33e47de-1c2e-4f72-9a77-c598dc5bdd9a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:29.625475 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f33e47de-1c2e-4f72-9a77-c598dc5bdd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:29.633896 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1021/2035] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:29.638171 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6e7d-5d06-4128-87d5-3495170eb2c9 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:29.649676 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6e7d-5d06-4128-87d5-3495170eb2c9 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:29.656013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e33c2-c39a-4490-9df7-901cbe24eeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:29.657182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e33c2-c39a-4490-9df7-901cbe24eeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:29.657496 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e33c2-c39a-4490-9df7-901cbe24eeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:29.657944 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e33c2-c39a-4490-9df7-901cbe24eeb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:29.659213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e33c2-c39a-4490-9df7-901cbe24eeb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:33:29.659528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e33c2-c39a-4490-9df7-901cbe24eeb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:29.661233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e33c2-c39a-4490-9df7-901cbe24eeb7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:29.677434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1015/2036] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:33:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:33:29.679731 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e47de-1c2e-4f72-9a77-c598dc5bdd9a None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:29.689159 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e47de-1c2e-4f72-9a77-c598dc5bdd9a None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:29.694065 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11390106-9c44-439c-8b1f-f9f583962f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:29.694719 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390106-9c44-439c-8b1f-f9f583962f2d admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:29.695036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390106-9c44-439c-8b1f-f9f583962f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:29.695316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390106-9c44-439c-8b1f-f9f583962f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:29.696007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11390106-9c44-439c-8b1f-f9f583962f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:29.697950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11390106-9c44-439c-8b1f-f9f583962f2d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:29.722040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1022/2037] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:29 2021] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:33:29.727628 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e33c2-c39a-4490-9df7-901cbe24eeb7 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:29.742354 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e33c2-c39a-4490-9df7-901cbe24eeb7 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:29.799586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ac3b2-9eb3-439c-8aba-c445c78c5361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:29.800266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac3b2-9eb3-439c-8aba-c445c78c5361 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:29.800554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac3b2-9eb3-439c-8aba-c445c78c5361 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:29.800834 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac3b2-9eb3-439c-8aba-c445c78c5361 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:29.801529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ac3b2-9eb3-439c-8aba-c445c78c5361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:29.804195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ac3b2-9eb3-439c-8aba-c445c78c5361 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:29.826302 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1016/2038] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:29 2021] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:29.827818 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11390106-9c44-439c-8b1f-f9f583962f2d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:29.838458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11390106-9c44-439c-8b1f-f9f583962f2d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:29.843159 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648d5ba-a7d2-4e84-a3db-24e695c9c4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:29.843834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648d5ba-a7d2-4e84-a3db-24e695c9c4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:29.844117 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648d5ba-a7d2-4e84-a3db-24e695c9c4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:29.844393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648d5ba-a7d2-4e84-a3db-24e695c9c4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:29.845144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648d5ba-a7d2-4e84-a3db-24e695c9c4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:29.846858 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648d5ba-a7d2-4e84-a3db-24e695c9c4a3 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:29.859103 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1023/2039] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:29 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:29.863174 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ac3b2-9eb3-439c-8aba-c445c78c5361 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:29.873737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ac3b2-9eb3-439c-8aba-c445c78c5361 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:29.879102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7619b-66e2-4bdd-8b54-e41cddc27591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:29.879763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7619b-66e2-4bdd-8b54-e41cddc27591 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:29.880048 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7619b-66e2-4bdd-8b54-e41cddc27591 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:29.880321 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7619b-66e2-4bdd-8b54-e41cddc27591 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:29.881045 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7619b-66e2-4bdd-8b54-e41cddc27591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:29.883307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7619b-66e2-4bdd-8b54-e41cddc27591 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:29.893156 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1017/2040] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:29.897898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648d5ba-a7d2-4e84-a3db-24e695c9c4a3 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:29.907977 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648d5ba-a7d2-4e84-a3db-24e695c9c4a3 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:29.913477 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e385e3-9a18-4690-9303-3c39d6476172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:29.914360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e385e3-9a18-4690-9303-3c39d6476172 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:29.914679 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e385e3-9a18-4690-9303-3c39d6476172 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:29.914996 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e385e3-9a18-4690-9303-3c39d6476172 admin admin] PATH_INFO: `/v3/projects/bf721023b46845749274e702faa56989/users/abb75035d6d04699899fc09caa5a840e/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:29.930468 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e385e3-9a18-4690-9303-3c39d6476172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf721023b46845749274e702faa56989, user_id=abb75035d6d04699899fc09caa5a840e, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:29.933405 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e385e3-9a18-4690-9303-3c39d6476172 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:29.952536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1024/2041] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:29 2021] PUT /identity/v3/projects/bf721023b46845749274e702faa56989/users/abb75035d6d04699899fc09caa5a840e/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:29.957934 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452bda0-b78e-4c55-b375-b9910b18ca9a None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:29.958255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452bda0-b78e-4c55-b375-b9910b18ca9a None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:29.958541 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452bda0-b78e-4c55-b375-b9910b18ca9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:29.987465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-9452bda0-b78e-4c55-b375-b9910b18ca9a None None] MFA Rules not processed for user `abb75035d6d04699899fc09caa5a840e`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:29.988712 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9452bda0-b78e-4c55-b375-b9910b18ca9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:30.064917 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1018/2042] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:29 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:30.066247 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e385e3-9a18-4690-9303-3c39d6476172 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:30.129649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e385e3-9a18-4690-9303-3c39d6476172 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:30.134769 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2b832-d907-4836-b554-da0a13ac6761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:30.136680 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2b832-d907-4836-b554-da0a13ac6761 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:30.136976 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2b832-d907-4836-b554-da0a13ac6761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:30.137261 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2b832-d907-4836-b554-da0a13ac6761 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:30.137970 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2b832-d907-4836-b554-da0a13ac6761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:30.139959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2b832-d907-4836-b554-da0a13ac6761 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:30.169572 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1025/2043] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:30 2021] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:33:30.173667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452bda0-b78e-4c55-b375-b9910b18ca9a None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:30.184923 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452bda0-b78e-4c55-b375-b9910b18ca9a None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:30.243467 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449de61-4344-4828-9d80-26027caa1742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:30.244551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449de61-4344-4828-9d80-26027caa1742 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:30.245075 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449de61-4344-4828-9d80-26027caa1742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:30.245510 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449de61-4344-4828-9d80-26027caa1742 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:30.246421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449de61-4344-4828-9d80-26027caa1742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:30.248618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449de61-4344-4828-9d80-26027caa1742 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:30.271894 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1019/2044] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:30 2021] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:30.276595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2b832-d907-4836-b554-da0a13ac6761 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:30.287288 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2b832-d907-4836-b554-da0a13ac6761 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:30.292382 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e988c-8a2a-4cf5-810e-93e56dd755da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:30.293060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e988c-8a2a-4cf5-810e-93e56dd755da admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:30.293347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e988c-8a2a-4cf5-810e-93e56dd755da admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:30.293623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e988c-8a2a-4cf5-810e-93e56dd755da admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:30.294356 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e988c-8a2a-4cf5-810e-93e56dd755da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:30.296026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e988c-8a2a-4cf5-810e-93e56dd755da admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:30.310225 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1026/2045] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:30 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:33:30.311484 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449de61-4344-4828-9d80-26027caa1742 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:30.324659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449de61-4344-4828-9d80-26027caa1742 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:30.330273 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47232433-0af0-4c2f-9f0a-f724c2d585d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:30.331479 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47232433-0af0-4c2f-9f0a-f724c2d585d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:30.333449 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47232433-0af0-4c2f-9f0a-f724c2d585d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:30.333449 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47232433-0af0-4c2f-9f0a-f724c2d585d7 admin admin] PATH_INFO: `/v3/projects/130fb78b7fb2441fb6329abc49fc6ae9/users/8a2e44fb59d74dd88285f94c9e669711/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:30.359328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47232433-0af0-4c2f-9f0a-f724c2d585d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130fb78b7fb2441fb6329abc49fc6ae9, user_id=8a2e44fb59d74dd88285f94c9e669711, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:30.362020 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47232433-0af0-4c2f-9f0a-f724c2d585d7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:30.378142 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1020/2046] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:30 2021] PUT /identity/v3/projects/130fb78b7fb2441fb6329abc49fc6ae9/users/8a2e44fb59d74dd88285f94c9e669711/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:30.383605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e988c-8a2a-4cf5-810e-93e56dd755da admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:30.394666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e988c-8a2a-4cf5-810e-93e56dd755da admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:30.455315 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03205df3-68e4-4c6e-b835-0cc41313bea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:30.456025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03205df3-68e4-4c6e-b835-0cc41313bea7 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:30.456390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03205df3-68e4-4c6e-b835-0cc41313bea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:30.456682 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03205df3-68e4-4c6e-b835-0cc41313bea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:30.457526 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03205df3-68e4-4c6e-b835-0cc41313bea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:30.459166 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03205df3-68e4-4c6e-b835-0cc41313bea7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:30.469728 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1027/2047] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:30 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:30.473898 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47232433-0af0-4c2f-9f0a-f724c2d585d7 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:30.487136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47232433-0af0-4c2f-9f0a-f724c2d585d7 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:30.493419 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307e537-a923-4016-b1be-f66432c735b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:30.494326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307e537-a923-4016-b1be-f66432c735b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:30.494608 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307e537-a923-4016-b1be-f66432c735b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:30.494926 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307e537-a923-4016-b1be-f66432c735b4 admin admin] PATH_INFO: `/v3/projects/130fb78b7fb2441fb6329abc49fc6ae9/users/8a2e44fb59d74dd88285f94c9e669711/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:30.497312 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307e537-a923-4016-b1be-f66432c735b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130fb78b7fb2441fb6329abc49fc6ae9, user_id=8a2e44fb59d74dd88285f94c9e669711, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:30.499623 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307e537-a923-4016-b1be-f66432c735b4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:30.511965 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1021/2048] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:30 2021] PUT /identity/v3/projects/130fb78b7fb2441fb6329abc49fc6ae9/users/8a2e44fb59d74dd88285f94c9e669711/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:33:30.522079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecd6df-30b4-472e-bec1-fabfe2b29674 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:30.522669 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecd6df-30b4-472e-bec1-fabfe2b29674 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:30.522669 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecd6df-30b4-472e-bec1-fabfe2b29674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:30.554725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-dcecd6df-30b4-472e-bec1-fabfe2b29674 None None] MFA Rules not processed for user `8a2e44fb59d74dd88285f94c9e669711`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:30.556000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-dcecd6df-30b4-472e-bec1-fabfe2b29674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:30.645406 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1028/2049] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:30 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:30.658396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307e537-a923-4016-b1be-f66432c735b4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:30.660206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e307e537-a923-4016-b1be-f66432c735b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:30.752734 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307e537-a923-4016-b1be-f66432c735b4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:30.764484 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525a6e0-395c-47ab-a759-29e77600e3b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:30.766927 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525a6e0-395c-47ab-a759-29e77600e3b6 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:30.767401 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525a6e0-395c-47ab-a759-29e77600e3b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:30.767849 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525a6e0-395c-47ab-a759-29e77600e3b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:30.779213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525a6e0-395c-47ab-a759-29e77600e3b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:30.781090 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525a6e0-395c-47ab-a759-29e77600e3b6 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:30.793441 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1022/2050] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:30 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:32.295966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecd6df-30b4-472e-bec1-fabfe2b29674 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:32.361003 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecd6df-30b4-472e-bec1-fabfe2b29674 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:32.366448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308e9b8-d2ba-4661-b03b-524654a460ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:32.367582 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e9b8-d2ba-4661-b03b-524654a460ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:32.367868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e9b8-d2ba-4661-b03b-524654a460ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:32.368147 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e9b8-d2ba-4661-b03b-524654a460ad admin admin] PATH_INFO: `/v3/users/abb75035d6d04699899fc09caa5a840e` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:32.369812 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308e9b8-d2ba-4661-b03b-524654a460ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb75035d6d04699899fc09caa5a840e)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:32.372274 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308e9b8-d2ba-4661-b03b-524654a460ad admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:32.420050 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d308e9b8-d2ba-4661-b03b-524654a460ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb75035d6d04699899fc09caa5a840e'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:32.431146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d308e9b8-d2ba-4661-b03b-524654a460ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb75035d6d04699899fc09caa5a840e'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:32.439071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d308e9b8-d2ba-4661-b03b-524654a460ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb75035d6d04699899fc09caa5a840e'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:32.452204 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d308e9b8-d2ba-4661-b03b-524654a460ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb75035d6d04699899fc09caa5a840e'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:32.452864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d308e9b8-d2ba-4661-b03b-524654a460ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb75035d6d04699899fc09caa5a840e'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:32.459121 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1029/2051] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:32 2021] DELETE /identity/v3/users/abb75035d6d04699899fc09caa5a840e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:32.466681 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06646157-f5e6-4941-b177-66f6797f2da0 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:32.467343 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06646157-f5e6-4941-b177-66f6797f2da0 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:32.467663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06646157-f5e6-4941-b177-66f6797f2da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:32.487470 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-06646157-f5e6-4941-b177-66f6797f2da0 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:32.488671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-06646157-f5e6-4941-b177-66f6797f2da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:32.546022 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1023/2052] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:32.556507 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308e9b8-d2ba-4661-b03b-524654a460ad admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:32.557934 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d308e9b8-d2ba-4661-b03b-524654a460ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:32.616923 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308e9b8-d2ba-4661-b03b-524654a460ad admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:32.623090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e233b-24e9-444d-8729-0d80b992a9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:32.623748 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e233b-24e9-444d-8729-0d80b992a9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:32.624039 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e233b-24e9-444d-8729-0d80b992a9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:32.624317 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e233b-24e9-444d-8729-0d80b992a9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:32.633557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e233b-24e9-444d-8729-0d80b992a9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:32.635026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e233b-24e9-444d-8729-0d80b992a9b9 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:32.644291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1030/2053] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:32.896301 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06646157-f5e6-4941-b177-66f6797f2da0 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:32.898406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-06646157-f5e6-4941-b177-66f6797f2da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:32.912259 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06646157-f5e6-4941-b177-66f6797f2da0 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:32.918171 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:32.926024 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:32.926341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:32.926634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] PATH_INFO: `/v3/projects/bf721023b46845749274e702faa56989` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:32.928190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf721023b46845749274e702faa56989)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:32.929956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:32.977730 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf721023b46845749274e702faa56989', 'request_id': 'req-fbec25af-712c-481b-9bf3-8cbd60edaeb1'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:32.982996 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf721023b46845749274e702faa56989', 'request_id': 'req-fbec25af-712c-481b-9bf3-8cbd60edaeb1'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:32.989209 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf721023b46845749274e702faa56989', 'request_id': 'req-fbec25af-712c-481b-9bf3-8cbd60edaeb1'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:33.004279 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] The token cache is being invalidate because project bf721023b46845749274e702faa56989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:33.004665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:33.005504 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:33.008131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1024/2054] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:32 2021] DELETE /identity/v3/projects/bf721023b46845749274e702faa56989 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:33.013423 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e233b-24e9-444d-8729-0d80b992a9b9 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:33.029698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e233b-24e9-444d-8729-0d80b992a9b9 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:33.088753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd62f43-b633-4846-819c-71929a192dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:33.089626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd62f43-b633-4846-819c-71929a192dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:33.089915 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd62f43-b633-4846-819c-71929a192dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:33.090190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd62f43-b633-4846-819c-71929a192dfd admin admin] PATH_INFO: `/v3/users/8a2e44fb59d74dd88285f94c9e669711` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:33.091402 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd62f43-b633-4846-819c-71929a192dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a2e44fb59d74dd88285f94c9e669711)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:33.093326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd62f43-b633-4846-819c-71929a192dfd admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:33.138399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0cd62f43-b633-4846-819c-71929a192dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a2e44fb59d74dd88285f94c9e669711'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:33.144948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0cd62f43-b633-4846-819c-71929a192dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a2e44fb59d74dd88285f94c9e669711'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:33.153927 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0cd62f43-b633-4846-819c-71929a192dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a2e44fb59d74dd88285f94c9e669711'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:33.167272 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0cd62f43-b633-4846-819c-71929a192dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a2e44fb59d74dd88285f94c9e669711'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:33.167936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0cd62f43-b633-4846-819c-71929a192dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a2e44fb59d74dd88285f94c9e669711'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:33.173704 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1031/2055] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:33 2021] DELETE /identity/v3/users/8a2e44fb59d74dd88285f94c9e669711 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:33.449842 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:33.451627 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:33.467483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec25af-712c-481b-9bf3-8cbd60edaeb1 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:33.543350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bacf7-6ef1-4a14-bf93-2436229d8c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:33.544230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bacf7-6ef1-4a14-bf93-2436229d8c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:33.544543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bacf7-6ef1-4a14-bf93-2436229d8c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:33.544823 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bacf7-6ef1-4a14-bf93-2436229d8c09 admin admin] PATH_INFO: `/v3/projects/130fb78b7fb2441fb6329abc49fc6ae9` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:33.546014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bacf7-6ef1-4a14-bf93-2436229d8c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=130fb78b7fb2441fb6329abc49fc6ae9)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:33.547982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bacf7-6ef1-4a14-bf93-2436229d8c09 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:33.595924 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-642bacf7-6ef1-4a14-bf93-2436229d8c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130fb78b7fb2441fb6329abc49fc6ae9', 'request_id': 'req-642bacf7-6ef1-4a14-bf93-2436229d8c09'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:33.601460 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-642bacf7-6ef1-4a14-bf93-2436229d8c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130fb78b7fb2441fb6329abc49fc6ae9', 'request_id': 'req-642bacf7-6ef1-4a14-bf93-2436229d8c09'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:33.607450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-642bacf7-6ef1-4a14-bf93-2436229d8c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130fb78b7fb2441fb6329abc49fc6ae9', 'request_id': 'req-642bacf7-6ef1-4a14-bf93-2436229d8c09'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:33.623202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-642bacf7-6ef1-4a14-bf93-2436229d8c09 admin admin] The token cache is being invalidate because project 130fb78b7fb2441fb6329abc49fc6ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:33.623499 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-642bacf7-6ef1-4a14-bf93-2436229d8c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:33.624438 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-642bacf7-6ef1-4a14-bf93-2436229d8c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:33.630240 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1025/2056] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:33 2021] DELETE /identity/v3/projects/130fb78b7fb2441fb6329abc49fc6ae9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:33.632734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a935e-ba4f-49c8-9ab7-bd905d279134 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:33.633459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a935e-ba4f-49c8-9ab7-bd905d279134 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:33.633459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a935e-ba4f-49c8-9ab7-bd905d279134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:33.653086 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-3e2a935e-ba4f-49c8-9ab7-bd905d279134 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:33.654391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-3e2a935e-ba4f-49c8-9ab7-bd905d279134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:33.712783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1032/2057] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:33.720466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fd8b8-d3ff-4e9d-8278-63a91a125348 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:33.720759 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fd8b8-d3ff-4e9d-8278-63a91a125348 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:33.721041 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fd8b8-d3ff-4e9d-8278-63a91a125348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:33.739785 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-b89fd8b8-d3ff-4e9d-8278-63a91a125348 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:33.741524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b89fd8b8-d3ff-4e9d-8278-63a91a125348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:33.749470 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1026/2058] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:33.753862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a935e-ba4f-49c8-9ab7-bd905d279134 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:33.764235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a935e-ba4f-49c8-9ab7-bd905d279134 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:33.769022 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d505f70-fa79-4cf4-afb2-0b4f6fdb83c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:33.769756 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d505f70-fa79-4cf4-afb2-0b4f6fdb83c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:33.770047 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d505f70-fa79-4cf4-afb2-0b4f6fdb83c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:33.770330 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d505f70-fa79-4cf4-afb2-0b4f6fdb83c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:33.771167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d505f70-fa79-4cf4-afb2-0b4f6fdb83c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:33:33.771491 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d505f70-fa79-4cf4-afb2-0b4f6fdb83c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:33.773190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d505f70-fa79-4cf4-afb2-0b4f6fdb83c8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:33.785057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1033/2059] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:33:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:33:33.789783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fd8b8-d3ff-4e9d-8278-63a91a125348 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:33.798959 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fd8b8-d3ff-4e9d-8278-63a91a125348 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:33.804292 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844de57-f938-42ec-862c-c3fc0dea2536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:33.804945 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844de57-f938-42ec-862c-c3fc0dea2536 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:33.805229 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844de57-f938-42ec-862c-c3fc0dea2536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:33.805507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844de57-f938-42ec-862c-c3fc0dea2536 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:33.806202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844de57-f938-42ec-862c-c3fc0dea2536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:33.808139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844de57-f938-42ec-862c-c3fc0dea2536 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:33.834401 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1027/2060] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:33 2021] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:33.839212 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d505f70-fa79-4cf4-afb2-0b4f6fdb83c8 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:33.849105 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d505f70-fa79-4cf4-afb2-0b4f6fdb83c8 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:33.904106 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67361a-2c14-4f3e-8631-32f961e2b66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:33.904782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67361a-2c14-4f3e-8631-32f961e2b66c admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:33.905072 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67361a-2c14-4f3e-8631-32f961e2b66c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:33.905351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67361a-2c14-4f3e-8631-32f961e2b66c admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:33.906051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67361a-2c14-4f3e-8631-32f961e2b66c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:33.908016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67361a-2c14-4f3e-8631-32f961e2b66c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:33.932634 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1034/2061] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:33 2021] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:33:33.935373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844de57-f938-42ec-862c-c3fc0dea2536 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:33.948140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844de57-f938-42ec-862c-c3fc0dea2536 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:33.955783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c4e28-655a-404b-83c4-661ce9d2ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:33.956564 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c4e28-655a-404b-83c4-661ce9d2ad94 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:33.956851 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c4e28-655a-404b-83c4-661ce9d2ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:33.957131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c4e28-655a-404b-83c4-661ce9d2ad94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:33.957864 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c4e28-655a-404b-83c4-661ce9d2ad94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:33.959850 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c4e28-655a-404b-83c4-661ce9d2ad94 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:33.970644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1028/2062] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:33 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:33.975706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67361a-2c14-4f3e-8631-32f961e2b66c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:33.986283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67361a-2c14-4f3e-8631-32f961e2b66c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:33.991819 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cb015-b8b1-496c-8cbd-356e46762771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:33.992495 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cb015-b8b1-496c-8cbd-356e46762771 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:33.992784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cb015-b8b1-496c-8cbd-356e46762771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:33.993066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cb015-b8b1-496c-8cbd-356e46762771 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:33.993802 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1cb015-b8b1-496c-8cbd-356e46762771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:33.995481 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1cb015-b8b1-496c-8cbd-356e46762771 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:34.007844 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1035/2063] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:33 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:34.012398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c4e28-655a-404b-83c4-661ce9d2ad94 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:34.023124 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c4e28-655a-404b-83c4-661ce9d2ad94 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:34.027914 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977457cc-4a63-44fd-aea9-20d40c9273d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:34.028839 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977457cc-4a63-44fd-aea9-20d40c9273d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:34.029130 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977457cc-4a63-44fd-aea9-20d40c9273d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:34.029414 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977457cc-4a63-44fd-aea9-20d40c9273d2 admin admin] PATH_INFO: `/v3/projects/26dc7b71c3e34c0891ec8bdabd1a8ff8/users/242f0e25120d47029b186d8ba4ee751a/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:34.045086 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977457cc-4a63-44fd-aea9-20d40c9273d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26dc7b71c3e34c0891ec8bdabd1a8ff8, user_id=242f0e25120d47029b186d8ba4ee751a, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:34.047807 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977457cc-4a63-44fd-aea9-20d40c9273d2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:34.061630 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1029/2064] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:34 2021] PUT /identity/v3/projects/26dc7b71c3e34c0891ec8bdabd1a8ff8/users/242f0e25120d47029b186d8ba4ee751a/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:34.073699 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e76130-c24f-418a-9ea4-87663b1c3cbb None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:34.073912 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e76130-c24f-418a-9ea4-87663b1c3cbb None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:34.074199 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e76130-c24f-418a-9ea4-87663b1c3cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:34.102089 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-29e76130-c24f-418a-9ea4-87663b1c3cbb None None] MFA Rules not processed for user `242f0e25120d47029b186d8ba4ee751a`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:34.103321 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-29e76130-c24f-418a-9ea4-87663b1c3cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:34.165821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1036/2065] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:34 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:34.170208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977457cc-4a63-44fd-aea9-20d40c9273d2 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:34.229577 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977457cc-4a63-44fd-aea9-20d40c9273d2 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:34.234281 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b58f6-1100-4f7d-a5bd-a2d80e4cc476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:34.234972 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b58f6-1100-4f7d-a5bd-a2d80e4cc476 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:34.235264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b58f6-1100-4f7d-a5bd-a2d80e4cc476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:34.235544 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b58f6-1100-4f7d-a5bd-a2d80e4cc476 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:34.236233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b58f6-1100-4f7d-a5bd-a2d80e4cc476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:34.238140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b58f6-1100-4f7d-a5bd-a2d80e4cc476 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:34.262734 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1030/2066] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:34 2021] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:34.266747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e76130-c24f-418a-9ea4-87663b1c3cbb None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:34.277232 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e76130-c24f-418a-9ea4-87663b1c3cbb None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:34.330546 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b436eb-3fac-4378-8653-d68d06ea5d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:34.331241 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b436eb-3fac-4378-8653-d68d06ea5d75 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:34.331527 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b436eb-3fac-4378-8653-d68d06ea5d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:34.331799 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b436eb-3fac-4378-8653-d68d06ea5d75 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:34.332486 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b436eb-3fac-4378-8653-d68d06ea5d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:34.335090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b436eb-3fac-4378-8653-d68d06ea5d75 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:34.354738 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1037/2067] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:34 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:33:34.358701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b58f6-1100-4f7d-a5bd-a2d80e4cc476 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:34.368838 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b58f6-1100-4f7d-a5bd-a2d80e4cc476 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:34.373544 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6f16b-f295-4fed-be97-326d257f0329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:34.374205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6f16b-f295-4fed-be97-326d257f0329 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:34.374494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6f16b-f295-4fed-be97-326d257f0329 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:34.374776 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6f16b-f295-4fed-be97-326d257f0329 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:34.375537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6f16b-f295-4fed-be97-326d257f0329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:34.377146 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6f16b-f295-4fed-be97-326d257f0329 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:34.388308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1031/2068] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:34.392365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b436eb-3fac-4378-8653-d68d06ea5d75 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:34.402568 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b436eb-3fac-4378-8653-d68d06ea5d75 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:34.407785 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b34b2-8f7c-43b1-a7bd-b8b4892b6b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:34.408663 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b34b2-8f7c-43b1-a7bd-b8b4892b6b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:34.408947 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b34b2-8f7c-43b1-a7bd-b8b4892b6b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:34.409226 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b34b2-8f7c-43b1-a7bd-b8b4892b6b2e admin admin] PATH_INFO: `/v3/projects/557b3044e3f448b39b1cf4b4db00401d/users/207f9366c0364c6a83a851668adf51b8/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:34.424185 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b34b2-8f7c-43b1-a7bd-b8b4892b6b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=557b3044e3f448b39b1cf4b4db00401d, user_id=207f9366c0364c6a83a851668adf51b8, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:34.426867 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b34b2-8f7c-43b1-a7bd-b8b4892b6b2e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:34.440227 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1038/2069] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:34 2021] PUT /identity/v3/projects/557b3044e3f448b39b1cf4b4db00401d/users/207f9366c0364c6a83a851668adf51b8/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:34.444354 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6f16b-f295-4fed-be97-326d257f0329 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:34.453971 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6f16b-f295-4fed-be97-326d257f0329 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:34.510304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be2868-943b-43f9-8968-67f419170b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:34.511066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be2868-943b-43f9-8968-67f419170b84 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:34.511352 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be2868-943b-43f9-8968-67f419170b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:34.511631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be2868-943b-43f9-8968-67f419170b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:34.512367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be2868-943b-43f9-8968-67f419170b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:34.513976 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be2868-943b-43f9-8968-67f419170b84 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:34.528111 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1032/2070] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:34 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:34.529525 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b34b2-8f7c-43b1-a7bd-b8b4892b6b2e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:34.540425 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b34b2-8f7c-43b1-a7bd-b8b4892b6b2e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:34.545808 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd4810-a505-4989-940e-0f105d9f9294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:34.546698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4810-a505-4989-940e-0f105d9f9294 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:34.547021 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4810-a505-4989-940e-0f105d9f9294 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:34.547445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4810-a505-4989-940e-0f105d9f9294 admin admin] PATH_INFO: `/v3/projects/557b3044e3f448b39b1cf4b4db00401d/users/207f9366c0364c6a83a851668adf51b8/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:34.549328 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd4810-a505-4989-940e-0f105d9f9294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557b3044e3f448b39b1cf4b4db00401d, user_id=207f9366c0364c6a83a851668adf51b8, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:34.552015 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd4810-a505-4989-940e-0f105d9f9294 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:34.563387 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1039/2071] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:34 2021] PUT /identity/v3/projects/557b3044e3f448b39b1cf4b4db00401d/users/207f9366c0364c6a83a851668adf51b8/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:34.574453 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf2b5-2a7c-4601-b95d-d9381c8aaee0 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:34.574746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf2b5-2a7c-4601-b95d-d9381c8aaee0 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:34.575066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf2b5-2a7c-4601-b95d-d9381c8aaee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:34.606909 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-dffaf2b5-2a7c-4601-b95d-d9381c8aaee0 None None] MFA Rules not processed for user `207f9366c0364c6a83a851668adf51b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:34.608169 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-dffaf2b5-2a7c-4601-b95d-d9381c8aaee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:34.676487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1033/2072] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:34 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:34.687118 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd4810-a505-4989-940e-0f105d9f9294 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:34.689178 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-36cd4810-a505-4989-940e-0f105d9f9294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:34.744315 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd4810-a505-4989-940e-0f105d9f9294 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:34.747987 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691530f-c776-4162-8adb-73b7d1ecf99b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:34.748625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691530f-c776-4162-8adb-73b7d1ecf99b service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:34.748917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691530f-c776-4162-8adb-73b7d1ecf99b service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:34.749209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691530f-c776-4162-8adb-73b7d1ecf99b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:34.758593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691530f-c776-4162-8adb-73b7d1ecf99b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:34.760055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691530f-c776-4162-8adb-73b7d1ecf99b service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:34.769314 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1040/2073] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:34 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:34.812341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffaf2b5-2a7c-4601-b95d-d9381c8aaee0 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:34.813774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-dffaf2b5-2a7c-4601-b95d-d9381c8aaee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:34.825890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffaf2b5-2a7c-4601-b95d-d9381c8aaee0 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:34.829546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f7d68-34f9-4059-a711-57727cdf6e4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:34.830188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f7d68-34f9-4059-a711-57727cdf6e4d service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:34.830474 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f7d68-34f9-4059-a711-57727cdf6e4d service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:34.830752 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f7d68-34f9-4059-a711-57727cdf6e4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:34.885394 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f7d68-34f9-4059-a711-57727cdf6e4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:34.886897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f7d68-34f9-4059-a711-57727cdf6e4d service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:34.895631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1034/2074] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:34 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:33:38.184650 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691530f-c776-4162-8adb-73b7d1ecf99b service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:38.242901 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691530f-c776-4162-8adb-73b7d1ecf99b service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:38.247573 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4613271-3263-4c3c-b550-286f83354c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:38.248459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4613271-3263-4c3c-b550-286f83354c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:38.248733 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4613271-3263-4c3c-b550-286f83354c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:38.249011 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4613271-3263-4c3c-b550-286f83354c27 admin admin] PATH_INFO: `/v3/users/242f0e25120d47029b186d8ba4ee751a` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:38.250365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4613271-3263-4c3c-b550-286f83354c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=242f0e25120d47029b186d8ba4ee751a)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:38.252455 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4613271-3263-4c3c-b550-286f83354c27 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:38.300582 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d4613271-3263-4c3c-b550-286f83354c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242f0e25120d47029b186d8ba4ee751a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:38.308199 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d4613271-3263-4c3c-b550-286f83354c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242f0e25120d47029b186d8ba4ee751a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:38.315809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d4613271-3263-4c3c-b550-286f83354c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242f0e25120d47029b186d8ba4ee751a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:38.328724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d4613271-3263-4c3c-b550-286f83354c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242f0e25120d47029b186d8ba4ee751a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:38.329452 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d4613271-3263-4c3c-b550-286f83354c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242f0e25120d47029b186d8ba4ee751a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:38.335581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1041/2075] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:38 2021] DELETE /identity/v3/users/242f0e25120d47029b186d8ba4ee751a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:38.340578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e1291-5a0c-4421-b56a-b132e26ad523 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:38.341069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e1291-5a0c-4421-b56a-b132e26ad523 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:38.341170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e1291-5a0c-4421-b56a-b132e26ad523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:38.359543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-b36e1291-5a0c-4421-b56a-b132e26ad523 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:38.360760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b36e1291-5a0c-4421-b56a-b132e26ad523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:38.418544 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1035/2076] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:33:38.428236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4613271-3263-4c3c-b550-286f83354c27 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:38.429666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d4613271-3263-4c3c-b550-286f83354c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:38.487500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4613271-3263-4c3c-b550-286f83354c27 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:38.491179 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65d7fb-2d2b-4cc8-9d8f-2dccf0338572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:38.491826 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65d7fb-2d2b-4cc8-9d8f-2dccf0338572 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:38.492118 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65d7fb-2d2b-4cc8-9d8f-2dccf0338572 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:38.492398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65d7fb-2d2b-4cc8-9d8f-2dccf0338572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:38.501364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65d7fb-2d2b-4cc8-9d8f-2dccf0338572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:38.502817 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65d7fb-2d2b-4cc8-9d8f-2dccf0338572 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:38.512695 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1042/2077] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:38.768797 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e1291-5a0c-4421-b56a-b132e26ad523 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:38.770188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b36e1291-5a0c-4421-b56a-b132e26ad523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:38.787897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e1291-5a0c-4421-b56a-b132e26ad523 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:38.799507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:38.800405 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:38.800692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:38.800970 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] PATH_INFO: `/v3/projects/26dc7b71c3e34c0891ec8bdabd1a8ff8` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:38.802238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26dc7b71c3e34c0891ec8bdabd1a8ff8)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:38.804213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:38.850364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26dc7b71c3e34c0891ec8bdabd1a8ff8', 'request_id': 'req-710d51db-ce65-4f2f-8294-6f74f08c16f4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:38.855549 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26dc7b71c3e34c0891ec8bdabd1a8ff8', 'request_id': 'req-710d51db-ce65-4f2f-8294-6f74f08c16f4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:38.861410 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26dc7b71c3e34c0891ec8bdabd1a8ff8', 'request_id': 'req-710d51db-ce65-4f2f-8294-6f74f08c16f4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:38.873345 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] The token cache is being invalidate because project 26dc7b71c3e34c0891ec8bdabd1a8ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:38.873638 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:38.874256 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:38.875813 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1036/2078] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:38 2021] DELETE /identity/v3/projects/26dc7b71c3e34c0891ec8bdabd1a8ff8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:38.880141 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65d7fb-2d2b-4cc8-9d8f-2dccf0338572 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:38.890446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65d7fb-2d2b-4cc8-9d8f-2dccf0338572 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:38.943361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098a2c6-039f-44d9-b5d1-66c7deee3829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:38.944321 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098a2c6-039f-44d9-b5d1-66c7deee3829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:38.944611 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098a2c6-039f-44d9-b5d1-66c7deee3829 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:38.944900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098a2c6-039f-44d9-b5d1-66c7deee3829 admin admin] PATH_INFO: `/v3/users/207f9366c0364c6a83a851668adf51b8` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:38.947218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098a2c6-039f-44d9-b5d1-66c7deee3829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=207f9366c0364c6a83a851668adf51b8)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:38.949098 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098a2c6-039f-44d9-b5d1-66c7deee3829 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:38.993912 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-b098a2c6-039f-44d9-b5d1-66c7deee3829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '207f9366c0364c6a83a851668adf51b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:39.000846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-b098a2c6-039f-44d9-b5d1-66c7deee3829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '207f9366c0364c6a83a851668adf51b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:39.009869 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-b098a2c6-039f-44d9-b5d1-66c7deee3829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '207f9366c0364c6a83a851668adf51b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:39.021560 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-b098a2c6-039f-44d9-b5d1-66c7deee3829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '207f9366c0364c6a83a851668adf51b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:39.022230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-b098a2c6-039f-44d9-b5d1-66c7deee3829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '207f9366c0364c6a83a851668adf51b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:39.028136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1043/2079] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:38 2021] DELETE /identity/v3/users/207f9366c0364c6a83a851668adf51b8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:39.377404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:39.381767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:39.401794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d51db-ce65-4f2f-8294-6f74f08c16f4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:39.465748 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7c647-7fc8-4626-9419-22ee4e83403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:39.466529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c647-7fc8-4626-9419-22ee4e83403f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:39.466815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c647-7fc8-4626-9419-22ee4e83403f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:39.467125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c647-7fc8-4626-9419-22ee4e83403f admin admin] PATH_INFO: `/v3/projects/557b3044e3f448b39b1cf4b4db00401d` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:39.471582 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7c647-7fc8-4626-9419-22ee4e83403f admin admin] RBAC: Authorizing `identity:delete_project(project_id=557b3044e3f448b39b1cf4b4db00401d)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:39.471582 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7c647-7fc8-4626-9419-22ee4e83403f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:39.636025 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-83b7c647-7fc8-4626-9419-22ee4e83403f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557b3044e3f448b39b1cf4b4db00401d', 'request_id': 'req-83b7c647-7fc8-4626-9419-22ee4e83403f'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:39.641512 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-83b7c647-7fc8-4626-9419-22ee4e83403f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557b3044e3f448b39b1cf4b4db00401d', 'request_id': 'req-83b7c647-7fc8-4626-9419-22ee4e83403f'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:39.647720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-83b7c647-7fc8-4626-9419-22ee4e83403f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557b3044e3f448b39b1cf4b4db00401d', 'request_id': 'req-83b7c647-7fc8-4626-9419-22ee4e83403f'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:39.659692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-83b7c647-7fc8-4626-9419-22ee4e83403f admin admin] The token cache is being invalidate because project 557b3044e3f448b39b1cf4b4db00401d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:39.660095 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-83b7c647-7fc8-4626-9419-22ee4e83403f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:39.660792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-83b7c647-7fc8-4626-9419-22ee4e83403f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:39.662395 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1037/2080] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:39 2021] DELETE /identity/v3/projects/557b3044e3f448b39b1cf4b4db00401d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:39.669151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ef93-e4ec-4e20-8ff7-e73e01d8bf60 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:39.669610 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ef93-e4ec-4e20-8ff7-e73e01d8bf60 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:39.669719 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ef93-e4ec-4e20-8ff7-e73e01d8bf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:39.687865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7e49ef93-e4ec-4e20-8ff7-e73e01d8bf60 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:39.689050 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7e49ef93-e4ec-4e20-8ff7-e73e01d8bf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:39.755807 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1044/2081] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:39.764167 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef2f36-23af-41c9-964b-04aac68403f6 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:39.764462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef2f36-23af-41c9-964b-04aac68403f6 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:39.764794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef2f36-23af-41c9-964b-04aac68403f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:39.783091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-0bef2f36-23af-41c9-964b-04aac68403f6 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:39.784334 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0bef2f36-23af-41c9-964b-04aac68403f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:39.793261 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1038/2082] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:39.797218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49ef93-e4ec-4e20-8ff7-e73e01d8bf60 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:39.806987 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49ef93-e4ec-4e20-8ff7-e73e01d8bf60 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:39.811511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b8203-adc3-46bc-a581-446cabbbd888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:39.812150 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b8203-adc3-46bc-a581-446cabbbd888 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:39.812431 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b8203-adc3-46bc-a581-446cabbbd888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:39.812705 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b8203-adc3-46bc-a581-446cabbbd888 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:39.813415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b8203-adc3-46bc-a581-446cabbbd888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:33:39.813718 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b8203-adc3-46bc-a581-446cabbbd888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:39.815353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b8203-adc3-46bc-a581-446cabbbd888 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:39.827356 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1045/2083] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:33:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:33:39.831530 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef2f36-23af-41c9-964b-04aac68403f6 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:39.840919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef2f36-23af-41c9-964b-04aac68403f6 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:39.845601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf233fa-3116-48fc-9238-f35ba12556c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:39.846251 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf233fa-3116-48fc-9238-f35ba12556c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:39.846538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf233fa-3116-48fc-9238-f35ba12556c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:39.846814 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf233fa-3116-48fc-9238-f35ba12556c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:39.847544 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf233fa-3116-48fc-9238-f35ba12556c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:39.849427 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf233fa-3116-48fc-9238-f35ba12556c4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:39.878784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1039/2084] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:39 2021] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:39.884034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b8203-adc3-46bc-a581-446cabbbd888 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:39.893770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b8203-adc3-46bc-a581-446cabbbd888 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:39.949438 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b82764-2483-4505-b010-94f91c54341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:39.950150 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b82764-2483-4505-b010-94f91c54341b admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:39.950441 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b82764-2483-4505-b010-94f91c54341b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:39.950724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b82764-2483-4505-b010-94f91c54341b admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:39.951455 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b82764-2483-4505-b010-94f91c54341b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:39.953481 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b82764-2483-4505-b010-94f91c54341b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:39.972879 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1046/2085] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:39 2021] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:39.977230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf233fa-3116-48fc-9238-f35ba12556c4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:39.987171 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf233fa-3116-48fc-9238-f35ba12556c4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:39.991828 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77bb14-996b-47e4-b60b-b07cf5da16ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:39.992708 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77bb14-996b-47e4-b60b-b07cf5da16ca admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:39.992992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77bb14-996b-47e4-b60b-b07cf5da16ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:39.993270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77bb14-996b-47e4-b60b-b07cf5da16ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:39.994032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77bb14-996b-47e4-b60b-b07cf5da16ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:39.995677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77bb14-996b-47e4-b60b-b07cf5da16ca admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:40.006129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1040/2086] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:39 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:33:40.010792 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b82764-2483-4505-b010-94f91c54341b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:40.020721 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b82764-2483-4505-b010-94f91c54341b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:40.026190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbc2fe-15eb-44bc-a418-ff55d51fc59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:40.026865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbc2fe-15eb-44bc-a418-ff55d51fc59b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:40.027164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbc2fe-15eb-44bc-a418-ff55d51fc59b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:40.027448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbc2fe-15eb-44bc-a418-ff55d51fc59b admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:40.028176 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbc2fe-15eb-44bc-a418-ff55d51fc59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:40.029784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbc2fe-15eb-44bc-a418-ff55d51fc59b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:40.039611 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1047/2087] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:40 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:40.043779 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77bb14-996b-47e4-b60b-b07cf5da16ca admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:40.053422 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77bb14-996b-47e4-b60b-b07cf5da16ca admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:40.058200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81af85-d8fa-4b3a-b983-0978e296f957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:40.059127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81af85-d8fa-4b3a-b983-0978e296f957 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:40.059412 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81af85-d8fa-4b3a-b983-0978e296f957 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:40.059690 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81af85-d8fa-4b3a-b983-0978e296f957 admin admin] PATH_INFO: `/v3/projects/d835f80faff3406697f39d5482b14a53/users/78f9d3a69906429ca9e78716ecb76f15/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:40.074358 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81af85-d8fa-4b3a-b983-0978e296f957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d835f80faff3406697f39d5482b14a53, user_id=78f9d3a69906429ca9e78716ecb76f15, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:40.077101 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81af85-d8fa-4b3a-b983-0978e296f957 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:40.090608 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1041/2088] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:40 2021] PUT /identity/v3/projects/d835f80faff3406697f39d5482b14a53/users/78f9d3a69906429ca9e78716ecb76f15/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:40.101096 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9010c5c-24df-4814-8ce0-ab10d32fd6f8 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:40.101389 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9010c5c-24df-4814-8ce0-ab10d32fd6f8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:40.101704 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9010c5c-24df-4814-8ce0-ab10d32fd6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:40.127273 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-d9010c5c-24df-4814-8ce0-ab10d32fd6f8 None None] MFA Rules not processed for user `78f9d3a69906429ca9e78716ecb76f15`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:40.128492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d9010c5c-24df-4814-8ce0-ab10d32fd6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:40.192358 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1048/2089] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:40 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:40.197637 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81af85-d8fa-4b3a-b983-0978e296f957 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:40.267500 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81af85-d8fa-4b3a-b983-0978e296f957 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:40.272380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2abff-cd60-4a73-85df-bb7f70815082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:40.273109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2abff-cd60-4a73-85df-bb7f70815082 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:40.273335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2abff-cd60-4a73-85df-bb7f70815082 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:40.273623 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2abff-cd60-4a73-85df-bb7f70815082 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:40.274317 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2abff-cd60-4a73-85df-bb7f70815082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:40.276250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2abff-cd60-4a73-85df-bb7f70815082 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:40.306717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1042/2090] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:40 2021] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:33:40.308185 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9010c5c-24df-4814-8ce0-ab10d32fd6f8 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:40.319837 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9010c5c-24df-4814-8ce0-ab10d32fd6f8 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:40.391126 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7de561-1748-4fb8-af55-08ee1903fb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:40.391818 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7de561-1748-4fb8-af55-08ee1903fb5a admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:40.392105 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7de561-1748-4fb8-af55-08ee1903fb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:40.392385 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7de561-1748-4fb8-af55-08ee1903fb5a admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:40.393132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7de561-1748-4fb8-af55-08ee1903fb5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:40.395445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7de561-1748-4fb8-af55-08ee1903fb5a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:40.431137 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1049/2091] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:40 2021] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:33:40.432874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2abff-cd60-4a73-85df-bb7f70815082 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:40.444140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2abff-cd60-4a73-85df-bb7f70815082 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:40.449916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231ea88-f03e-49d3-8e15-50ff625b1b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:40.450693 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231ea88-f03e-49d3-8e15-50ff625b1b9d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:40.450904 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231ea88-f03e-49d3-8e15-50ff625b1b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:40.451231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231ea88-f03e-49d3-8e15-50ff625b1b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:40.462306 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231ea88-f03e-49d3-8e15-50ff625b1b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:40.462487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231ea88-f03e-49d3-8e15-50ff625b1b9d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:40.474468 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1043/2092] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:40 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:40.478859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7de561-1748-4fb8-af55-08ee1903fb5a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:40.490671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7de561-1748-4fb8-af55-08ee1903fb5a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:40.499214 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d47f25-7c66-458e-9764-f555047d4287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:40.500426 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d47f25-7c66-458e-9764-f555047d4287 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:40.500835 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d47f25-7c66-458e-9764-f555047d4287 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:40.501347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d47f25-7c66-458e-9764-f555047d4287 admin admin] PATH_INFO: `/v3/projects/fc22375667b244fc998808e38767e566/users/bed1d454cc174b10b0afdc18cf4bd89f/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:40.531654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d47f25-7c66-458e-9764-f555047d4287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc22375667b244fc998808e38767e566, user_id=bed1d454cc174b10b0afdc18cf4bd89f, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:40.534699 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d47f25-7c66-458e-9764-f555047d4287 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:40.561695 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1050/2093] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:40 2021] PUT /identity/v3/projects/fc22375667b244fc998808e38767e566/users/bed1d454cc174b10b0afdc18cf4bd89f/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:33:40.561824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231ea88-f03e-49d3-8e15-50ff625b1b9d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:40.573078 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231ea88-f03e-49d3-8e15-50ff625b1b9d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:40.636660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cbb60-991a-4f23-82db-85d04c0b3196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:40.637346 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cbb60-991a-4f23-82db-85d04c0b3196 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:40.637632 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cbb60-991a-4f23-82db-85d04c0b3196 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:40.637916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cbb60-991a-4f23-82db-85d04c0b3196 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:40.638646 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cbb60-991a-4f23-82db-85d04c0b3196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:40.640274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cbb60-991a-4f23-82db-85d04c0b3196 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:40.654044 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1044/2094] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:40 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:40.655878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d47f25-7c66-458e-9764-f555047d4287 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:40.667297 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d47f25-7c66-458e-9764-f555047d4287 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:40.672843 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54dae09-5b53-4daf-ae7f-3e5fdcd37804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:40.673728 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dae09-5b53-4daf-ae7f-3e5fdcd37804 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:40.674009 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dae09-5b53-4daf-ae7f-3e5fdcd37804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:40.674286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dae09-5b53-4daf-ae7f-3e5fdcd37804 admin admin] PATH_INFO: `/v3/projects/fc22375667b244fc998808e38767e566/users/bed1d454cc174b10b0afdc18cf4bd89f/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:40.676316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54dae09-5b53-4daf-ae7f-3e5fdcd37804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc22375667b244fc998808e38767e566, user_id=bed1d454cc174b10b0afdc18cf4bd89f, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:40.679010 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54dae09-5b53-4daf-ae7f-3e5fdcd37804 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:40.690470 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1051/2095] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:40 2021] PUT /identity/v3/projects/fc22375667b244fc998808e38767e566/users/bed1d454cc174b10b0afdc18cf4bd89f/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:40.701438 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f678b-6ad6-4cff-a8a7-535a01363605 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:40.701749 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f678b-6ad6-4cff-a8a7-535a01363605 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:40.702028 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f678b-6ad6-4cff-a8a7-535a01363605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:40.729537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-b54f678b-6ad6-4cff-a8a7-535a01363605 None None] MFA Rules not processed for user `bed1d454cc174b10b0afdc18cf4bd89f`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:40.730722 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b54f678b-6ad6-4cff-a8a7-535a01363605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:40.797943 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1045/2096] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:40 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:40.809106 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54dae09-5b53-4daf-ae7f-3e5fdcd37804 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:40.810864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-c54dae09-5b53-4daf-ae7f-3e5fdcd37804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:40.870189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54dae09-5b53-4daf-ae7f-3e5fdcd37804 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:40.873930 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9161-43ce-4aed-9b42-c1b0a99402e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:40.874620 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9161-43ce-4aed-9b42-c1b0a99402e0 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:40.874952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9161-43ce-4aed-9b42-c1b0a99402e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:40.875305 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9161-43ce-4aed-9b42-c1b0a99402e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:40.887933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec9161-43ce-4aed-9b42-c1b0a99402e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:40.890928 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec9161-43ce-4aed-9b42-c1b0a99402e0 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:40.899561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1052/2097] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:40 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:40.927641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f678b-6ad6-4cff-a8a7-535a01363605 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:40.993086 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f678b-6ad6-4cff-a8a7-535a01363605 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:40.999192 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f2b10-3c76-4d29-86a1-ba8136151661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:41.000344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2b10-3c76-4d29-86a1-ba8136151661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:41.000741 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2b10-3c76-4d29-86a1-ba8136151661 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:41.001097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2b10-3c76-4d29-86a1-ba8136151661 admin admin] PATH_INFO: `/v3/users/78f9d3a69906429ca9e78716ecb76f15` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:41.002681 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f2b10-3c76-4d29-86a1-ba8136151661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f9d3a69906429ca9e78716ecb76f15)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:41.005171 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f2b10-3c76-4d29-86a1-ba8136151661 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:41.064295 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d72f2b10-3c76-4d29-86a1-ba8136151661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f9d3a69906429ca9e78716ecb76f15'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.070933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d72f2b10-3c76-4d29-86a1-ba8136151661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f9d3a69906429ca9e78716ecb76f15'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.071625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d72f2b10-3c76-4d29-86a1-ba8136151661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f9d3a69906429ca9e78716ecb76f15'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.083408 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d72f2b10-3c76-4d29-86a1-ba8136151661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f9d3a69906429ca9e78716ecb76f15'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.084085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d72f2b10-3c76-4d29-86a1-ba8136151661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f9d3a69906429ca9e78716ecb76f15'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.101175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1046/2098] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:40 2021] DELETE /identity/v3/users/78f9d3a69906429ca9e78716ecb76f15 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:41.106388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5099-48f6-4175-af67-7b006d71bb7a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:41.106948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5099-48f6-4175-af67-7b006d71bb7a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:41.107418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5099-48f6-4175-af67-7b006d71bb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:41.126179 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-4a7d5099-48f6-4175-af67-7b006d71bb7a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:41.127434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4a7d5099-48f6-4175-af67-7b006d71bb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:41.192867 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1053/2099] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:41.202823 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f2b10-3c76-4d29-86a1-ba8136151661 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:41.204403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d72f2b10-3c76-4d29-86a1-ba8136151661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:41.264004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f2b10-3c76-4d29-86a1-ba8136151661 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:41.268253 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcb729-3657-4749-aaff-590ab7fa7712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:41.268928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb729-3657-4749-aaff-590ab7fa7712 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:41.269281 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb729-3657-4749-aaff-590ab7fa7712 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:41.269562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb729-3657-4749-aaff-590ab7fa7712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:41.279747 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcb729-3657-4749-aaff-590ab7fa7712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:41.281415 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcb729-3657-4749-aaff-590ab7fa7712 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:41.296380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1047/2100] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:41.584784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d5099-48f6-4175-af67-7b006d71bb7a None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:41.586888 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4a7d5099-48f6-4175-af67-7b006d71bb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:41.609755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d5099-48f6-4175-af67-7b006d71bb7a None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:41.614869 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:41.615753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:41.616041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:41.616338 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] PATH_INFO: `/v3/projects/d835f80faff3406697f39d5482b14a53` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:41.618258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d835f80faff3406697f39d5482b14a53)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:41.620211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:41.669131 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd835f80faff3406697f39d5482b14a53', 'request_id': 'req-50928e8f-e8bf-42b9-bef8-d1b2478038c1'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.675271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd835f80faff3406697f39d5482b14a53', 'request_id': 'req-50928e8f-e8bf-42b9-bef8-d1b2478038c1'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.685912 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd835f80faff3406697f39d5482b14a53', 'request_id': 'req-50928e8f-e8bf-42b9-bef8-d1b2478038c1'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.699160 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] The token cache is being invalidate because project d835f80faff3406697f39d5482b14a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:41.699698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.700540 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.702351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1054/2101] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:41 2021] DELETE /identity/v3/projects/d835f80faff3406697f39d5482b14a53 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:41.706164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcb729-3657-4749-aaff-590ab7fa7712 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:41.721399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcb729-3657-4749-aaff-590ab7fa7712 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:41.799998 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95838d73-2345-419b-979f-8cc87c1e4956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:41.800964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95838d73-2345-419b-979f-8cc87c1e4956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:41.801311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95838d73-2345-419b-979f-8cc87c1e4956 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:41.801788 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95838d73-2345-419b-979f-8cc87c1e4956 admin admin] PATH_INFO: `/v3/users/bed1d454cc174b10b0afdc18cf4bd89f` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:41.803254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95838d73-2345-419b-979f-8cc87c1e4956 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed1d454cc174b10b0afdc18cf4bd89f)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:41.806194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95838d73-2345-419b-979f-8cc87c1e4956 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:41.864943 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-95838d73-2345-419b-979f-8cc87c1e4956 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed1d454cc174b10b0afdc18cf4bd89f'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.872346 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-95838d73-2345-419b-979f-8cc87c1e4956 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed1d454cc174b10b0afdc18cf4bd89f'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.873020 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-95838d73-2345-419b-979f-8cc87c1e4956 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed1d454cc174b10b0afdc18cf4bd89f'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.884877 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-95838d73-2345-419b-979f-8cc87c1e4956 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed1d454cc174b10b0afdc18cf4bd89f'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.885626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-95838d73-2345-419b-979f-8cc87c1e4956 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed1d454cc174b10b0afdc18cf4bd89f'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:41.897109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1048/2102] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:41 2021] DELETE /identity/v3/users/bed1d454cc174b10b0afdc18cf4bd89f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:42.173616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:42.175259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:42.189273 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50928e8f-e8bf-42b9-bef8-d1b2478038c1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:42.254189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe568420-ae49-4a64-84c1-8883c6d9ecf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:42.255110 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe568420-ae49-4a64-84c1-8883c6d9ecf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:42.255397 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe568420-ae49-4a64-84c1-8883c6d9ecf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:42.255675 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe568420-ae49-4a64-84c1-8883c6d9ecf1 admin admin] PATH_INFO: `/v3/projects/fc22375667b244fc998808e38767e566` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:42.256907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe568420-ae49-4a64-84c1-8883c6d9ecf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc22375667b244fc998808e38767e566)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:42.259459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe568420-ae49-4a64-84c1-8883c6d9ecf1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:42.305333 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-fe568420-ae49-4a64-84c1-8883c6d9ecf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc22375667b244fc998808e38767e566', 'request_id': 'req-fe568420-ae49-4a64-84c1-8883c6d9ecf1'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:42.311593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-fe568420-ae49-4a64-84c1-8883c6d9ecf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc22375667b244fc998808e38767e566', 'request_id': 'req-fe568420-ae49-4a64-84c1-8883c6d9ecf1'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:42.319544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-fe568420-ae49-4a64-84c1-8883c6d9ecf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc22375667b244fc998808e38767e566', 'request_id': 'req-fe568420-ae49-4a64-84c1-8883c6d9ecf1'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:42.332156 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-fe568420-ae49-4a64-84c1-8883c6d9ecf1 admin admin] The token cache is being invalidate because project fc22375667b244fc998808e38767e566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:42.332479 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-fe568420-ae49-4a64-84c1-8883c6d9ecf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:42.333093 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-fe568420-ae49-4a64-84c1-8883c6d9ecf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:42.334627 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1055/2103] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:42 2021] DELETE /identity/v3/projects/fc22375667b244fc998808e38767e566 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:42.341725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69794540-2882-4407-bae9-a747c976cb3a None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:42.341949 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69794540-2882-4407-bae9-a747c976cb3a None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:42.342225 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69794540-2882-4407-bae9-a747c976cb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:42.360316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-69794540-2882-4407-bae9-a747c976cb3a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:42.361563 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-69794540-2882-4407-bae9-a747c976cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:42.433442 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1049/2104] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:42.441984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950bab2-a1e8-4c1b-b001-c817f1352d2e None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:42.442283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950bab2-a1e8-4c1b-b001-c817f1352d2e None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:42.442569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950bab2-a1e8-4c1b-b001-c817f1352d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:42.461425 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-d950bab2-a1e8-4c1b-b001-c817f1352d2e None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:42.462647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d950bab2-a1e8-4c1b-b001-c817f1352d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:42.475164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1056/2105] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:42.479952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69794540-2882-4407-bae9-a747c976cb3a None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:42.489310 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69794540-2882-4407-bae9-a747c976cb3a None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:42.494544 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d98327-394b-4fbb-9dbd-e80dcd0e9535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:42.495242 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98327-394b-4fbb-9dbd-e80dcd0e9535 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:42.495528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98327-394b-4fbb-9dbd-e80dcd0e9535 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:42.495814 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98327-394b-4fbb-9dbd-e80dcd0e9535 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:42.496539 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d98327-394b-4fbb-9dbd-e80dcd0e9535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:33:42.496863 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d98327-394b-4fbb-9dbd-e80dcd0e9535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:42.498483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d98327-394b-4fbb-9dbd-e80dcd0e9535 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:42.510107 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1050/2106] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:33:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:33:42.515928 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950bab2-a1e8-4c1b-b001-c817f1352d2e None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:42.525883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950bab2-a1e8-4c1b-b001-c817f1352d2e None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:42.530629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e0dee-8317-4f3a-9c50-ba9bcae94e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:42.531320 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e0dee-8317-4f3a-9c50-ba9bcae94e2b admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:42.531609 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e0dee-8317-4f3a-9c50-ba9bcae94e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:42.531946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e0dee-8317-4f3a-9c50-ba9bcae94e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:42.532650 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e0dee-8317-4f3a-9c50-ba9bcae94e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:42.534798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e0dee-8317-4f3a-9c50-ba9bcae94e2b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:42.563537 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1057/2107] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:42 2021] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:33:42.570554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d98327-394b-4fbb-9dbd-e80dcd0e9535 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:42.580092 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d98327-394b-4fbb-9dbd-e80dcd0e9535 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:42.649065 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97457-0326-4cb6-a3b3-dac77f63b9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:42.649752 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97457-0326-4cb6-a3b3-dac77f63b9af admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:42.650039 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97457-0326-4cb6-a3b3-dac77f63b9af admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:42.650320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97457-0326-4cb6-a3b3-dac77f63b9af admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:42.652135 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f97457-0326-4cb6-a3b3-dac77f63b9af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:42.655114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f97457-0326-4cb6-a3b3-dac77f63b9af admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:42.679463 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1051/2108] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:42 2021] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:42.684403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e0dee-8317-4f3a-9c50-ba9bcae94e2b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:42.694812 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e0dee-8317-4f3a-9c50-ba9bcae94e2b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:42.700350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922516c-8008-4fe2-a67e-1991982b384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:42.701016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922516c-8008-4fe2-a67e-1991982b384e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:42.701308 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922516c-8008-4fe2-a67e-1991982b384e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:42.701593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922516c-8008-4fe2-a67e-1991982b384e admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:42.702358 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922516c-8008-4fe2-a67e-1991982b384e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:42.704219 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922516c-8008-4fe2-a67e-1991982b384e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:42.719087 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1058/2109] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:42 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:42.719782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97457-0326-4cb6-a3b3-dac77f63b9af admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:42.730666 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97457-0326-4cb6-a3b3-dac77f63b9af admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:42.735818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb4fd4-69bf-4141-89c3-8e9ad84665ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:42.736564 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb4fd4-69bf-4141-89c3-8e9ad84665ad admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:42.736919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb4fd4-69bf-4141-89c3-8e9ad84665ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:42.737266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb4fd4-69bf-4141-89c3-8e9ad84665ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:42.738058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb4fd4-69bf-4141-89c3-8e9ad84665ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:42.739757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb4fd4-69bf-4141-89c3-8e9ad84665ad admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:42.752427 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1052/2110] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:42 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:42.755780 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922516c-8008-4fe2-a67e-1991982b384e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:42.768603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922516c-8008-4fe2-a67e-1991982b384e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:42.774429 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555abe9-0091-418b-b1cc-a7cd0813fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:42.775458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555abe9-0091-418b-b1cc-a7cd0813fad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:42.775811 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555abe9-0091-418b-b1cc-a7cd0813fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:42.776161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555abe9-0091-418b-b1cc-a7cd0813fad5 admin admin] PATH_INFO: `/v3/projects/592b67adb359400c964b7c05beb298b1/users/09beb527ce2f4f749565752fd569efac/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:42.791435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555abe9-0091-418b-b1cc-a7cd0813fad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592b67adb359400c964b7c05beb298b1, user_id=09beb527ce2f4f749565752fd569efac, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:42.794113 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555abe9-0091-418b-b1cc-a7cd0813fad5 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:42.809254 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1059/2111] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:42 2021] PUT /identity/v3/projects/592b67adb359400c964b7c05beb298b1/users/09beb527ce2f4f749565752fd569efac/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:42.819516 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015088-e0bb-494f-a261-d70f1f38070f None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:42.819807 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015088-e0bb-494f-a261-d70f1f38070f None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:42.820088 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b015088-e0bb-494f-a261-d70f1f38070f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:42.853830 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-7b015088-e0bb-494f-a261-d70f1f38070f None None] MFA Rules not processed for user `09beb527ce2f4f749565752fd569efac`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:42.855196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7b015088-e0bb-494f-a261-d70f1f38070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:42.954908 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1053/2112] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:42 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:42.955844 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555abe9-0091-418b-b1cc-a7cd0813fad5 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:43.041585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555abe9-0091-418b-b1cc-a7cd0813fad5 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:43.046755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab179b64-5d1f-4b82-9559-e2bdedec124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:43.047529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab179b64-5d1f-4b82-9559-e2bdedec124e admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:43.047868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab179b64-5d1f-4b82-9559-e2bdedec124e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:43.048151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab179b64-5d1f-4b82-9559-e2bdedec124e admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:43.049109 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab179b64-5d1f-4b82-9559-e2bdedec124e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:43.051532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab179b64-5d1f-4b82-9559-e2bdedec124e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:43.088200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1060/2113] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:42 2021] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:43.091898 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b015088-e0bb-494f-a261-d70f1f38070f None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:43.105872 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b015088-e0bb-494f-a261-d70f1f38070f None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:43.111470 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab179b64-5d1f-4b82-9559-e2bdedec124e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:43.113207 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ab179b64-5d1f-4b82-9559-e2bdedec124e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:43.202009 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab179b64-5d1f-4b82-9559-e2bdedec124e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:43.205805 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcb4cb-28f6-4459-bd3f-27e3d42f32a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:43.206570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcb4cb-28f6-4459-bd3f-27e3d42f32a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:43.207050 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcb4cb-28f6-4459-bd3f-27e3d42f32a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:43.207341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcb4cb-28f6-4459-bd3f-27e3d42f32a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:43.207990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d8083-3563-4e62-853f-f82ba80854ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:43.208130 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcb4cb-28f6-4459-bd3f-27e3d42f32a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:43.208921 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d8083-3563-4e62-853f-f82ba80854ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:43.209224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d8083-3563-4e62-853f-f82ba80854ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:43.209499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d8083-3563-4e62-853f-f82ba80854ae admin admin] PATH_INFO: `/v3/users/3df38fa7077d432fbfd51cc1bbef5f69` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:43.210531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcb4cb-28f6-4459-bd3f-27e3d42f32a5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:43.210772 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d8083-3563-4e62-853f-f82ba80854ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df38fa7077d432fbfd51cc1bbef5f69)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:43.213738 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d8083-3563-4e62-853f-f82ba80854ae admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:43.234967 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1054/2114] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:43 2021] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:33:43.239405 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcb4cb-28f6-4459-bd3f-27e3d42f32a5 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:43.263775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcb4cb-28f6-4459-bd3f-27e3d42f32a5 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:43.272892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c269720-c1c0-405b-b0c8-006d41917ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:43.274369 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c269720-c1c0-405b-b0c8-006d41917ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:43.274885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c269720-c1c0-405b-b0c8-006d41917ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:43.275098 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c269720-c1c0-405b-b0c8-006d41917ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:43.275832 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c269720-c1c0-405b-b0c8-006d41917ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:43.277631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c269720-c1c0-405b-b0c8-006d41917ab5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:43.282132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d18d8083-3563-4e62-853f-f82ba80854ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df38fa7077d432fbfd51cc1bbef5f69'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:43.290651 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d18d8083-3563-4e62-853f-f82ba80854ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df38fa7077d432fbfd51cc1bbef5f69'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:43.299660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1055/2115] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:43 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:43.303902 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c269720-c1c0-405b-b0c8-006d41917ab5 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:43.304855 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d18d8083-3563-4e62-853f-f82ba80854ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df38fa7077d432fbfd51cc1bbef5f69'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:43.315339 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c269720-c1c0-405b-b0c8-006d41917ab5 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:43.317749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d18d8083-3563-4e62-853f-f82ba80854ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df38fa7077d432fbfd51cc1bbef5f69'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:43.318440 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-d18d8083-3563-4e62-853f-f82ba80854ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df38fa7077d432fbfd51cc1bbef5f69'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:43.320457 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade80e47-1879-4333-b357-5f5e896e597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:43.321525 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade80e47-1879-4333-b357-5f5e896e597b admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:43.321882 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade80e47-1879-4333-b357-5f5e896e597b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:43.322172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade80e47-1879-4333-b357-5f5e896e597b admin admin] PATH_INFO: `/v3/projects/86ec5adad7a94be0986db4687a343ce7/users/ffc71391c3a44746be0497f4d312934f/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:43.324558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1061/2116] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:43 2021] DELETE /identity/v3/users/3df38fa7077d432fbfd51cc1bbef5f69 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:43.329129 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e589e0-bb77-4985-b2dc-5ceffa7f60df None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:43.329442 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e589e0-bb77-4985-b2dc-5ceffa7f60df None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:43.329751 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e589e0-bb77-4985-b2dc-5ceffa7f60df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:43.338485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade80e47-1879-4333-b357-5f5e896e597b admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ec5adad7a94be0986db4687a343ce7, user_id=ffc71391c3a44746be0497f4d312934f, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:43.341271 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade80e47-1879-4333-b357-5f5e896e597b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:43.348007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-20e589e0-bb77-4985-b2dc-5ceffa7f60df None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:43.349240 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-20e589e0-bb77-4985-b2dc-5ceffa7f60df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:43.356662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1056/2117] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:43 2021] PUT /identity/v3/projects/86ec5adad7a94be0986db4687a343ce7/users/ffc71391c3a44746be0497f4d312934f/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:43.360580 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade80e47-1879-4333-b357-5f5e896e597b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:43.362289 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ade80e47-1879-4333-b357-5f5e896e597b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:43.411376 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1062/2118] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:33:43.421803 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e589e0-bb77-4985-b2dc-5ceffa7f60df None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:43.423209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-20e589e0-bb77-4985-b2dc-5ceffa7f60df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:43.437820 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade80e47-1879-4333-b357-5f5e896e597b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:43.444388 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426857-b9a5-4f79-a7b0-7c9c2eb657a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:43.445391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426857-b9a5-4f79-a7b0-7c9c2eb657a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:43.446291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426857-b9a5-4f79-a7b0-7c9c2eb657a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:43.447241 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426857-b9a5-4f79-a7b0-7c9c2eb657a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:43.448785 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13426857-b9a5-4f79-a7b0-7c9c2eb657a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:43.451315 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13426857-b9a5-4f79-a7b0-7c9c2eb657a9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:43.463923 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1057/2119] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:43 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:33:43.468175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426857-b9a5-4f79-a7b0-7c9c2eb657a9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:43.480059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426857-b9a5-4f79-a7b0-7c9c2eb657a9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:43.484689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf5021-1975-4843-828e-799a5af1bd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:43.484959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e589e0-bb77-4985-b2dc-5ceffa7f60df None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:43.485596 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf5021-1975-4843-828e-799a5af1bd9c admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:43.485864 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf5021-1975-4843-828e-799a5af1bd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:43.486136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf5021-1975-4843-828e-799a5af1bd9c admin admin] PATH_INFO: `/v3/projects/86ec5adad7a94be0986db4687a343ce7/users/ffc71391c3a44746be0497f4d312934f/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:43.488155 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf5021-1975-4843-828e-799a5af1bd9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ec5adad7a94be0986db4687a343ce7, user_id=ffc71391c3a44746be0497f4d312934f, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:43.489974 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e47c39-4783-4877-b8c6-84c92ff7193a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:43.490624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e47c39-4783-4877-b8c6-84c92ff7193a service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:43.490746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf5021-1975-4843-828e-799a5af1bd9c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:43.490949 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e47c39-4783-4877-b8c6-84c92ff7193a service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:43.491230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e47c39-4783-4877-b8c6-84c92ff7193a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:43.501577 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e47c39-4783-4877-b8c6-84c92ff7193a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:43.512181 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1058/2120] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:43 2021] PUT /identity/v3/projects/86ec5adad7a94be0986db4687a343ce7/users/ffc71391c3a44746be0497f4d312934f/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:33:43.512408 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e47c39-4783-4877-b8c6-84c92ff7193a service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:43.515367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc77a32-b038-4364-8cc1-6414293cd0fd None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:43.515572 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1063/2121] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:33:43.515789 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc77a32-b038-4364-8cc1-6414293cd0fd None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:43.515955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc77a32-b038-4364-8cc1-6414293cd0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:43.546744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-0cc77a32-b038-4364-8cc1-6414293cd0fd None None] MFA Rules not processed for user `ffc71391c3a44746be0497f4d312934f`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:43.547976 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0cc77a32-b038-4364-8cc1-6414293cd0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:43.630417 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1059/2122] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:43 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:33:43.641517 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e47c39-4783-4877-b8c6-84c92ff7193a service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:43.643001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-90e47c39-4783-4877-b8c6-84c92ff7193a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:43.709944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e47c39-4783-4877-b8c6-84c92ff7193a service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:43.764619 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c58213-c006-4ed0-9270-1aff66d8da39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:43.765274 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c58213-c006-4ed0-9270-1aff66d8da39 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:43.765555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c58213-c006-4ed0-9270-1aff66d8da39 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:43.766031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c58213-c006-4ed0-9270-1aff66d8da39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:43.777161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c58213-c006-4ed0-9270-1aff66d8da39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:43.778659 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c58213-c006-4ed0-9270-1aff66d8da39 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:43.788757 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1064/2123] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:43 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:43.876951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc77a32-b038-4364-8cc1-6414293cd0fd None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:43.878620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0cc77a32-b038-4364-8cc1-6414293cd0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:43.989143 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc77a32-b038-4364-8cc1-6414293cd0fd None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:43.996006 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:43.997330 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:43.997712 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:43.998276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] PATH_INFO: `/v3/projects/d35bd39581784b3c8f95b7ff1d8f5346` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:43.999911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35bd39581784b3c8f95b7ff1d8f5346)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:44.002315 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:44.093888 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35bd39581784b3c8f95b7ff1d8f5346', 'request_id': 'req-09730076-bdd8-4430-90d4-cdc355658f5c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.104747 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35bd39581784b3c8f95b7ff1d8f5346', 'request_id': 'req-09730076-bdd8-4430-90d4-cdc355658f5c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.114121 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35bd39581784b3c8f95b7ff1d8f5346', 'request_id': 'req-09730076-bdd8-4430-90d4-cdc355658f5c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.134756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] The token cache is being invalidate because project d35bd39581784b3c8f95b7ff1d8f5346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:44.135699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.136615 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.139085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1060/2124] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:43 2021] DELETE /identity/v3/projects/d35bd39581784b3c8f95b7ff1d8f5346 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:44.143046 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c58213-c006-4ed0-9270-1aff66d8da39 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:44.156087 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c58213-c006-4ed0-9270-1aff66d8da39 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:44.243634 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90a584-74a1-4c4c-9f6c-c055a3ce69fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:44.244617 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90a584-74a1-4c4c-9f6c-c055a3ce69fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:44.244960 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90a584-74a1-4c4c-9f6c-c055a3ce69fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:44.245177 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90a584-74a1-4c4c-9f6c-c055a3ce69fb admin admin] PATH_INFO: `/v3/users/265246eda9474bc48b0a42d1e69469ff` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:44.246909 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90a584-74a1-4c4c-9f6c-c055a3ce69fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=265246eda9474bc48b0a42d1e69469ff)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:44.248985 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90a584-74a1-4c4c-9f6c-c055a3ce69fb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:44.272540 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:44.275912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:44.295214 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09730076-bdd8-4430-90d4-cdc355658f5c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:44.300432 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797cfb2-0c1f-4d89-a839-906ce2a5b0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:44.301554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797cfb2-0c1f-4d89-a839-906ce2a5b0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:44.301835 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797cfb2-0c1f-4d89-a839-906ce2a5b0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:44.302272 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797cfb2-0c1f-4d89-a839-906ce2a5b0a5 admin admin] PATH_INFO: `/v3/users/09beb527ce2f4f749565752fd569efac` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:44.303558 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797cfb2-0c1f-4d89-a839-906ce2a5b0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09beb527ce2f4f749565752fd569efac)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:44.305756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797cfb2-0c1f-4d89-a839-906ce2a5b0a5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:44.309820 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0d90a584-74a1-4c4c-9f6c-c055a3ce69fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265246eda9474bc48b0a42d1e69469ff'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.316790 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0d90a584-74a1-4c4c-9f6c-c055a3ce69fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265246eda9474bc48b0a42d1e69469ff'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.326630 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0d90a584-74a1-4c4c-9f6c-c055a3ce69fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265246eda9474bc48b0a42d1e69469ff'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.340681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0d90a584-74a1-4c4c-9f6c-c055a3ce69fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265246eda9474bc48b0a42d1e69469ff'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.341458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0d90a584-74a1-4c4c-9f6c-c055a3ce69fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265246eda9474bc48b0a42d1e69469ff'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.350907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1065/2125] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:44 2021] DELETE /identity/v3/users/265246eda9474bc48b0a42d1e69469ff => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:44.359495 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8797cfb2-0c1f-4d89-a839-906ce2a5b0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09beb527ce2f4f749565752fd569efac'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.366768 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8797cfb2-0c1f-4d89-a839-906ce2a5b0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09beb527ce2f4f749565752fd569efac'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.368801 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8797cfb2-0c1f-4d89-a839-906ce2a5b0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09beb527ce2f4f749565752fd569efac'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.384256 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8797cfb2-0c1f-4d89-a839-906ce2a5b0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09beb527ce2f4f749565752fd569efac'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.385271 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8797cfb2-0c1f-4d89-a839-906ce2a5b0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09beb527ce2f4f749565752fd569efac'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.394238 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb030e-df4a-4e6a-b26b-3a4869c09760 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:44.394520 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb030e-df4a-4e6a-b26b-3a4869c09760 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:44.394871 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb030e-df4a-4e6a-b26b-3a4869c09760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:44.403521 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1061/2126] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:44 2021] DELETE /identity/v3/users/09beb527ce2f4f749565752fd569efac => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:33:44.408392 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987821e1-3b66-4f49-bd85-67499cd7bb97 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:44.408678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987821e1-3b66-4f49-bd85-67499cd7bb97 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:44.408955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987821e1-3b66-4f49-bd85-67499cd7bb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:44.420461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-48eb030e-df4a-4e6a-b26b-3a4869c09760 None None] MFA Rules not processed for user `f6af4c462c6347ff8abbcc8770874b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:44.421251 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-48eb030e-df4a-4e6a-b26b-3a4869c09760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:44.437884 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-987821e1-3b66-4f49-bd85-67499cd7bb97 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:44.439690 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-987821e1-3b66-4f49-bd85-67499cd7bb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:44.498447 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1066/2127] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Nov 16 00:33:44 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:33:44.526105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1062/2128] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:44.538152 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb030e-df4a-4e6a-b26b-3a4869c09760 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:44.542532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-48eb030e-df4a-4e6a-b26b-3a4869c09760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:44.569320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987821e1-3b66-4f49-bd85-67499cd7bb97 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:44.572093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-987821e1-3b66-4f49-bd85-67499cd7bb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:44.636975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb030e-df4a-4e6a-b26b-3a4869c09760 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:44.647325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09744d-9f0b-4042-a10e-b1f8f58ee91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:44.647998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09744d-9f0b-4042-a10e-b1f8f58ee91f service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:44.649006 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09744d-9f0b-4042-a10e-b1f8f58ee91f service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:44.649883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09744d-9f0b-4042-a10e-b1f8f58ee91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:44.669862 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09744d-9f0b-4042-a10e-b1f8f58ee91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:44.670872 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09744d-9f0b-4042-a10e-b1f8f58ee91f service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:44.691434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1067/2129] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:44.703054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987821e1-3b66-4f49-bd85-67499cd7bb97 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:44.735831 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d8351-3781-4e53-81a6-adb076c6eef2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac32c6730654a889472a3bad95374bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:44.736398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d8351-3781-4e53-81a6-adb076c6eef2 service swift] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:44.736685 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d8351-3781-4e53-81a6-adb076c6eef2 service swift] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:44.737036 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d8351-3781-4e53-81a6-adb076c6eef2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:44.766856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d8351-3781-4e53-81a6-adb076c6eef2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:44.767844 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d8351-3781-4e53-81a6-adb076c6eef2 service swift] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:44.768650 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09744d-9f0b-4042-a10e-b1f8f58ee91f service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:44.771443 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ed09744d-9f0b-4042-a10e-b1f8f58ee91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:44.785259 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1063/2130] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Nov 16 00:33:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 00:33:44.805246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09744d-9f0b-4042-a10e-b1f8f58ee91f service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:44.822687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c16ea1-e18c-40dd-a798-4bdf9b735505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:44.826202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16ea1-e18c-40dd-a798-4bdf9b735505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:44.826533 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16ea1-e18c-40dd-a798-4bdf9b735505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:44.829625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16ea1-e18c-40dd-a798-4bdf9b735505 admin admin] PATH_INFO: `/v3/projects/99c76c9221a04a85bb9fafe60d6da736` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:44.831285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c16ea1-e18c-40dd-a798-4bdf9b735505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c76c9221a04a85bb9fafe60d6da736)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:44.833731 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c16ea1-e18c-40dd-a798-4bdf9b735505 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:44.936399 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-65c16ea1-e18c-40dd-a798-4bdf9b735505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c76c9221a04a85bb9fafe60d6da736', 'request_id': 'req-65c16ea1-e18c-40dd-a798-4bdf9b735505'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.951898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-65c16ea1-e18c-40dd-a798-4bdf9b735505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c76c9221a04a85bb9fafe60d6da736', 'request_id': 'req-65c16ea1-e18c-40dd-a798-4bdf9b735505'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.970701 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-65c16ea1-e18c-40dd-a798-4bdf9b735505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c76c9221a04a85bb9fafe60d6da736', 'request_id': 'req-65c16ea1-e18c-40dd-a798-4bdf9b735505'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.994641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-65c16ea1-e18c-40dd-a798-4bdf9b735505 admin admin] The token cache is being invalidate because project 99c76c9221a04a85bb9fafe60d6da736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:44.997023 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-65c16ea1-e18c-40dd-a798-4bdf9b735505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:44.997974 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-65c16ea1-e18c-40dd-a798-4bdf9b735505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:45.000163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1068/2131] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:44 2021] DELETE /identity/v3/projects/99c76c9221a04a85bb9fafe60d6da736 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:33:45.006025 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464168eb-e6c7-4302-8f85-29b55db54158 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:45.006618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464168eb-e6c7-4302-8f85-29b55db54158 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:45.006618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464168eb-e6c7-4302-8f85-29b55db54158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:45.044790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-464168eb-e6c7-4302-8f85-29b55db54158 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:45.046286 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-464168eb-e6c7-4302-8f85-29b55db54158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:45.129537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1064/2132] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:45.139987 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8328939-d436-4b8e-9c29-096a202bc345 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:45.140414 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8328939-d436-4b8e-9c29-096a202bc345 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:45.141435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8328939-d436-4b8e-9c29-096a202bc345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:45.163882 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-a8328939-d436-4b8e-9c29-096a202bc345 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:45.165305 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a8328939-d436-4b8e-9c29-096a202bc345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:45.180020 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1069/2133] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:45.186770 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464168eb-e6c7-4302-8f85-29b55db54158 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:45.199476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8328939-d436-4b8e-9c29-096a202bc345 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:45.200147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464168eb-e6c7-4302-8f85-29b55db54158 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:45.202161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a8328939-d436-4b8e-9c29-096a202bc345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:45.212962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5f3a6-2b45-4dba-b1f1-c20b0537e562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:45.213647 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5f3a6-2b45-4dba-b1f1-c20b0537e562 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:45.213933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5f3a6-2b45-4dba-b1f1-c20b0537e562 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:45.214212 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5f3a6-2b45-4dba-b1f1-c20b0537e562 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:45.215063 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5f3a6-2b45-4dba-b1f1-c20b0537e562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:33:45.215377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5f3a6-2b45-4dba-b1f1-c20b0537e562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:45.216982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5f3a6-2b45-4dba-b1f1-c20b0537e562 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:45.239615 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1065/2134] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:33:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:33:45.244684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5f3a6-2b45-4dba-b1f1-c20b0537e562 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:45.247257 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8328939-d436-4b8e-9c29-096a202bc345 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:45.256899 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:45.258554 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:45.259743 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:45.260234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] PATH_INFO: `/v3/projects/592b67adb359400c964b7c05beb298b1` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:45.262218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=592b67adb359400c964b7c05beb298b1)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:45.272373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:45.277431 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5f3a6-2b45-4dba-b1f1-c20b0537e562 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:45.284460 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa0e79-683d-412e-99e0-8545d10472f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:45.285405 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa0e79-683d-412e-99e0-8545d10472f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:45.286310 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa0e79-683d-412e-99e0-8545d10472f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:45.287239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa0e79-683d-412e-99e0-8545d10472f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:45.288291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa0e79-683d-412e-99e0-8545d10472f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:45.291942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa0e79-683d-412e-99e0-8545d10472f4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:45.333622 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1066/2135] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:45 2021] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:45.355780 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592b67adb359400c964b7c05beb298b1', 'request_id': 'req-946fa003-7ae2-4a45-9818-149960f338b2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:45.358576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa0e79-683d-412e-99e0-8545d10472f4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:45.366511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592b67adb359400c964b7c05beb298b1', 'request_id': 'req-946fa003-7ae2-4a45-9818-149960f338b2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:45.379424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592b67adb359400c964b7c05beb298b1', 'request_id': 'req-946fa003-7ae2-4a45-9818-149960f338b2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:45.394215 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] The token cache is being invalidate because project 592b67adb359400c964b7c05beb298b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:45.394509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:45.395136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:45.401394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1070/2136] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:45 2021] DELETE /identity/v3/projects/592b67adb359400c964b7c05beb298b1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:45.402163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:45.403817 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:45.475462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa0e79-683d-412e-99e0-8545d10472f4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:45.485360 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307b8b3-c4ff-4651-983e-957a11004e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:45.486127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b8b3-c4ff-4651-983e-957a11004e35 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:45.486305 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b8b3-c4ff-4651-983e-957a11004e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:45.486584 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b8b3-c4ff-4651-983e-957a11004e35 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:45.490856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307b8b3-c4ff-4651-983e-957a11004e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:45.490856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307b8b3-c4ff-4651-983e-957a11004e35 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:45.503890 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fa003-7ae2-4a45-9818-149960f338b2 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:45.514273 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40014a-f102-4b9a-916e-5b5d39cf13eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:45.515457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40014a-f102-4b9a-916e-5b5d39cf13eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:45.515673 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40014a-f102-4b9a-916e-5b5d39cf13eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:45.516735 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40014a-f102-4b9a-916e-5b5d39cf13eb admin admin] PATH_INFO: `/v3/users/ffc71391c3a44746be0497f4d312934f` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:45.517415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40014a-f102-4b9a-916e-5b5d39cf13eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc71391c3a44746be0497f4d312934f)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:45.519935 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40014a-f102-4b9a-916e-5b5d39cf13eb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:45.525065 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1067/2137] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:45 2021] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:45.529133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307b8b3-c4ff-4651-983e-957a11004e35 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:45.531116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d307b8b3-c4ff-4651-983e-957a11004e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:45.547848 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307b8b3-c4ff-4651-983e-957a11004e35 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:45.553161 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8a3cf-0a67-478e-85e6-df97eb13d3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:45.553857 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8a3cf-0a67-478e-85e6-df97eb13d3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:45.554156 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8a3cf-0a67-478e-85e6-df97eb13d3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:45.554437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8a3cf-0a67-478e-85e6-df97eb13d3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:45.555825 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8a3cf-0a67-478e-85e6-df97eb13d3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:45.557508 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8a3cf-0a67-478e-85e6-df97eb13d3d6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:45.567836 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1068/2138] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:45 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:45.572384 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8a3cf-0a67-478e-85e6-df97eb13d3d6 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:45.580619 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4d40014a-f102-4b9a-916e-5b5d39cf13eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc71391c3a44746be0497f4d312934f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:45.582421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8a3cf-0a67-478e-85e6-df97eb13d3d6 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:45.588048 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee169f5-9ed0-4351-ab73-6ad9fef42582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:45.588695 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4d40014a-f102-4b9a-916e-5b5d39cf13eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc71391c3a44746be0497f4d312934f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:45.588843 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee169f5-9ed0-4351-ab73-6ad9fef42582 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:45.590502 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee169f5-9ed0-4351-ab73-6ad9fef42582 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:45.590502 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee169f5-9ed0-4351-ab73-6ad9fef42582 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:45.590502 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee169f5-9ed0-4351-ab73-6ad9fef42582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:45.591593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee169f5-9ed0-4351-ab73-6ad9fef42582 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:45.598717 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4d40014a-f102-4b9a-916e-5b5d39cf13eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc71391c3a44746be0497f4d312934f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:45.604786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1069/2139] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:45 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:33:45.608538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cb2ff-9977-4b90-8baa-7797cf476fbd None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:45.608906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cb2ff-9977-4b90-8baa-7797cf476fbd None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:45.609195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cb2ff-9977-4b90-8baa-7797cf476fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:45.615142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4d40014a-f102-4b9a-916e-5b5d39cf13eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc71391c3a44746be0497f4d312934f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:45.615853 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4d40014a-f102-4b9a-916e-5b5d39cf13eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc71391c3a44746be0497f4d312934f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:45.621740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1071/2140] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:33:45 2021] DELETE /identity/v3/users/ffc71391c3a44746be0497f4d312934f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:45.622508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40014a-f102-4b9a-916e-5b5d39cf13eb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:45.624016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4d40014a-f102-4b9a-916e-5b5d39cf13eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:45.627128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-f89cb2ff-9977-4b90-8baa-7797cf476fbd None None] MFA Rules not processed for user `f6af4c462c6347ff8abbcc8770874b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:45.628302 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-f89cb2ff-9977-4b90-8baa-7797cf476fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:45.688288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1070/2141] 10.222.0.50 () {58 vars in 967 bytes} [Tue Nov 16 00:33:45 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:45.709470 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cb2ff-9977-4b90-8baa-7797cf476fbd None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:45.711610 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40014a-f102-4b9a-916e-5b5d39cf13eb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:45.712206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-f89cb2ff-9977-4b90-8baa-7797cf476fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:45.725034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0675d56-aa3e-4d1d-962c-b61ef004b015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:45.726158 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0675d56-aa3e-4d1d-962c-b61ef004b015 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:45.727282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0675d56-aa3e-4d1d-962c-b61ef004b015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:45.727729 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0675d56-aa3e-4d1d-962c-b61ef004b015 admin admin] PATH_INFO: `/v3/projects/0b104c1990f346579622eba783ccee45/users/55407d5ba3e34e109ec0a4b90f942a28/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:45.763796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0675d56-aa3e-4d1d-962c-b61ef004b015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b104c1990f346579622eba783ccee45, user_id=55407d5ba3e34e109ec0a4b90f942a28, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:45.767649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0675d56-aa3e-4d1d-962c-b61ef004b015 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:45.795728 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1072/2142] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:45 2021] PUT /identity/v3/projects/0b104c1990f346579622eba783ccee45/users/55407d5ba3e34e109ec0a4b90f942a28/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:45.798543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5ea3-30e5-43c5-a611-44c7e35bbd2c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:45.798869 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5ea3-30e5-43c5-a611-44c7e35bbd2c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:45.799255 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5ea3-30e5-43c5-a611-44c7e35bbd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:45.811547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cb2ff-9977-4b90-8baa-7797cf476fbd None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:45.841838 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-da7f5ea3-30e5-43c5-a611-44c7e35bbd2c None None] MFA Rules not processed for user `55407d5ba3e34e109ec0a4b90f942a28`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:45.843103 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-da7f5ea3-30e5-43c5-a611-44c7e35bbd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:45.887973 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93762e-187e-4d98-b488-7a0c1d15fc61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac32c6730654a889472a3bad95374bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:45.888800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93762e-187e-4d98-b488-7a0c1d15fc61 service swift] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:45.888800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93762e-187e-4d98-b488-7a0c1d15fc61 service swift] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:45.888987 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93762e-187e-4d98-b488-7a0c1d15fc61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:45.914068 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1073/2143] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:45 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:45.919022 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f5ea3-30e5-43c5-a611-44c7e35bbd2c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:45.976079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93762e-187e-4d98-b488-7a0c1d15fc61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:45.977985 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93762e-187e-4d98-b488-7a0c1d15fc61 service swift] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:45.995648 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1071/2144] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Nov 16 00:33:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 00:33:45.996708 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93762e-187e-4d98-b488-7a0c1d15fc61 service swift] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:45.998538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-db93762e-187e-4d98-b488-7a0c1d15fc61 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:46.016952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f5ea3-30e5-43c5-a611-44c7e35bbd2c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:46.021783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566b58-f88a-4a3b-9efb-dfa0ebbc3def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:46.022451 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566b58-f88a-4a3b-9efb-dfa0ebbc3def admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.022743 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566b58-f88a-4a3b-9efb-dfa0ebbc3def admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.023096 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566b58-f88a-4a3b-9efb-dfa0ebbc3def admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.024954 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4566b58-f88a-4a3b-9efb-dfa0ebbc3def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:46.027070 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4566b58-f88a-4a3b-9efb-dfa0ebbc3def admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:46.072018 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1074/2145] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:45 2021] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:46.077172 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566b58-f88a-4a3b-9efb-dfa0ebbc3def admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:46.091468 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93762e-187e-4d98-b488-7a0c1d15fc61 service swift] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:46.160505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566b58-f88a-4a3b-9efb-dfa0ebbc3def admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:46.165879 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbee7b-d123-49d3-98fa-968b6a0868f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:46.166761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbee7b-d123-49d3-98fa-968b6a0868f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.167157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbee7b-d123-49d3-98fa-968b6a0868f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.167448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbee7b-d123-49d3-98fa-968b6a0868f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.168344 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbee7b-d123-49d3-98fa-968b6a0868f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:46.171193 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbee7b-d123-49d3-98fa-968b6a0868f9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:46.171320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7ed13-8a46-4a34-a673-6c5e9a056654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:46.172233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7ed13-8a46-4a34-a673-6c5e9a056654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.172687 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7ed13-8a46-4a34-a673-6c5e9a056654 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.173113 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7ed13-8a46-4a34-a673-6c5e9a056654 admin admin] PATH_INFO: `/v3/projects/86ec5adad7a94be0986db4687a343ce7` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.174541 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7ed13-8a46-4a34-a673-6c5e9a056654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ec5adad7a94be0986db4687a343ce7)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:46.176507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7ed13-8a46-4a34-a673-6c5e9a056654 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:46.203740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1075/2146] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:46 2021] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:33:46.212707 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbee7b-d123-49d3-98fa-968b6a0868f9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:46.230968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbee7b-d123-49d3-98fa-968b6a0868f9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:46.255679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-48a7ed13-8a46-4a34-a673-6c5e9a056654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ec5adad7a94be0986db4687a343ce7', 'request_id': 'req-48a7ed13-8a46-4a34-a673-6c5e9a056654'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:46.264247 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-48a7ed13-8a46-4a34-a673-6c5e9a056654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ec5adad7a94be0986db4687a343ce7', 'request_id': 'req-48a7ed13-8a46-4a34-a673-6c5e9a056654'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:46.271600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-48a7ed13-8a46-4a34-a673-6c5e9a056654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ec5adad7a94be0986db4687a343ce7', 'request_id': 'req-48a7ed13-8a46-4a34-a673-6c5e9a056654'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:46.286949 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-48a7ed13-8a46-4a34-a673-6c5e9a056654 admin admin] The token cache is being invalidate because project 86ec5adad7a94be0986db4687a343ce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:33:46.287239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-48a7ed13-8a46-4a34-a673-6c5e9a056654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:46.288277 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-48a7ed13-8a46-4a34-a673-6c5e9a056654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:33:46.290762 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1072/2147] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:33:45 2021] DELETE /identity/v3/projects/86ec5adad7a94be0986db4687a343ce7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:46.292454 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df42714-e758-4ec7-ac84-acb79bc667df None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.292974 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df42714-e758-4ec7-ac84-acb79bc667df None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.293496 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df42714-e758-4ec7-ac84-acb79bc667df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.309189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a427de-96c2-4c34-af84-432026cbf556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:46.309871 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a427de-96c2-4c34-af84-432026cbf556 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.310152 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a427de-96c2-4c34-af84-432026cbf556 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.310460 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a427de-96c2-4c34-af84-432026cbf556 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.311229 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a427de-96c2-4c34-af84-432026cbf556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:46.312856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a427de-96c2-4c34-af84-432026cbf556 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:46.314203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-9df42714-e758-4ec7-ac84-acb79bc667df None None] MFA Rules not processed for user `f6af4c462c6347ff8abbcc8770874b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:46.315679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9df42714-e758-4ec7-ac84-acb79bc667df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:46.330512 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1076/2148] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:46 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:46.332204 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825e5c0-8460-423e-884c-c85b49d26d23 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.332498 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825e5c0-8460-423e-884c-c85b49d26d23 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.332775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825e5c0-8460-423e-884c-c85b49d26d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.354708 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7825e5c0-8460-423e-884c-c85b49d26d23 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:46.356560 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7825e5c0-8460-423e-884c-c85b49d26d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:46.368842 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1077/2149] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:46.371999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825e5c0-8460-423e-884c-c85b49d26d23 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:46.380007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7825e5c0-8460-423e-884c-c85b49d26d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:46.391661 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1073/2150] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Nov 16 00:33:46 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:46.392982 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825e5c0-8460-423e-884c-c85b49d26d23 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:46.393786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57baf6-442d-4eae-bd2a-9377b6074fa2 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.394232 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57baf6-442d-4eae-bd2a-9377b6074fa2 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.394659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57baf6-442d-4eae-bd2a-9377b6074fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.405965 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62489976-5c48-4925-8996-416029f9186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:46.406654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62489976-5c48-4925-8996-416029f9186a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.406975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62489976-5c48-4925-8996-416029f9186a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.407258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62489976-5c48-4925-8996-416029f9186a admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.407993 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62489976-5c48-4925-8996-416029f9186a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:46.409624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62489976-5c48-4925-8996-416029f9186a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:46.416697 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-8c57baf6-442d-4eae-bd2a-9377b6074fa2 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:46.418196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8c57baf6-442d-4eae-bd2a-9377b6074fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:46.420832 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1078/2151] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:46 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:46.424619 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62489976-5c48-4925-8996-416029f9186a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:46.427456 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-62489976-5c48-4925-8996-416029f9186a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:46.437865 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1074/2152] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:46.438805 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57baf6-442d-4eae-bd2a-9377b6074fa2 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:46.453267 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57baf6-442d-4eae-bd2a-9377b6074fa2 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:46.458412 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7106122-f8ed-4230-819d-5f658fafba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:46.459356 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7106122-f8ed-4230-819d-5f658fafba45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.459736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7106122-f8ed-4230-819d-5f658fafba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.459908 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7106122-f8ed-4230-819d-5f658fafba45 admin admin] PATH_INFO: `/v3/projects/a99adc71fb844b4d98af9e0ca8b7e0b6/users/e39fa447cb7e4514b4ad5dcc6391f7b8/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.477761 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7106122-f8ed-4230-819d-5f658fafba45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99adc71fb844b4d98af9e0ca8b7e0b6, user_id=e39fa447cb7e4514b4ad5dcc6391f7b8, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:46.480609 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7106122-f8ed-4230-819d-5f658fafba45 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:46.509683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1075/2153] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:46 2021] PUT /identity/v3/projects/a99adc71fb844b4d98af9e0ca8b7e0b6/users/e39fa447cb7e4514b4ad5dcc6391f7b8/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:46.510561 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7106122-f8ed-4230-819d-5f658fafba45 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:46.535318 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62489976-5c48-4925-8996-416029f9186a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:46.607329 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7106122-f8ed-4230-819d-5f658fafba45 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:46.613528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043865d-cddc-4a45-83e9-4059f6fb6d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:46.614322 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043865d-cddc-4a45-83e9-4059f6fb6d33 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.614626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043865d-cddc-4a45-83e9-4059f6fb6d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.614943 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043865d-cddc-4a45-83e9-4059f6fb6d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.615766 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043865d-cddc-4a45-83e9-4059f6fb6d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:33:46.616804 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043865d-cddc-4a45-83e9-4059f6fb6d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:46.619160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043865d-cddc-4a45-83e9-4059f6fb6d33 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:46.631646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8191aa7-c02d-4a5a-9910-4ac6b330a22c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac32c6730654a889472a3bad95374bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:46.633222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8191aa7-c02d-4a5a-9910-4ac6b330a22c service swift] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.633818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1076/2154] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:33:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:33:46.634253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8191aa7-c02d-4a5a-9910-4ac6b330a22c service swift] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.634755 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8191aa7-c02d-4a5a-9910-4ac6b330a22c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.635061 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73ea31-c685-47b0-b51d-1cf1cdbbb9fd None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.635361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73ea31-c685-47b0-b51d-1cf1cdbbb9fd None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.635642 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73ea31-c685-47b0-b51d-1cf1cdbbb9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.668677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-9b73ea31-c685-47b0-b51d-1cf1cdbbb9fd None None] MFA Rules not processed for user `e39fa447cb7e4514b4ad5dcc6391f7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:46.669429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9b73ea31-c685-47b0-b51d-1cf1cdbbb9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:46.704291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8191aa7-c02d-4a5a-9910-4ac6b330a22c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:46.705905 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8191aa7-c02d-4a5a-9910-4ac6b330a22c service swift] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:46.715460 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1079/2155] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Nov 16 00:33:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 00:33:46.716610 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8191aa7-c02d-4a5a-9910-4ac6b330a22c service swift] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:46.727966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8191aa7-c02d-4a5a-9910-4ac6b330a22c service swift] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:46.734424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a73cd8-5805-4bf3-a017-66c9baa3f876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:46.735295 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a73cd8-5805-4bf3-a017-66c9baa3f876 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.735587 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a73cd8-5805-4bf3-a017-66c9baa3f876 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.735873 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a73cd8-5805-4bf3-a017-66c9baa3f876 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.736614 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a73cd8-5805-4bf3-a017-66c9baa3f876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:46.738570 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a73cd8-5805-4bf3-a017-66c9baa3f876 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:46.746424 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1077/2156] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:46 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:46.751809 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73ea31-c685-47b0-b51d-1cf1cdbbb9fd None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:46.767697 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73ea31-c685-47b0-b51d-1cf1cdbbb9fd None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:46.775842 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1080/2157] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:46 2021] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:46.776028 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4bac2-0ec3-4045-b090-e549a56ad2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:46.776028 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4bac2-0ec3-4045-b090-e549a56ad2bb admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.776028 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4bac2-0ec3-4045-b090-e549a56ad2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.776028 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4bac2-0ec3-4045-b090-e549a56ad2bb admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.776352 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4bac2-0ec3-4045-b090-e549a56ad2bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:46.777625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a73cd8-5805-4bf3-a017-66c9baa3f876 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:46.780689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4bac2-0ec3-4045-b090-e549a56ad2bb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:46.842371 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1078/2158] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:33:46 2021] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:46.844058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4bac2-0ec3-4045-b090-e549a56ad2bb admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:46.910324 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a73cd8-5805-4bf3-a017-66c9baa3f876 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:46.928154 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4bac2-0ec3-4045-b090-e549a56ad2bb admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:46.933400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0f867-5620-4dc4-a489-5392d635dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:46.934087 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f867-5620-4dc4-a489-5392d635dd59 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.934381 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f867-5620-4dc4-a489-5392d635dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.934738 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f867-5620-4dc4-a489-5392d635dd59 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.935486 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0f867-5620-4dc4-a489-5392d635dd59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:46.937442 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0f867-5620-4dc4-a489-5392d635dd59 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:46.963301 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1079/2159] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:46 2021] POST /identity/v3/users => generated 296 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:33:46.964880 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0f867-5620-4dc4-a489-5392d635dd59 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:46.976459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0f867-5620-4dc4-a489-5392d635dd59 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:46.981654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab6f83-60dc-4a2f-89c9-8f5e1dd5b2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:46.982390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab6f83-60dc-4a2f-89c9-8f5e1dd5b2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.982745 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab6f83-60dc-4a2f-89c9-8f5e1dd5b2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.983059 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab6f83-60dc-4a2f-89c9-8f5e1dd5b2a7 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.983756 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab6f83-60dc-4a2f-89c9-8f5e1dd5b2a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:46.985588 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbf7f6-e141-4271-9578-e9adebd1683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:46.985903 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab6f83-60dc-4a2f-89c9-8f5e1dd5b2a7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:46.986281 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbf7f6-e141-4271-9578-e9adebd1683d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:46.986575 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbf7f6-e141-4271-9578-e9adebd1683d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:46.986881 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbf7f6-e141-4271-9578-e9adebd1683d admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:46.987659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbf7f6-e141-4271-9578-e9adebd1683d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:46.989262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbf7f6-e141-4271-9578-e9adebd1683d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:47.001385 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1080/2160] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:46 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:33:47.005765 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbf7f6-e141-4271-9578-e9adebd1683d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:47.008979 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1081/2161] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:33:46 2021] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:33:47.018925 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab6f83-60dc-4a2f-89c9-8f5e1dd5b2a7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:47.022412 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbf7f6-e141-4271-9578-e9adebd1683d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:47.027583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf929c-8f0e-48f1-b39d-4b3128888912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:47.028552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf929c-8f0e-48f1-b39d-4b3128888912 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:47.028914 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf929c-8f0e-48f1-b39d-4b3128888912 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:47.029269 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf929c-8f0e-48f1-b39d-4b3128888912 admin admin] PATH_INFO: `/v3/projects/a82eb58d635640ae878e2eb0da06e151/users/361943dd3efd434081058e4f9dd48af4/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:47.029369 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab6f83-60dc-4a2f-89c9-8f5e1dd5b2a7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:47.034995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac69ef6-343e-4340-8db0-2c9c798e023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:47.035654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac69ef6-343e-4340-8db0-2c9c798e023c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:47.035942 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac69ef6-343e-4340-8db0-2c9c798e023c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:47.036224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac69ef6-343e-4340-8db0-2c9c798e023c admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:47.036948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac69ef6-343e-4340-8db0-2c9c798e023c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:47.038557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac69ef6-343e-4340-8db0-2c9c798e023c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:47.047781 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf929c-8f0e-48f1-b39d-4b3128888912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a82eb58d635640ae878e2eb0da06e151, user_id=361943dd3efd434081058e4f9dd48af4, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:47.052038 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1082/2162] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:47.052180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf929c-8f0e-48f1-b39d-4b3128888912 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:47.052871 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac69ef6-343e-4340-8db0-2c9c798e023c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:47.064838 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac69ef6-343e-4340-8db0-2c9c798e023c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:47.068588 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1081/2163] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:47 2021] PUT /identity/v3/projects/a82eb58d635640ae878e2eb0da06e151/users/361943dd3efd434081058e4f9dd48af4/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:47.075042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf929c-8f0e-48f1-b39d-4b3128888912 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:47.136454 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a83e6b-dd42-4654-9dde-93718990af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:47.137133 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a83e6b-dd42-4654-9dde-93718990af20 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:47.137420 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a83e6b-dd42-4654-9dde-93718990af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:47.137757 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a83e6b-dd42-4654-9dde-93718990af20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:47.138421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a83e6b-dd42-4654-9dde-93718990af20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:47.140054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a83e6b-dd42-4654-9dde-93718990af20 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:47.140163 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf929c-8f0e-48f1-b39d-4b3128888912 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:47.144784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc441796-2666-4ca2-974a-542d6686ef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:47.145448 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc441796-2666-4ca2-974a-542d6686ef68 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:47.145740 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc441796-2666-4ca2-974a-542d6686ef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:47.146018 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc441796-2666-4ca2-974a-542d6686ef68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:47.146741 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc441796-2666-4ca2-974a-542d6686ef68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:47.148958 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc441796-2666-4ca2-974a-542d6686ef68 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:47.150523 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1083/2164] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:47 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:33:47.151871 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc0a47-ec4c-400d-a33e-85b72cf90dbe None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:47.152240 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc0a47-ec4c-400d-a33e-85b72cf90dbe None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:47.152457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc0a47-ec4c-400d-a33e-85b72cf90dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:47.161980 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1082/2165] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:33:47 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:33:47.161980 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc441796-2666-4ca2-974a-542d6686ef68 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:47.170287 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc441796-2666-4ca2-974a-542d6686ef68 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:47.170860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-90dc0a47-ec4c-400d-a33e-85b72cf90dbe None None] MFA Rules not processed for user `f6af4c462c6347ff8abbcc8770874b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:47.172275 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-90dc0a47-ec4c-400d-a33e-85b72cf90dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:47.175088 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b09da-b7b5-4dd2-b6c3-beadec8e1957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:47.175993 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b09da-b7b5-4dd2-b6c3-beadec8e1957 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:47.176282 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b09da-b7b5-4dd2-b6c3-beadec8e1957 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:47.176562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b09da-b7b5-4dd2-b6c3-beadec8e1957 admin admin] PATH_INFO: `/v3/projects/8acc9a0774784312ae690cea7ea7a0da/users/79dcae6d1b1048569f7195f5cb0446e3/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:47.191198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b09da-b7b5-4dd2-b6c3-beadec8e1957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8acc9a0774784312ae690cea7ea7a0da, user_id=79dcae6d1b1048569f7195f5cb0446e3, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:47.193854 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b09da-b7b5-4dd2-b6c3-beadec8e1957 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:47.206429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1083/2166] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:47 2021] PUT /identity/v3/projects/8acc9a0774784312ae690cea7ea7a0da/users/79dcae6d1b1048569f7195f5cb0446e3/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:47.207379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b09da-b7b5-4dd2-b6c3-beadec8e1957 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:47.232087 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1084/2167] 10.222.0.50 () {58 vars in 967 bytes} [Tue Nov 16 00:33:47 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:47.233490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a990c0-ef4d-427f-b738-e99f1b4b0f30 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:47.233950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a990c0-ef4d-427f-b738-e99f1b4b0f30 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:47.234244 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a990c0-ef4d-427f-b738-e99f1b4b0f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:47.260197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-07a990c0-ef4d-427f-b738-e99f1b4b0f30 None None] MFA Rules not processed for user `79dcae6d1b1048569f7195f5cb0446e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:47.261418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-07a990c0-ef4d-427f-b738-e99f1b4b0f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:47.268787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b09da-b7b5-4dd2-b6c3-beadec8e1957 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:47.274256 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08800f13-10cc-4534-acd8-2d7f4347b9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:47.275207 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08800f13-10cc-4534-acd8-2d7f4347b9ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:47.275494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08800f13-10cc-4534-acd8-2d7f4347b9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:47.275802 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08800f13-10cc-4534-acd8-2d7f4347b9ab admin admin] PATH_INFO: `/v3/projects/a82eb58d635640ae878e2eb0da06e151/users/361943dd3efd434081058e4f9dd48af4/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:47.277814 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08800f13-10cc-4534-acd8-2d7f4347b9ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a82eb58d635640ae878e2eb0da06e151, user_id=361943dd3efd434081058e4f9dd48af4, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:47.280545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08800f13-10cc-4534-acd8-2d7f4347b9ab admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:47.291432 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1084/2168] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:33:47 2021] PUT /identity/v3/projects/a82eb58d635640ae878e2eb0da06e151/users/361943dd3efd434081058e4f9dd48af4/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:33:47.292230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08800f13-10cc-4534-acd8-2d7f4347b9ab admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:47.324931 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1085/2169] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:47 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:47.328476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7c30e-9703-482b-a1d0-ffd3ef677bce None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:47.328476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7c30e-9703-482b-a1d0-ffd3ef677bce None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:47.328476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7c30e-9703-482b-a1d0-ffd3ef677bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:47.355030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-c7d7c30e-9703-482b-a1d0-ffd3ef677bce None None] MFA Rules not processed for user `361943dd3efd434081058e4f9dd48af4`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:33:47.356271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-c7d7c30e-9703-482b-a1d0-ffd3ef677bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:47.362514 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08800f13-10cc-4534-acd8-2d7f4347b9ab admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:47.368138 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e94841-7475-455a-b326-5487f59adff5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac32c6730654a889472a3bad95374bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:47.368787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e94841-7475-455a-b326-5487f59adff5 service swift] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:47.369074 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e94841-7475-455a-b326-5487f59adff5 service swift] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:47.369355 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e94841-7475-455a-b326-5487f59adff5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:47.425097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e94841-7475-455a-b326-5487f59adff5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:47.427603 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e94841-7475-455a-b326-5487f59adff5 service swift] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:47.429182 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1086/2170] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:33:47 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:33:47.429182 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7c30e-9703-482b-a1d0-ffd3ef677bce None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:47.429182 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-c7d7c30e-9703-482b-a1d0-ffd3ef677bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:47.438305 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1085/2171] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Nov 16 00:33:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 00:33:47.440252 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e94841-7475-455a-b326-5487f59adff5 service swift] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:47.441783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-92e94841-7475-455a-b326-5487f59adff5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:47.491834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7c30e-9703-482b-a1d0-ffd3ef677bce None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:47.495472 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432e440-50b3-4cbc-ae2f-1d6fb24ee166 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cab78404d3c4980a4b99da09edab426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:47.496140 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432e440-50b3-4cbc-ae2f-1d6fb24ee166 service glance] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:47.496846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432e440-50b3-4cbc-ae2f-1d6fb24ee166 service glance] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:47.496846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432e440-50b3-4cbc-ae2f-1d6fb24ee166 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:47.500237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e94841-7475-455a-b326-5487f59adff5 service swift] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:47.506112 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5248-1420-4e33-8e2f-e20693d63c64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:47.506906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5248-1420-4e33-8e2f-e20693d63c64 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:47.507238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5248-1420-4e33-8e2f-e20693d63c64 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:47.508050 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5248-1420-4e33-8e2f-e20693d63c64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:47.518052 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a5248-1420-4e33-8e2f-e20693d63c64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:47.519537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a5248-1420-4e33-8e2f-e20693d63c64 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:47.530761 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1086/2172] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:47 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:33:47.557352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432e440-50b3-4cbc-ae2f-1d6fb24ee166 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:47.558879 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432e440-50b3-4cbc-ae2f-1d6fb24ee166 service glance] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:47.569285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1087/2173] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:47 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:33:47.574465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5248-1420-4e33-8e2f-e20693d63c64 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:33:47.576085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3f8a5248-1420-4e33-8e2f-e20693d63c64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:47.588196 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5248-1420-4e33-8e2f-e20693d63c64 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:33:47.592085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9005e2-14ee-4935-a1b2-1cdc2c25aee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:33:47.592792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9005e2-14ee-4935-a1b2-1cdc2c25aee0 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:33:47.593072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9005e2-14ee-4935-a1b2-1cdc2c25aee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:33:47.593350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9005e2-14ee-4935-a1b2-1cdc2c25aee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:33:47.595304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9e9005e2-14ee-4935-a1b2-1cdc2c25aee0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:33:47.671860 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9005e2-14ee-4935-a1b2-1cdc2c25aee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:33:47.673406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9005e2-14ee-4935-a1b2-1cdc2c25aee0 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:33:47.682999 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1087/2174] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:33:47 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:02.572226 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432e440-50b3-4cbc-ae2f-1d6fb24ee166 service glance] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:02.574225 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8432e440-50b3-4cbc-ae2f-1d6fb24ee166 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:02.638515 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432e440-50b3-4cbc-ae2f-1d6fb24ee166 service glance] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:02.643058 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d58a6-cca0-44dd-9d03-d15551a2f366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:02.643915 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d58a6-cca0-44dd-9d03-d15551a2f366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:02.644198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d58a6-cca0-44dd-9d03-d15551a2f366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:02.644500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d58a6-cca0-44dd-9d03-d15551a2f366 admin admin] PATH_INFO: `/v3/users/2a11b68cbc0e410dab2a5630f95b9802` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:02.645671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d58a6-cca0-44dd-9d03-d15551a2f366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a11b68cbc0e410dab2a5630f95b9802)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:02.647624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d58a6-cca0-44dd-9d03-d15551a2f366 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:02.693489 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f42d58a6-cca0-44dd-9d03-d15551a2f366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a11b68cbc0e410dab2a5630f95b9802'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:02.701013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f42d58a6-cca0-44dd-9d03-d15551a2f366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a11b68cbc0e410dab2a5630f95b9802'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:02.708444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f42d58a6-cca0-44dd-9d03-d15551a2f366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a11b68cbc0e410dab2a5630f95b9802'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:02.720830 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f42d58a6-cca0-44dd-9d03-d15551a2f366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a11b68cbc0e410dab2a5630f95b9802'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:02.721500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f42d58a6-cca0-44dd-9d03-d15551a2f366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a11b68cbc0e410dab2a5630f95b9802'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:02.727577 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1088/2175] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:34:02 2021] DELETE /identity/v3/users/2a11b68cbc0e410dab2a5630f95b9802 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:02.732843 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4190884-255c-4fe7-b9f6-8f78b78d1a61 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:02.733361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4190884-255c-4fe7-b9f6-8f78b78d1a61 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:02.733472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4190884-255c-4fe7-b9f6-8f78b78d1a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:02.752114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-a4190884-255c-4fe7-b9f6-8f78b78d1a61 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:02.753720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a4190884-255c-4fe7-b9f6-8f78b78d1a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:02.815010 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1088/2176] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:02.825595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d58a6-cca0-44dd-9d03-d15551a2f366 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:02.826751 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f42d58a6-cca0-44dd-9d03-d15551a2f366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:02.885082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d58a6-cca0-44dd-9d03-d15551a2f366 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:02.888943 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277069e-5622-4a35-93f5-b87950b67012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:02.889529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277069e-5622-4a35-93f5-b87950b67012 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:02.889811 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277069e-5622-4a35-93f5-b87950b67012 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:02.890084 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277069e-5622-4a35-93f5-b87950b67012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:02.899290 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277069e-5622-4a35-93f5-b87950b67012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:02.900799 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277069e-5622-4a35-93f5-b87950b67012 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:02.911603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1089/2177] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:03.081009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4190884-255c-4fe7-b9f6-8f78b78d1a61 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:03.082671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a4190884-255c-4fe7-b9f6-8f78b78d1a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:03.102342 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4190884-255c-4fe7-b9f6-8f78b78d1a61 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:03.107786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df585a-8e8a-47e0-89d1-fb98644af8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:03.108842 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df585a-8e8a-47e0-89d1-fb98644af8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:03.109205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df585a-8e8a-47e0-89d1-fb98644af8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:03.109573 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df585a-8e8a-47e0-89d1-fb98644af8b4 admin admin] PATH_INFO: `/v3/projects/148b1eb8db104096ae5c8041e2945bae` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:03.110978 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df585a-8e8a-47e0-89d1-fb98644af8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=148b1eb8db104096ae5c8041e2945bae)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:03.113063 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df585a-8e8a-47e0-89d1-fb98644af8b4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:03.164426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-04df585a-8e8a-47e0-89d1-fb98644af8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '148b1eb8db104096ae5c8041e2945bae', 'request_id': 'req-04df585a-8e8a-47e0-89d1-fb98644af8b4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:03.169699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-04df585a-8e8a-47e0-89d1-fb98644af8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '148b1eb8db104096ae5c8041e2945bae', 'request_id': 'req-04df585a-8e8a-47e0-89d1-fb98644af8b4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:03.175764 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-04df585a-8e8a-47e0-89d1-fb98644af8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '148b1eb8db104096ae5c8041e2945bae', 'request_id': 'req-04df585a-8e8a-47e0-89d1-fb98644af8b4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:03.191948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-04df585a-8e8a-47e0-89d1-fb98644af8b4 admin admin] The token cache is being invalidate because project 148b1eb8db104096ae5c8041e2945bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:34:03.192385 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-04df585a-8e8a-47e0-89d1-fb98644af8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:03.193144 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-04df585a-8e8a-47e0-89d1-fb98644af8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:03.195079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1089/2178] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:34:03 2021] DELETE /identity/v3/projects/148b1eb8db104096ae5c8041e2945bae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:03.203335 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd31a5-f37a-41a9-b395-f0fca6836474 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:03.203756 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd31a5-f37a-41a9-b395-f0fca6836474 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:03.204039 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd31a5-f37a-41a9-b395-f0fca6836474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:03.228001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-6afd31a5-f37a-41a9-b395-f0fca6836474 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:03.229388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6afd31a5-f37a-41a9-b395-f0fca6836474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:03.311236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1090/2179] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:03.325999 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab242212-e6ef-4820-b414-d74c82e37b43 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:03.327097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab242212-e6ef-4820-b414-d74c82e37b43 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:03.328277 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab242212-e6ef-4820-b414-d74c82e37b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:03.368441 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-ab242212-e6ef-4820-b414-d74c82e37b43 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:03.369735 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ab242212-e6ef-4820-b414-d74c82e37b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:03.383902 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1090/2180] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:34:03.385134 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd31a5-f37a-41a9-b395-f0fca6836474 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:03.395955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd31a5-f37a-41a9-b395-f0fca6836474 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:03.402830 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923a989-be85-4cdb-a0f6-fe8973442fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:03.403587 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923a989-be85-4cdb-a0f6-fe8973442fbb admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:03.404260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923a989-be85-4cdb-a0f6-fe8973442fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:03.404260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923a989-be85-4cdb-a0f6-fe8973442fbb admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:03.404938 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923a989-be85-4cdb-a0f6-fe8973442fbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:34:03.405434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923a989-be85-4cdb-a0f6-fe8973442fbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:03.407351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923a989-be85-4cdb-a0f6-fe8973442fbb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:03.420921 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1091/2181] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:34:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:34:03.425323 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab242212-e6ef-4820-b414-d74c82e37b43 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:03.436167 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab242212-e6ef-4820-b414-d74c82e37b43 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:03.441064 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caa395-ae22-487a-93b9-754a9da94742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:03.441787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caa395-ae22-487a-93b9-754a9da94742 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:03.442070 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caa395-ae22-487a-93b9-754a9da94742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:03.442340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caa395-ae22-487a-93b9-754a9da94742 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:03.443122 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5caa395-ae22-487a-93b9-754a9da94742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:03.445014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5caa395-ae22-487a-93b9-754a9da94742 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:03.473180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1091/2182] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:34:03 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:03.477684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923a989-be85-4cdb-a0f6-fe8973442fbb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:03.488565 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923a989-be85-4cdb-a0f6-fe8973442fbb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:03.546478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fd35f-85df-4de5-952d-3e1d0a6d6c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:03.547203 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fd35f-85df-4de5-952d-3e1d0a6d6c6a admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:03.547527 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fd35f-85df-4de5-952d-3e1d0a6d6c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:03.547783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fd35f-85df-4de5-952d-3e1d0a6d6c6a admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:03.548474 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fd35f-85df-4de5-952d-3e1d0a6d6c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:03.550759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fd35f-85df-4de5-952d-3e1d0a6d6c6a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:03.583529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1092/2183] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:34:03 2021] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:34:03.587627 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caa395-ae22-487a-93b9-754a9da94742 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:03.604983 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caa395-ae22-487a-93b9-754a9da94742 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:03.621503 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0a292-1a61-415c-8491-59273843ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:03.622186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0a292-1a61-415c-8491-59273843ff62 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:03.622615 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0a292-1a61-415c-8491-59273843ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:03.622927 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0a292-1a61-415c-8491-59273843ff62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:03.623800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0a292-1a61-415c-8491-59273843ff62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:03.625562 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0a292-1a61-415c-8491-59273843ff62 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:03.651531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1092/2184] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:03 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:03.652641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fd35f-85df-4de5-952d-3e1d0a6d6c6a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:03.668908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fd35f-85df-4de5-952d-3e1d0a6d6c6a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:03.673801 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37b5d3-66d7-4409-8c58-fb706875f735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:03.674475 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37b5d3-66d7-4409-8c58-fb706875f735 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:03.674764 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37b5d3-66d7-4409-8c58-fb706875f735 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:03.675080 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37b5d3-66d7-4409-8c58-fb706875f735 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:03.675860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37b5d3-66d7-4409-8c58-fb706875f735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:03.677500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37b5d3-66d7-4409-8c58-fb706875f735 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:03.689303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1093/2185] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:03 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:03.693649 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0a292-1a61-415c-8491-59273843ff62 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:03.704352 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0a292-1a61-415c-8491-59273843ff62 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:03.709013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74808de-7ac3-4af9-b5f6-ff9c0f967ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:03.709890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74808de-7ac3-4af9-b5f6-ff9c0f967ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:03.710177 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74808de-7ac3-4af9-b5f6-ff9c0f967ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:03.710454 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74808de-7ac3-4af9-b5f6-ff9c0f967ba1 admin admin] PATH_INFO: `/v3/projects/83520f3a79ea4f8c9593aac314d7db4d/users/1cfb6806de1c4f79bf7dd4aaf8b71aa7/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:03.725824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74808de-7ac3-4af9-b5f6-ff9c0f967ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83520f3a79ea4f8c9593aac314d7db4d, user_id=1cfb6806de1c4f79bf7dd4aaf8b71aa7, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:03.728509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74808de-7ac3-4af9-b5f6-ff9c0f967ba1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:03.740819 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1093/2186] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:03 2021] PUT /identity/v3/projects/83520f3a79ea4f8c9593aac314d7db4d/users/1cfb6806de1c4f79bf7dd4aaf8b71aa7/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:03.746588 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047e7ad-5161-49d2-9b02-0c81e18bdc1b None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:03.747028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047e7ad-5161-49d2-9b02-0c81e18bdc1b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:03.747288 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047e7ad-5161-49d2-9b02-0c81e18bdc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:03.765979 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7047e7ad-5161-49d2-9b02-0c81e18bdc1b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:03.767224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7047e7ad-5161-49d2-9b02-0c81e18bdc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:03.823856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1094/2187] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:34:03.833787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74808de-7ac3-4af9-b5f6-ff9c0f967ba1 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:03.835710 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c74808de-7ac3-4af9-b5f6-ff9c0f967ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:03.917193 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74808de-7ac3-4af9-b5f6-ff9c0f967ba1 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:03.928735 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8ebab-3dd7-4ed6-9f2a-8b1dac1fc3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:03.929406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8ebab-3dd7-4ed6-9f2a-8b1dac1fc3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:03.929688 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8ebab-3dd7-4ed6-9f2a-8b1dac1fc3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:03.929965 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8ebab-3dd7-4ed6-9f2a-8b1dac1fc3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:03.941090 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8ebab-3dd7-4ed6-9f2a-8b1dac1fc3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:03.942652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8ebab-3dd7-4ed6-9f2a-8b1dac1fc3b9 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:03.953657 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1094/2188] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:04.716753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047e7ad-5161-49d2-9b02-0c81e18bdc1b None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:04.718868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7047e7ad-5161-49d2-9b02-0c81e18bdc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:04.732200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047e7ad-5161-49d2-9b02-0c81e18bdc1b None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:04.737189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9612972-bdab-4b9c-ad8b-9602e6a6d40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:04.738281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612972-bdab-4b9c-ad8b-9602e6a6d40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:04.738725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612972-bdab-4b9c-ad8b-9602e6a6d40b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:04.739034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612972-bdab-4b9c-ad8b-9602e6a6d40b admin admin] PATH_INFO: `/v3/users/55407d5ba3e34e109ec0a4b90f942a28` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:04.740413 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9612972-bdab-4b9c-ad8b-9602e6a6d40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=55407d5ba3e34e109ec0a4b90f942a28)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:04.742509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9612972-bdab-4b9c-ad8b-9602e6a6d40b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:04.834637 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-a9612972-bdab-4b9c-ad8b-9602e6a6d40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55407d5ba3e34e109ec0a4b90f942a28'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:04.843064 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-a9612972-bdab-4b9c-ad8b-9602e6a6d40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55407d5ba3e34e109ec0a4b90f942a28'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:04.856032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-a9612972-bdab-4b9c-ad8b-9602e6a6d40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55407d5ba3e34e109ec0a4b90f942a28'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:04.872353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-a9612972-bdab-4b9c-ad8b-9602e6a6d40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55407d5ba3e34e109ec0a4b90f942a28'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:04.873258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-a9612972-bdab-4b9c-ad8b-9602e6a6d40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55407d5ba3e34e109ec0a4b90f942a28'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:04.885273 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1095/2189] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:34:04 2021] DELETE /identity/v3/users/55407d5ba3e34e109ec0a4b90f942a28 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:04.890492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d094e97-cde9-4f05-b487-300579e86578 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:04.891114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d094e97-cde9-4f05-b487-300579e86578 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:04.892205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d094e97-cde9-4f05-b487-300579e86578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:04.913956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-8d094e97-cde9-4f05-b487-300579e86578 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:04.915767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8d094e97-cde9-4f05-b487-300579e86578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:05.013202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1095/2190] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:05.029683 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9612972-bdab-4b9c-ad8b-9602e6a6d40b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:05.031417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a9612972-bdab-4b9c-ad8b-9602e6a6d40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:05.097146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9612972-bdab-4b9c-ad8b-9602e6a6d40b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:05.102032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ea0e2-05e2-4e04-8546-cdf9530d7d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:05.103209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ea0e2-05e2-4e04-8546-cdf9530d7d2d service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:05.103669 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ea0e2-05e2-4e04-8546-cdf9530d7d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:05.104302 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ea0e2-05e2-4e04-8546-cdf9530d7d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:05.115071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ea0e2-05e2-4e04-8546-cdf9530d7d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:05.116543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ea0e2-05e2-4e04-8546-cdf9530d7d2d service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:05.127753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1096/2191] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:05.427955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d094e97-cde9-4f05-b487-300579e86578 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:05.429432 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8d094e97-cde9-4f05-b487-300579e86578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:05.441593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d094e97-cde9-4f05-b487-300579e86578 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:05.446761 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:05.447839 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:05.448808 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:05.449226 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] PATH_INFO: `/v3/projects/0b104c1990f346579622eba783ccee45` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:05.450529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b104c1990f346579622eba783ccee45)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:05.452542 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:05.507597 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b104c1990f346579622eba783ccee45', 'request_id': 'req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:05.513501 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b104c1990f346579622eba783ccee45', 'request_id': 'req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:05.525221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b104c1990f346579622eba783ccee45', 'request_id': 'req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:05.553543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] The token cache is being invalidate because project 0b104c1990f346579622eba783ccee45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:34:05.554043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:05.554815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:05.558702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1096/2192] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:34:05 2021] DELETE /identity/v3/projects/0b104c1990f346579622eba783ccee45 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:05.562623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ea0e2-05e2-4e04-8546-cdf9530d7d2d service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:05.584342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ea0e2-05e2-4e04-8546-cdf9530d7d2d service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:05.704462 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab798ecd-0bf3-42fa-98ff-8650cff60a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:05.705837 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab798ecd-0bf3-42fa-98ff-8650cff60a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:05.706922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab798ecd-0bf3-42fa-98ff-8650cff60a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:05.706922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab798ecd-0bf3-42fa-98ff-8650cff60a23 admin admin] PATH_INFO: `/v3/users/e39fa447cb7e4514b4ad5dcc6391f7b8` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:05.710798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab798ecd-0bf3-42fa-98ff-8650cff60a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39fa447cb7e4514b4ad5dcc6391f7b8)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:05.713172 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab798ecd-0bf3-42fa-98ff-8650cff60a23 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:05.809365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ab798ecd-0bf3-42fa-98ff-8650cff60a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39fa447cb7e4514b4ad5dcc6391f7b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:05.848178 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ab798ecd-0bf3-42fa-98ff-8650cff60a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39fa447cb7e4514b4ad5dcc6391f7b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:05.872715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ab798ecd-0bf3-42fa-98ff-8650cff60a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39fa447cb7e4514b4ad5dcc6391f7b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:05.893423 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ab798ecd-0bf3-42fa-98ff-8650cff60a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39fa447cb7e4514b4ad5dcc6391f7b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:05.894354 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ab798ecd-0bf3-42fa-98ff-8650cff60a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39fa447cb7e4514b4ad5dcc6391f7b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:05.906979 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1097/2193] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:34:05 2021] DELETE /identity/v3/users/e39fa447cb7e4514b4ad5dcc6391f7b8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:06.275343 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:06.277550 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:06.293308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e8ee7-3e35-4eae-bf80-1a28fe4a9f63 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:06.356818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:06.357809 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:06.358126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:06.358401 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] PATH_INFO: `/v3/projects/a99adc71fb844b4d98af9e0ca8b7e0b6` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:06.359848 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99adc71fb844b4d98af9e0ca8b7e0b6)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:06.361846 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:06.415777 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99adc71fb844b4d98af9e0ca8b7e0b6', 'request_id': 'req-d524b786-f2e5-4ee8-8c35-86b0f4934575'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:06.422939 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99adc71fb844b4d98af9e0ca8b7e0b6', 'request_id': 'req-d524b786-f2e5-4ee8-8c35-86b0f4934575'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:06.429947 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99adc71fb844b4d98af9e0ca8b7e0b6', 'request_id': 'req-d524b786-f2e5-4ee8-8c35-86b0f4934575'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:06.446760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] The token cache is being invalidate because project a99adc71fb844b4d98af9e0ca8b7e0b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:34:06.447104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:06.447751 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:06.450032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1097/2194] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:34:06 2021] DELETE /identity/v3/projects/a99adc71fb844b4d98af9e0ca8b7e0b6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:06.453968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab798ecd-0bf3-42fa-98ff-8650cff60a23 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:06.455472 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ab798ecd-0bf3-42fa-98ff-8650cff60a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:06.469391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab798ecd-0bf3-42fa-98ff-8650cff60a23 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:06.539236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20362a-19e9-4978-9f64-7af3ae7fdf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:06.540102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20362a-19e9-4978-9f64-7af3ae7fdf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:06.540383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20362a-19e9-4978-9f64-7af3ae7fdf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:06.540654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20362a-19e9-4978-9f64-7af3ae7fdf18 admin admin] PATH_INFO: `/v3/users/361943dd3efd434081058e4f9dd48af4` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:06.543177 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20362a-19e9-4978-9f64-7af3ae7fdf18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=361943dd3efd434081058e4f9dd48af4)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:06.545123 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20362a-19e9-4978-9f64-7af3ae7fdf18 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:06.601198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bf20362a-19e9-4978-9f64-7af3ae7fdf18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '361943dd3efd434081058e4f9dd48af4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:06.611265 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bf20362a-19e9-4978-9f64-7af3ae7fdf18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '361943dd3efd434081058e4f9dd48af4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:06.629108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bf20362a-19e9-4978-9f64-7af3ae7fdf18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '361943dd3efd434081058e4f9dd48af4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:06.646770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bf20362a-19e9-4978-9f64-7af3ae7fdf18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '361943dd3efd434081058e4f9dd48af4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:06.647840 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bf20362a-19e9-4978-9f64-7af3ae7fdf18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '361943dd3efd434081058e4f9dd48af4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:06.658295 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1098/2195] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:34:06 2021] DELETE /identity/v3/users/361943dd3efd434081058e4f9dd48af4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:07.374704 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:07.378169 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:07.404981 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524b786-f2e5-4ee8-8c35-86b0f4934575 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:07.487147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8e207-5195-40f0-b40c-b850376c9036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:07.488621 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8e207-5195-40f0-b40c-b850376c9036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:07.489055 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8e207-5195-40f0-b40c-b850376c9036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:07.489462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8e207-5195-40f0-b40c-b850376c9036 admin admin] PATH_INFO: `/v3/projects/a82eb58d635640ae878e2eb0da06e151` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:07.491105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8e207-5195-40f0-b40c-b850376c9036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a82eb58d635640ae878e2eb0da06e151)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:07.493221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8e207-5195-40f0-b40c-b850376c9036 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:07.550391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4cf8e207-5195-40f0-b40c-b850376c9036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a82eb58d635640ae878e2eb0da06e151', 'request_id': 'req-4cf8e207-5195-40f0-b40c-b850376c9036'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:07.561386 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4cf8e207-5195-40f0-b40c-b850376c9036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a82eb58d635640ae878e2eb0da06e151', 'request_id': 'req-4cf8e207-5195-40f0-b40c-b850376c9036'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:07.568669 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4cf8e207-5195-40f0-b40c-b850376c9036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a82eb58d635640ae878e2eb0da06e151', 'request_id': 'req-4cf8e207-5195-40f0-b40c-b850376c9036'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:07.589557 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4cf8e207-5195-40f0-b40c-b850376c9036 admin admin] The token cache is being invalidate because project a82eb58d635640ae878e2eb0da06e151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:34:07.590267 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4cf8e207-5195-40f0-b40c-b850376c9036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:07.591291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4cf8e207-5195-40f0-b40c-b850376c9036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:07.593821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1098/2196] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:34:07 2021] DELETE /identity/v3/projects/a82eb58d635640ae878e2eb0da06e151 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:07.600574 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afab0f-0115-4b74-afaf-41f73a1e4200 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:07.601089 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afab0f-0115-4b74-afaf-41f73a1e4200 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:07.601201 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afab0f-0115-4b74-afaf-41f73a1e4200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:07.621717 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-78afab0f-0115-4b74-afaf-41f73a1e4200 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:07.623720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-78afab0f-0115-4b74-afaf-41f73a1e4200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:07.716534 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1099/2197] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:07.725941 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19791977-159d-4145-a951-35386b0867c5 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:07.726593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19791977-159d-4145-a951-35386b0867c5 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:07.727127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19791977-159d-4145-a951-35386b0867c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:07.749840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-19791977-159d-4145-a951-35386b0867c5 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:07.751324 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-19791977-159d-4145-a951-35386b0867c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:07.763796 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1099/2198] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:07.767766 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afab0f-0115-4b74-afaf-41f73a1e4200 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:07.778420 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afab0f-0115-4b74-afaf-41f73a1e4200 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:07.783248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9428ac7-66b9-44a8-aff3-eb1b2d1df258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:07.783907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9428ac7-66b9-44a8-aff3-eb1b2d1df258 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:07.784189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9428ac7-66b9-44a8-aff3-eb1b2d1df258 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:07.784633 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9428ac7-66b9-44a8-aff3-eb1b2d1df258 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:07.785506 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9428ac7-66b9-44a8-aff3-eb1b2d1df258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:34:07.785977 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9428ac7-66b9-44a8-aff3-eb1b2d1df258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:07.787795 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9428ac7-66b9-44a8-aff3-eb1b2d1df258 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:07.800098 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1100/2199] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:34:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:34:07.806888 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19791977-159d-4145-a951-35386b0867c5 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:07.816379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19791977-159d-4145-a951-35386b0867c5 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:07.822030 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a2033-40da-43cc-9cff-ae37734f42aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:07.822625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a2033-40da-43cc-9cff-ae37734f42aa admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:07.823471 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a2033-40da-43cc-9cff-ae37734f42aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:07.823928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a2033-40da-43cc-9cff-ae37734f42aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:07.824866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a2033-40da-43cc-9cff-ae37734f42aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:07.827246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a2033-40da-43cc-9cff-ae37734f42aa admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:07.859387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1100/2200] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:34:07 2021] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:07.863683 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9428ac7-66b9-44a8-aff3-eb1b2d1df258 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:07.874305 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9428ac7-66b9-44a8-aff3-eb1b2d1df258 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:07.949788 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b69f0-006e-467e-ae18-4ed93face383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:07.950742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b69f0-006e-467e-ae18-4ed93face383 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:07.951278 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b69f0-006e-467e-ae18-4ed93face383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:07.951717 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b69f0-006e-467e-ae18-4ed93face383 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:07.952676 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b69f0-006e-467e-ae18-4ed93face383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:07.957968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b69f0-006e-467e-ae18-4ed93face383 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:07.995499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1101/2201] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:34:07 2021] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:34:07.997927 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a2033-40da-43cc-9cff-ae37734f42aa admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:08.010306 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a2033-40da-43cc-9cff-ae37734f42aa admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:08.020278 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659d789-6194-46af-9e50-5e412cfd8066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:08.021067 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659d789-6194-46af-9e50-5e412cfd8066 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:08.021422 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659d789-6194-46af-9e50-5e412cfd8066 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:08.021775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659d789-6194-46af-9e50-5e412cfd8066 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:08.022595 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659d789-6194-46af-9e50-5e412cfd8066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:08.024421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659d789-6194-46af-9e50-5e412cfd8066 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:08.036921 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1101/2202] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:07 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:08.041081 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b69f0-006e-467e-ae18-4ed93face383 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:08.059628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b69f0-006e-467e-ae18-4ed93face383 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:08.065699 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f042ca0-6186-4a2b-b492-5a149ee6781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:08.066534 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f042ca0-6186-4a2b-b492-5a149ee6781e admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:08.068190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f042ca0-6186-4a2b-b492-5a149ee6781e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:08.068190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f042ca0-6186-4a2b-b492-5a149ee6781e admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:08.068976 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f042ca0-6186-4a2b-b492-5a149ee6781e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:08.071006 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f042ca0-6186-4a2b-b492-5a149ee6781e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:08.088949 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659d789-6194-46af-9e50-5e412cfd8066 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:08.089956 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1102/2203] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:08 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:08.101579 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659d789-6194-46af-9e50-5e412cfd8066 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:08.108390 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d885b61-868c-48b2-9c4f-3795104933e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:08.109621 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d885b61-868c-48b2-9c4f-3795104933e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:08.110433 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d885b61-868c-48b2-9c4f-3795104933e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:08.110906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d885b61-868c-48b2-9c4f-3795104933e4 admin admin] PATH_INFO: `/v3/projects/a41c642e07a44136bfaeca28253040d5/users/ce9fc4f3ce4044f994fa9b5dbe4af396/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:08.137041 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d885b61-868c-48b2-9c4f-3795104933e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41c642e07a44136bfaeca28253040d5, user_id=ce9fc4f3ce4044f994fa9b5dbe4af396, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:08.140214 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d885b61-868c-48b2-9c4f-3795104933e4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:08.181069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1102/2204] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:08 2021] PUT /identity/v3/projects/a41c642e07a44136bfaeca28253040d5/users/ce9fc4f3ce4044f994fa9b5dbe4af396/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:34:08.182983 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af517330-cf9c-4e33-9425-65732d93d4e9 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:08.183386 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af517330-cf9c-4e33-9425-65732d93d4e9 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:08.183773 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af517330-cf9c-4e33-9425-65732d93d4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:08.231988 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-af517330-cf9c-4e33-9425-65732d93d4e9 None None] MFA Rules not processed for user `ce9fc4f3ce4044f994fa9b5dbe4af396`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:08.233786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-af517330-cf9c-4e33-9425-65732d93d4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:08.331259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1103/2205] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:08 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:08.335635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d885b61-868c-48b2-9c4f-3795104933e4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:08.452434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d885b61-868c-48b2-9c4f-3795104933e4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:08.460463 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9aafb-f796-436c-a314-08659b23861d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:08.461462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9aafb-f796-436c-a314-08659b23861d admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:08.461913 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9aafb-f796-436c-a314-08659b23861d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:08.462565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9aafb-f796-436c-a314-08659b23861d admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:08.466362 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9aafb-f796-436c-a314-08659b23861d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:08.472093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9aafb-f796-436c-a314-08659b23861d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:08.503849 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1103/2206] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:34:08 2021] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:08.507924 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af517330-cf9c-4e33-9425-65732d93d4e9 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:08.526014 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af517330-cf9c-4e33-9425-65732d93d4e9 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:08.595667 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627535-a690-43ec-9bc1-c2db7ffa5f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:08.596464 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627535-a690-43ec-9bc1-c2db7ffa5f78 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:08.600501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627535-a690-43ec-9bc1-c2db7ffa5f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:08.600501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627535-a690-43ec-9bc1-c2db7ffa5f78 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:08.600501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9627535-a690-43ec-9bc1-c2db7ffa5f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:08.600501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9627535-a690-43ec-9bc1-c2db7ffa5f78 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:08.627639 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1104/2207] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:34:08 2021] POST /identity/v3/users => generated 298 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:08.628445 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9aafb-f796-436c-a314-08659b23861d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:08.640246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9aafb-f796-436c-a314-08659b23861d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:08.648871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc795e08-2797-4186-bc00-f1c1908ac1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:08.649881 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc795e08-2797-4186-bc00-f1c1908ac1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:08.650333 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc795e08-2797-4186-bc00-f1c1908ac1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:08.650678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc795e08-2797-4186-bc00-f1c1908ac1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:08.651736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc795e08-2797-4186-bc00-f1c1908ac1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:08.653473 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc795e08-2797-4186-bc00-f1c1908ac1c1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:08.672675 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1104/2208] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:08 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:34:08.676866 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627535-a690-43ec-9bc1-c2db7ffa5f78 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:08.688985 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627535-a690-43ec-9bc1-c2db7ffa5f78 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:08.698691 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bcff9-1656-4cdd-bb14-4e6fd088a03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:08.699835 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bcff9-1656-4cdd-bb14-4e6fd088a03f admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:08.700573 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bcff9-1656-4cdd-bb14-4e6fd088a03f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:08.704234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bcff9-1656-4cdd-bb14-4e6fd088a03f admin admin] PATH_INFO: `/v3/projects/fdc0654ed23e4836a6760e31df58b02b/users/3fc171848f7c45f0a86956e9bfab0cab/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:08.739664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bcff9-1656-4cdd-bb14-4e6fd088a03f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc0654ed23e4836a6760e31df58b02b, user_id=3fc171848f7c45f0a86956e9bfab0cab, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:08.746311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bcff9-1656-4cdd-bb14-4e6fd088a03f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:08.763622 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1105/2209] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:08 2021] PUT /identity/v3/projects/fdc0654ed23e4836a6760e31df58b02b/users/3fc171848f7c45f0a86956e9bfab0cab/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:34:08.767643 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc795e08-2797-4186-bc00-f1c1908ac1c1 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:08.784268 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc795e08-2797-4186-bc00-f1c1908ac1c1 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:08.884977 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991c672-1766-4c47-89c4-3ba8faf7b573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:08.885776 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c672-1766-4c47-89c4-3ba8faf7b573 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:08.886431 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c672-1766-4c47-89c4-3ba8faf7b573 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:08.886611 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c672-1766-4c47-89c4-3ba8faf7b573 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:08.887404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991c672-1766-4c47-89c4-3ba8faf7b573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:08.889043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991c672-1766-4c47-89c4-3ba8faf7b573 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:08.905672 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bcff9-1656-4cdd-bb14-4e6fd088a03f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:08.907009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1105/2210] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:08 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:08.926893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bcff9-1656-4cdd-bb14-4e6fd088a03f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:08.940485 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c9cdb-8aa2-4fb5-9660-f8fcb90a212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:08.941932 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c9cdb-8aa2-4fb5-9660-f8fcb90a212d admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:08.942217 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c9cdb-8aa2-4fb5-9660-f8fcb90a212d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:08.942498 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c9cdb-8aa2-4fb5-9660-f8fcb90a212d admin admin] PATH_INFO: `/v3/projects/fdc0654ed23e4836a6760e31df58b02b/users/3fc171848f7c45f0a86956e9bfab0cab/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:08.945049 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c9cdb-8aa2-4fb5-9660-f8fcb90a212d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc0654ed23e4836a6760e31df58b02b, user_id=3fc171848f7c45f0a86956e9bfab0cab, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:08.947898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c9cdb-8aa2-4fb5-9660-f8fcb90a212d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:08.965660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f8695-a256-4655-ac38-f62f8561b16a None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:08.965959 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f8695-a256-4655-ac38-f62f8561b16a None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:08.966239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f8695-a256-4655-ac38-f62f8561b16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:08.977955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1106/2211] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:08 2021] PUT /identity/v3/projects/fdc0654ed23e4836a6760e31df58b02b/users/3fc171848f7c45f0a86956e9bfab0cab/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:08.989953 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeedbc-8ba5-4069-b7b5-e8b6112cfb1e None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:08.990270 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeedbc-8ba5-4069-b7b5-e8b6112cfb1e None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:08.990551 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eeedbc-8ba5-4069-b7b5-e8b6112cfb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:09.015513 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-778f8695-a256-4655-ac38-f62f8561b16a None None] MFA Rules not processed for user `1cfb6806de1c4f79bf7dd4aaf8b71aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:09.017616 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-778f8695-a256-4655-ac38-f62f8561b16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:09.029784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-11eeedbc-8ba5-4069-b7b5-e8b6112cfb1e None None] MFA Rules not processed for user `3fc171848f7c45f0a86956e9bfab0cab`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:09.031084 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-11eeedbc-8ba5-4069-b7b5-e8b6112cfb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:09.089868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1106/2212] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:08 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:34:09.094924 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f8695-a256-4655-ac38-f62f8561b16a None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:09.096322 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-778f8695-a256-4655-ac38-f62f8561b16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:09.104005 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1107/2213] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:08 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:34:09.114413 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eeedbc-8ba5-4069-b7b5-e8b6112cfb1e None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:09.116380 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-11eeedbc-8ba5-4069-b7b5-e8b6112cfb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:09.178910 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f8695-a256-4655-ac38-f62f8561b16a None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:09.185126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf21b40-a5a3-4bfc-afaa-38b0b3246b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:09.185832 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf21b40-a5a3-4bfc-afaa-38b0b3246b1b admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:09.186386 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf21b40-a5a3-4bfc-afaa-38b0b3246b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:09.186678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf21b40-a5a3-4bfc-afaa-38b0b3246b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:09.187564 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf21b40-a5a3-4bfc-afaa-38b0b3246b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:09.189405 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eeedbc-8ba5-4069-b7b5-e8b6112cfb1e None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:09.189546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf21b40-a5a3-4bfc-afaa-38b0b3246b1b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:09.193907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d5901-9dba-485e-91b5-6f305f560471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:09.194775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d5901-9dba-485e-91b5-6f305f560471 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:09.195317 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d5901-9dba-485e-91b5-6f305f560471 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:09.195435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d5901-9dba-485e-91b5-6f305f560471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:09.227122 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1107/2214] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:34:09 2021] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:09.231885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf21b40-a5a3-4bfc-afaa-38b0b3246b1b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:09.279129 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d5901-9dba-485e-91b5-6f305f560471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:09.280983 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d5901-9dba-485e-91b5-6f305f560471 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:09.297314 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1108/2215] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:09 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:34:09.327705 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf21b40-a5a3-4bfc-afaa-38b0b3246b1b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:09.335552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5a936-fce0-48e4-9d99-1e3ce9f10aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:09.336662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5a936-fce0-48e4-9d99-1e3ce9f10aaa admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:09.337019 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5a936-fce0-48e4-9d99-1e3ce9f10aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:09.337364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5a936-fce0-48e4-9d99-1e3ce9f10aaa admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:09.338128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5a936-fce0-48e4-9d99-1e3ce9f10aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:09.341874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5a936-fce0-48e4-9d99-1e3ce9f10aaa admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:09.371801 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1108/2216] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:34:09 2021] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:09.376039 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d5901-9dba-485e-91b5-6f305f560471 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:09.396350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d5901-9dba-485e-91b5-6f305f560471 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:09.405397 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f7f9c-a79f-4ee0-b476-f1fe051b13d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:09.406538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f7f9c-a79f-4ee0-b476-f1fe051b13d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:09.406829 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f7f9c-a79f-4ee0-b476-f1fe051b13d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:09.407141 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f7f9c-a79f-4ee0-b476-f1fe051b13d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:09.408037 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f7f9c-a79f-4ee0-b476-f1fe051b13d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:09.409840 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f7f9c-a79f-4ee0-b476-f1fe051b13d5 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:09.422882 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1109/2217] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:09 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:09.425828 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5a936-fce0-48e4-9d99-1e3ce9f10aaa admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:09.442007 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5a936-fce0-48e4-9d99-1e3ce9f10aaa admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:09.448638 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e64ad-8532-40c2-b2bc-5a688dbc8329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:09.449862 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e64ad-8532-40c2-b2bc-5a688dbc8329 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:09.450434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e64ad-8532-40c2-b2bc-5a688dbc8329 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:09.451126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e64ad-8532-40c2-b2bc-5a688dbc8329 admin admin] PATH_INFO: `/v3/projects/83f5fe8db7ed4e6da56d13d046017238/users/aa5ff63a82be470e988c40f6777efc97/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:09.482626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e64ad-8532-40c2-b2bc-5a688dbc8329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f5fe8db7ed4e6da56d13d046017238, user_id=aa5ff63a82be470e988c40f6777efc97, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:09.485481 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e64ad-8532-40c2-b2bc-5a688dbc8329 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:09.512677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1109/2218] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:09 2021] PUT /identity/v3/projects/83f5fe8db7ed4e6da56d13d046017238/users/aa5ff63a82be470e988c40f6777efc97/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:34:09.513999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f7f9c-a79f-4ee0-b476-f1fe051b13d5 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:09.527607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f7f9c-a79f-4ee0-b476-f1fe051b13d5 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:09.597076 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed289e13-5f9d-4b9b-8079-e2f51e140f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:09.598394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed289e13-5f9d-4b9b-8079-e2f51e140f46 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:09.598519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed289e13-5f9d-4b9b-8079-e2f51e140f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:09.598982 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed289e13-5f9d-4b9b-8079-e2f51e140f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:09.600197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed289e13-5f9d-4b9b-8079-e2f51e140f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:09.602537 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed289e13-5f9d-4b9b-8079-e2f51e140f46 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:09.615408 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1110/2219] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:09 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:09.619425 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e64ad-8532-40c2-b2bc-5a688dbc8329 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:09.636176 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e64ad-8532-40c2-b2bc-5a688dbc8329 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:09.642375 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdd5dd-9ac3-4976-8c45-06dbec16e9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:09.644030 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdd5dd-9ac3-4976-8c45-06dbec16e9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:09.644542 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdd5dd-9ac3-4976-8c45-06dbec16e9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:09.645161 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdd5dd-9ac3-4976-8c45-06dbec16e9ec admin admin] PATH_INFO: `/v3/projects/83f5fe8db7ed4e6da56d13d046017238/users/aa5ff63a82be470e988c40f6777efc97/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:09.649160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdd5dd-9ac3-4976-8c45-06dbec16e9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f5fe8db7ed4e6da56d13d046017238, user_id=aa5ff63a82be470e988c40f6777efc97, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:09.652865 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdd5dd-9ac3-4976-8c45-06dbec16e9ec admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:09.669749 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1110/2220] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:09 2021] PUT /identity/v3/projects/83f5fe8db7ed4e6da56d13d046017238/users/aa5ff63a82be470e988c40f6777efc97/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:34:14.773118 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e0a0f-8789-4957-b278-54b800bc0a9e None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:14.774006 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e0a0f-8789-4957-b278-54b800bc0a9e None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:14.774445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e0a0f-8789-4957-b278-54b800bc0a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:14.805641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-155e0a0f-8789-4957-b278-54b800bc0a9e None None] MFA Rules not processed for user `aa5ff63a82be470e988c40f6777efc97`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:14.807483 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-155e0a0f-8789-4957-b278-54b800bc0a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:14.886048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1111/2221] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:14 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:34:14.898662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdd5dd-9ac3-4976-8c45-06dbec16e9ec admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:14.900800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-affdd5dd-9ac3-4976-8c45-06dbec16e9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:14.959896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdd5dd-9ac3-4976-8c45-06dbec16e9ec admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:14.964087 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb31d8c-fac5-4794-b39e-405e7b570b42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cab78404d3c4980a4b99da09edab426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:14.964748 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb31d8c-fac5-4794-b39e-405e7b570b42 service glance] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:14.965032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb31d8c-fac5-4794-b39e-405e7b570b42 service glance] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:14.965305 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb31d8c-fac5-4794-b39e-405e7b570b42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:15.022230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb31d8c-fac5-4794-b39e-405e7b570b42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:15.023708 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb31d8c-fac5-4794-b39e-405e7b570b42 service glance] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:15.032583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1111/2222] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:14 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:15.161700 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2deff-21e2-4f58-867b-341dd409b08c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:15.161995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2deff-21e2-4f58-867b-341dd409b08c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:15.162277 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2deff-21e2-4f58-867b-341dd409b08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:15.189877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f9e2deff-21e2-4f58-867b-341dd409b08c None None] MFA Rules not processed for user `f6af4c462c6347ff8abbcc8770874b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:15.191575 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f9e2deff-21e2-4f58-867b-341dd409b08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:15.258991 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1112/2223] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Nov 16 00:34:15 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:15.272303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb31d8c-fac5-4794-b39e-405e7b570b42 service glance] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:15.273719 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6fb31d8c-fac5-4794-b39e-405e7b570b42 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:15.367530 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb31d8c-fac5-4794-b39e-405e7b570b42 service glance] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:15.375893 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38c4a0-9243-4d1f-abd6-39b09ad7294f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac32c6730654a889472a3bad95374bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:15.376202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38c4a0-9243-4d1f-abd6-39b09ad7294f service swift] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:15.376777 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38c4a0-9243-4d1f-abd6-39b09ad7294f service swift] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:15.376928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38c4a0-9243-4d1f-abd6-39b09ad7294f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:15.386474 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38c4a0-9243-4d1f-abd6-39b09ad7294f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:15.388236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38c4a0-9243-4d1f-abd6-39b09ad7294f service swift] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:15.400914 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1112/2224] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Nov 16 00:34:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 00:34:18.559759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a105dfa-d7b4-40bc-86e6-4cc8e2b83559 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:18.561273 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a105dfa-d7b4-40bc-86e6-4cc8e2b83559 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:18.561859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a105dfa-d7b4-40bc-86e6-4cc8e2b83559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:18.607068 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0a105dfa-d7b4-40bc-86e6-4cc8e2b83559 None None] MFA Rules not processed for user `75a772d36dc64b34ad0e9f2748cea24f`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:18.608696 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0a105dfa-d7b4-40bc-86e6-4cc8e2b83559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:18.689788 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1113/2225] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:18 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:19.461669 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38c4a0-9243-4d1f-abd6-39b09ad7294f service swift] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:19.463744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-4e38c4a0-9243-4d1f-abd6-39b09ad7294f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:19.571164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38c4a0-9243-4d1f-abd6-39b09ad7294f service swift] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:19.584175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd8f4d-5d14-4702-9a45-42e6f697ec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:19.586651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd8f4d-5d14-4702-9a45-42e6f697ec22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:19.587217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd8f4d-5d14-4702-9a45-42e6f697ec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:19.587674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd8f4d-5d14-4702-9a45-42e6f697ec22 admin admin] PATH_INFO: `/v3/users/19adaca24f4a40959ac6c04457122230` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:19.589421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd8f4d-5d14-4702-9a45-42e6f697ec22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19adaca24f4a40959ac6c04457122230)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:19.598215 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd8f4d-5d14-4702-9a45-42e6f697ec22 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:19.706573 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4fbd8f4d-5d14-4702-9a45-42e6f697ec22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19adaca24f4a40959ac6c04457122230'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:19.724274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4fbd8f4d-5d14-4702-9a45-42e6f697ec22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19adaca24f4a40959ac6c04457122230'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:19.728400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4fbd8f4d-5d14-4702-9a45-42e6f697ec22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19adaca24f4a40959ac6c04457122230'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:19.761139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4fbd8f4d-5d14-4702-9a45-42e6f697ec22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19adaca24f4a40959ac6c04457122230'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:19.762407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4fbd8f4d-5d14-4702-9a45-42e6f697ec22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19adaca24f4a40959ac6c04457122230'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:19.786809 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1113/2226] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:34:19 2021] DELETE /identity/v3/users/19adaca24f4a40959ac6c04457122230 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:19.791422 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65933c-edd7-462f-96a1-edba7b9b685d None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:19.792046 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65933c-edd7-462f-96a1-edba7b9b685d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:19.792046 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65933c-edd7-462f-96a1-edba7b9b685d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:19.830574 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-8c65933c-edd7-462f-96a1-edba7b9b685d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:19.831869 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8c65933c-edd7-462f-96a1-edba7b9b685d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:19.995481 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1114/2227] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:20.002523 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd8f4d-5d14-4702-9a45-42e6f697ec22 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:20.004858 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-4fbd8f4d-5d14-4702-9a45-42e6f697ec22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:20.133813 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd8f4d-5d14-4702-9a45-42e6f697ec22 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:20.139300 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae80770-24f9-43d3-9818-1876b90ed427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:20.140113 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae80770-24f9-43d3-9818-1876b90ed427 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:20.140403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae80770-24f9-43d3-9818-1876b90ed427 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:20.141362 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae80770-24f9-43d3-9818-1876b90ed427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:20.154863 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae80770-24f9-43d3-9818-1876b90ed427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:20.156663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae80770-24f9-43d3-9818-1876b90ed427 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:20.176092 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1114/2228] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:20.733246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65933c-edd7-462f-96a1-edba7b9b685d None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:20.734930 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8c65933c-edd7-462f-96a1-edba7b9b685d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:20.853454 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65933c-edd7-462f-96a1-edba7b9b685d None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:20.860786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee06e8-4283-4b29-8b53-aef8776a4f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:20.861944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee06e8-4283-4b29-8b53-aef8776a4f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:20.862404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee06e8-4283-4b29-8b53-aef8776a4f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:20.862890 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee06e8-4283-4b29-8b53-aef8776a4f39 admin admin] PATH_INFO: `/v3/projects/bfce037592134840ab857fb86ab0fb06` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:20.867839 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee06e8-4283-4b29-8b53-aef8776a4f39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfce037592134840ab857fb86ab0fb06)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:20.870543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee06e8-4283-4b29-8b53-aef8776a4f39 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:20.935773 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9bee06e8-4283-4b29-8b53-aef8776a4f39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfce037592134840ab857fb86ab0fb06', 'request_id': 'req-9bee06e8-4283-4b29-8b53-aef8776a4f39'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:20.942822 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9bee06e8-4283-4b29-8b53-aef8776a4f39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfce037592134840ab857fb86ab0fb06', 'request_id': 'req-9bee06e8-4283-4b29-8b53-aef8776a4f39'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:20.980265 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9bee06e8-4283-4b29-8b53-aef8776a4f39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfce037592134840ab857fb86ab0fb06', 'request_id': 'req-9bee06e8-4283-4b29-8b53-aef8776a4f39'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:21.004513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9bee06e8-4283-4b29-8b53-aef8776a4f39 admin admin] The token cache is being invalidate because project bfce037592134840ab857fb86ab0fb06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:34:21.007482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9bee06e8-4283-4b29-8b53-aef8776a4f39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:21.008583 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9bee06e8-4283-4b29-8b53-aef8776a4f39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:21.019808 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1115/2229] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:34:20 2021] DELETE /identity/v3/projects/bfce037592134840ab857fb86ab0fb06 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:21.025094 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97960f4b-1bca-49a8-b747-9bc3ba96a8ca None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:21.025842 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97960f4b-1bca-49a8-b747-9bc3ba96a8ca None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:21.025842 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97960f4b-1bca-49a8-b747-9bc3ba96a8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:21.125935 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-97960f4b-1bca-49a8-b747-9bc3ba96a8ca None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:21.131066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-97960f4b-1bca-49a8-b747-9bc3ba96a8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:21.281358 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1115/2230] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:34:21.290663 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91573dc3-8458-4c40-956d-a1234a03bf2f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:21.291529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91573dc3-8458-4c40-956d-a1234a03bf2f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:21.292973 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91573dc3-8458-4c40-956d-a1234a03bf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:21.349341 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-91573dc3-8458-4c40-956d-a1234a03bf2f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:21.351098 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-91573dc3-8458-4c40-956d-a1234a03bf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:21.382859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1116/2231] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:21.387904 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97960f4b-1bca-49a8-b747-9bc3ba96a8ca None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:21.399566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97960f4b-1bca-49a8-b747-9bc3ba96a8ca None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:21.417339 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628e312-0e0d-463f-8097-68b423173b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:21.418452 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e312-0e0d-463f-8097-68b423173b4b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:21.418452 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e312-0e0d-463f-8097-68b423173b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:21.418635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e312-0e0d-463f-8097-68b423173b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:21.419717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628e312-0e0d-463f-8097-68b423173b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:34:21.420030 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628e312-0e0d-463f-8097-68b423173b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:21.421659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628e312-0e0d-463f-8097-68b423173b4b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:21.443578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1116/2232] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:34:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:34:21.448668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91573dc3-8458-4c40-956d-a1234a03bf2f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:21.466517 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91573dc3-8458-4c40-956d-a1234a03bf2f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:21.483925 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57dcb-a4e1-4234-a137-20a8575b9e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:21.484880 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57dcb-a4e1-4234-a137-20a8575b9e9c admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:21.485340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57dcb-a4e1-4234-a137-20a8575b9e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:21.485793 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d57dcb-a4e1-4234-a137-20a8575b9e9c admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:21.487039 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d57dcb-a4e1-4234-a137-20a8575b9e9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:21.489126 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d57dcb-a4e1-4234-a137-20a8575b9e9c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:21.543547 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1117/2233] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:34:21 2021] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:34:21.544722 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628e312-0e0d-463f-8097-68b423173b4b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:21.563515 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628e312-0e0d-463f-8097-68b423173b4b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:21.673663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1f111-41f2-465e-a10a-5ea4a1d7024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:21.674445 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1f111-41f2-465e-a10a-5ea4a1d7024d admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:21.674801 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1f111-41f2-465e-a10a-5ea4a1d7024d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:21.675239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1f111-41f2-465e-a10a-5ea4a1d7024d admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:21.676019 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1f111-41f2-465e-a10a-5ea4a1d7024d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:21.677986 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1f111-41f2-465e-a10a-5ea4a1d7024d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:21.710183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1117/2234] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:34:21 2021] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:34:21.711472 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57dcb-a4e1-4234-a137-20a8575b9e9c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:21.725192 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d57dcb-a4e1-4234-a137-20a8575b9e9c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:21.731543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513f807-00e1-4fee-8261-40168d2ab466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:21.732742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513f807-00e1-4fee-8261-40168d2ab466 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:21.733059 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513f807-00e1-4fee-8261-40168d2ab466 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:21.733415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513f807-00e1-4fee-8261-40168d2ab466 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:21.734321 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513f807-00e1-4fee-8261-40168d2ab466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:21.736197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513f807-00e1-4fee-8261-40168d2ab466 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:21.755343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1118/2235] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:21 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:21.756110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1f111-41f2-465e-a10a-5ea4a1d7024d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:21.778483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1f111-41f2-465e-a10a-5ea4a1d7024d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:21.804951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614988df-cf1f-4a8f-b490-b62886fbd0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:21.805639 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614988df-cf1f-4a8f-b490-b62886fbd0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:21.805941 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614988df-cf1f-4a8f-b490-b62886fbd0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:21.806198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614988df-cf1f-4a8f-b490-b62886fbd0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:21.807886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614988df-cf1f-4a8f-b490-b62886fbd0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:21.809624 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614988df-cf1f-4a8f-b490-b62886fbd0c8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:21.824190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1118/2236] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:21 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:34:21.828156 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513f807-00e1-4fee-8261-40168d2ab466 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:21.840412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513f807-00e1-4fee-8261-40168d2ab466 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:21.849770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e4e59-7480-4e82-bd43-5bf6800f25e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:21.851335 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e4e59-7480-4e82-bd43-5bf6800f25e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:21.851675 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e4e59-7480-4e82-bd43-5bf6800f25e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:21.851958 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e4e59-7480-4e82-bd43-5bf6800f25e1 admin admin] PATH_INFO: `/v3/projects/b4d7780222934efaa7ea2e666bdc2b7b/users/88e46a4841c54de49b291afb3c2edbdd/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:21.874384 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e4e59-7480-4e82-bd43-5bf6800f25e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d7780222934efaa7ea2e666bdc2b7b, user_id=88e46a4841c54de49b291afb3c2edbdd, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:21.878373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e4e59-7480-4e82-bd43-5bf6800f25e1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:21.910852 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0b0d-f7c1-4073-b4a1-23818876d0f2 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:21.911068 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1119/2237] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:21 2021] PUT /identity/v3/projects/b4d7780222934efaa7ea2e666bdc2b7b/users/88e46a4841c54de49b291afb3c2edbdd/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:34:21.913255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0b0d-f7c1-4073-b4a1-23818876d0f2 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:21.913763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0b0d-f7c1-4073-b4a1-23818876d0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:21.937045 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-0f3f0b0d-f7c1-4073-b4a1-23818876d0f2 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:21.938679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0f3f0b0d-f7c1-4073-b4a1-23818876d0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:22.023694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1119/2238] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:22.036330 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e4e59-7480-4e82-bd43-5bf6800f25e1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:22.038905 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-af3e4e59-7480-4e82-bd43-5bf6800f25e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:22.199391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e4e59-7480-4e82-bd43-5bf6800f25e1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:22.203936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17230e52-7d6a-48b8-bbc5-b336f7fccee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:22.204662 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230e52-7d6a-48b8-bbc5-b336f7fccee8 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:22.204959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230e52-7d6a-48b8-bbc5-b336f7fccee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:22.205237 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230e52-7d6a-48b8-bbc5-b336f7fccee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:22.222090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17230e52-7d6a-48b8-bbc5-b336f7fccee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:22.224191 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17230e52-7d6a-48b8-bbc5-b336f7fccee8 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:22.237342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1120/2239] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:22.317147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f0b0d-f7c1-4073-b4a1-23818876d0f2 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:22.319687 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0f3f0b0d-f7c1-4073-b4a1-23818876d0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:22.333960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f0b0d-f7c1-4073-b4a1-23818876d0f2 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:22.359659 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbf842-fc23-4cdb-9944-e5d72badb73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:22.360504 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbf842-fc23-4cdb-9944-e5d72badb73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:22.360853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbf842-fc23-4cdb-9944-e5d72badb73e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:22.361115 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbf842-fc23-4cdb-9944-e5d72badb73e admin admin] PATH_INFO: `/v3/users/b18017f455214415bb241cda6cb137fc` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:22.362570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbf842-fc23-4cdb-9944-e5d72badb73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18017f455214415bb241cda6cb137fc)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:22.364664 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbf842-fc23-4cdb-9944-e5d72badb73e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:22.447337 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17230e52-7d6a-48b8-bbc5-b336f7fccee8 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:22.449789 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-17230e52-7d6a-48b8-bbc5-b336f7fccee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:22.500982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b7cbf842-fc23-4cdb-9944-e5d72badb73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18017f455214415bb241cda6cb137fc'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:22.513938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b7cbf842-fc23-4cdb-9944-e5d72badb73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18017f455214415bb241cda6cb137fc'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:22.515530 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b7cbf842-fc23-4cdb-9944-e5d72badb73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18017f455214415bb241cda6cb137fc'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:22.537332 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b7cbf842-fc23-4cdb-9944-e5d72badb73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18017f455214415bb241cda6cb137fc'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:22.546544 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b7cbf842-fc23-4cdb-9944-e5d72badb73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18017f455214415bb241cda6cb137fc'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:22.578892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1120/2240] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:34:22 2021] DELETE /identity/v3/users/b18017f455214415bb241cda6cb137fc => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:22.580525 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf09f45-22dc-4c4d-b5d9-80e91e764996 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:22.581383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf09f45-22dc-4c4d-b5d9-80e91e764996 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:22.581674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf09f45-22dc-4c4d-b5d9-80e91e764996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:22.582481 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17230e52-7d6a-48b8-bbc5-b336f7fccee8 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:22.623614 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-fbf09f45-22dc-4c4d-b5d9-80e91e764996 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:22.633058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-fbf09f45-22dc-4c4d-b5d9-80e91e764996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:22.716151 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1121/2241] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:22.722310 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf09f45-22dc-4c4d-b5d9-80e91e764996 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:22.725266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-fbf09f45-22dc-4c4d-b5d9-80e91e764996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:22.726668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdec480-02ee-482c-a648-9f1de787e680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:22.728175 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdec480-02ee-482c-a648-9f1de787e680 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:22.728856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdec480-02ee-482c-a648-9f1de787e680 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:22.729476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdec480-02ee-482c-a648-9f1de787e680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:22.731802 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2cdec480-02ee-482c-a648-9f1de787e680 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:22.793064 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf09f45-22dc-4c4d-b5d9-80e91e764996 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:22.798436 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda97d9b-5f62-48c6-9ae7-d5e36a2e9309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:22.799279 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda97d9b-5f62-48c6-9ae7-d5e36a2e9309 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:22.799779 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda97d9b-5f62-48c6-9ae7-d5e36a2e9309 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:22.800060 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda97d9b-5f62-48c6-9ae7-d5e36a2e9309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:22.814353 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda97d9b-5f62-48c6-9ae7-d5e36a2e9309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:22.815834 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda97d9b-5f62-48c6-9ae7-d5e36a2e9309 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:22.829176 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1122/2242] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:22.851416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdec480-02ee-482c-a648-9f1de787e680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:22.862419 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdec480-02ee-482c-a648-9f1de787e680 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:22.898996 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1121/2243] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:22 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:34:23.277198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda97d9b-5f62-48c6-9ae7-d5e36a2e9309 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:23.281689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-cda97d9b-5f62-48c6-9ae7-d5e36a2e9309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:23.300967 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda97d9b-5f62-48c6-9ae7-d5e36a2e9309 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:23.316055 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:23.317343 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:23.317343 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:23.318050 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf admin admin] PATH_INFO: `/v3/projects/5684b0dc6ed242a791b9afaaceac1828` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:23.320608 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5684b0dc6ed242a791b9afaaceac1828)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:23.329338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:23.417546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5684b0dc6ed242a791b9afaaceac1828', 'request_id': 'req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:23.428308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5684b0dc6ed242a791b9afaaceac1828', 'request_id': 'req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:23.436599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5684b0dc6ed242a791b9afaaceac1828', 'request_id': 'req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:23.455354 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf admin admin] The token cache is being invalidate because project 5684b0dc6ed242a791b9afaaceac1828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:34:23.455815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:23.456655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-e3bd6259-39c6-4d6f-bb83-b53a29f38abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:23.462586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1123/2244] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:34:23 2021] DELETE /identity/v3/projects/5684b0dc6ed242a791b9afaaceac1828 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:23.465035 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17529d-6f37-4fa8-a94d-ba3255af4a74 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:23.465325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17529d-6f37-4fa8-a94d-ba3255af4a74 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:23.465603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17529d-6f37-4fa8-a94d-ba3255af4a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:23.499906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-db17529d-6f37-4fa8-a94d-ba3255af4a74 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:23.501429 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-db17529d-6f37-4fa8-a94d-ba3255af4a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:23.631877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1122/2245] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:23.633170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ee5dd-7670-4852-92a3-97707e072016 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:23.633465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ee5dd-7670-4852-92a3-97707e072016 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:23.633750 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ee5dd-7670-4852-92a3-97707e072016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:23.657478 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-1b8ee5dd-7670-4852-92a3-97707e072016 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:23.658738 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-1b8ee5dd-7670-4852-92a3-97707e072016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:23.671690 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1124/2246] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:34:23.672867 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17529d-6f37-4fa8-a94d-ba3255af4a74 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:23.684939 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17529d-6f37-4fa8-a94d-ba3255af4a74 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:23.690349 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672931d1-b2b1-4843-bf53-80b936d8e1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:23.691374 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672931d1-b2b1-4843-bf53-80b936d8e1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:23.691873 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672931d1-b2b1-4843-bf53-80b936d8e1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:23.692460 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672931d1-b2b1-4843-bf53-80b936d8e1e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:23.693403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672931d1-b2b1-4843-bf53-80b936d8e1e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:34:23.694078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672931d1-b2b1-4843-bf53-80b936d8e1e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:23.697121 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672931d1-b2b1-4843-bf53-80b936d8e1e2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:23.720015 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1123/2247] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:34:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:34:23.724226 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ee5dd-7670-4852-92a3-97707e072016 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:23.737689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ee5dd-7670-4852-92a3-97707e072016 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:23.746570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b4b6c-e16a-4acc-8dab-78e7385be1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:23.747309 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b4b6c-e16a-4acc-8dab-78e7385be1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:23.747594 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b4b6c-e16a-4acc-8dab-78e7385be1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:23.747870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b4b6c-e16a-4acc-8dab-78e7385be1d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:23.748577 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b4b6c-e16a-4acc-8dab-78e7385be1d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:23.750715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b4b6c-e16a-4acc-8dab-78e7385be1d7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:23.806136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1125/2248] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:34:23 2021] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:23.807259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672931d1-b2b1-4843-bf53-80b936d8e1e2 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:23.819187 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672931d1-b2b1-4843-bf53-80b936d8e1e2 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:23.916947 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fb2c2-8d73-4601-ac5f-0005bbbb803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:23.918428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fb2c2-8d73-4601-ac5f-0005bbbb803c admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:23.918888 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fb2c2-8d73-4601-ac5f-0005bbbb803c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:23.919339 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fb2c2-8d73-4601-ac5f-0005bbbb803c admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:23.920196 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fb2c2-8d73-4601-ac5f-0005bbbb803c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:23.924824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fb2c2-8d73-4601-ac5f-0005bbbb803c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:23.968655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b4b6c-e16a-4acc-8dab-78e7385be1d7 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:23.971208 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1124/2249] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:34:23 2021] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:34:23.995124 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b4b6c-e16a-4acc-8dab-78e7385be1d7 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:24.000756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd813a-2586-4aa5-90b2-a8b8ca0c16c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:24.001600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd813a-2586-4aa5-90b2-a8b8ca0c16c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:24.002021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd813a-2586-4aa5-90b2-a8b8ca0c16c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:24.002412 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd813a-2586-4aa5-90b2-a8b8ca0c16c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:24.004262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd813a-2586-4aa5-90b2-a8b8ca0c16c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:24.012243 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd813a-2586-4aa5-90b2-a8b8ca0c16c1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:24.031058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1126/2250] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:23 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:24.035031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fb2c2-8d73-4601-ac5f-0005bbbb803c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:24.047879 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fb2c2-8d73-4601-ac5f-0005bbbb803c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:24.053886 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5613d7-fd62-4faa-a127-a3e3f5b1d269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:24.054551 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5613d7-fd62-4faa-a127-a3e3f5b1d269 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:24.054848 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5613d7-fd62-4faa-a127-a3e3f5b1d269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:24.055137 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5613d7-fd62-4faa-a127-a3e3f5b1d269 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:24.055914 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5613d7-fd62-4faa-a127-a3e3f5b1d269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:24.058630 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5613d7-fd62-4faa-a127-a3e3f5b1d269 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:24.092853 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd813a-2586-4aa5-90b2-a8b8ca0c16c1 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:24.093995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1125/2251] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:24 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:24.107604 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd813a-2586-4aa5-90b2-a8b8ca0c16c1 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:24.115703 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9ef65-6caf-4b9e-b269-f1ee90cbc2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:24.116713 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ef65-6caf-4b9e-b269-f1ee90cbc2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:24.116998 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ef65-6caf-4b9e-b269-f1ee90cbc2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:24.117273 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ef65-6caf-4b9e-b269-f1ee90cbc2d0 admin admin] PATH_INFO: `/v3/projects/b7dec70c7a01458e8f02c1eeae473343/users/dadfb594bfad48aab7308f7e2c19a28b/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:24.161846 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9ef65-6caf-4b9e-b269-f1ee90cbc2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7dec70c7a01458e8f02c1eeae473343, user_id=dadfb594bfad48aab7308f7e2c19a28b, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:24.173210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9ef65-6caf-4b9e-b269-f1ee90cbc2d0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:24.299255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1127/2252] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:24 2021] PUT /identity/v3/projects/b7dec70c7a01458e8f02c1eeae473343/users/dadfb594bfad48aab7308f7e2c19a28b/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:24.299381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516d432-18bf-4c25-afa4-5d138c09e89b None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:24.299381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516d432-18bf-4c25-afa4-5d138c09e89b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:24.299381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516d432-18bf-4c25-afa4-5d138c09e89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:24.367244 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-4516d432-18bf-4c25-afa4-5d138c09e89b None None] MFA Rules not processed for user `dadfb594bfad48aab7308f7e2c19a28b`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:24.368450 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4516d432-18bf-4c25-afa4-5d138c09e89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:24.551167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1126/2253] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:24 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:24.564945 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9ef65-6caf-4b9e-b269-f1ee90cbc2d0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:24.569996 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-68e9ef65-6caf-4b9e-b269-f1ee90cbc2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:24.661576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9ef65-6caf-4b9e-b269-f1ee90cbc2d0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:24.670725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e12fbf-f47b-4b6a-9d24-0cfd65684e57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:24.671872 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e12fbf-f47b-4b6a-9d24-0cfd65684e57 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:24.672377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e12fbf-f47b-4b6a-9d24-0cfd65684e57 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:24.675172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e12fbf-f47b-4b6a-9d24-0cfd65684e57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:24.698824 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e12fbf-f47b-4b6a-9d24-0cfd65684e57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:24.700968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e12fbf-f47b-4b6a-9d24-0cfd65684e57 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:24.715839 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1128/2254] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:24 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:24.762175 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516d432-18bf-4c25-afa4-5d138c09e89b None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:24.952944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516d432-18bf-4c25-afa4-5d138c09e89b None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:24.967479 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e42ac-b6df-4626-9f49-b6af8753903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:24.968565 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e42ac-b6df-4626-9f49-b6af8753903b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:24.968852 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e42ac-b6df-4626-9f49-b6af8753903b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:24.969128 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e42ac-b6df-4626-9f49-b6af8753903b admin admin] PATH_INFO: `/v3/users/dadfb594bfad48aab7308f7e2c19a28b` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:24.972530 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e42ac-b6df-4626-9f49-b6af8753903b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dadfb594bfad48aab7308f7e2c19a28b)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:24.980323 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e42ac-b6df-4626-9f49-b6af8753903b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:25.105720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0d8e42ac-b6df-4626-9f49-b6af8753903b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dadfb594bfad48aab7308f7e2c19a28b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:25.131661 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0d8e42ac-b6df-4626-9f49-b6af8753903b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dadfb594bfad48aab7308f7e2c19a28b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:25.148035 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0d8e42ac-b6df-4626-9f49-b6af8753903b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dadfb594bfad48aab7308f7e2c19a28b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:25.177643 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0d8e42ac-b6df-4626-9f49-b6af8753903b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dadfb594bfad48aab7308f7e2c19a28b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:25.178656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0d8e42ac-b6df-4626-9f49-b6af8753903b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dadfb594bfad48aab7308f7e2c19a28b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:25.195231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2f964-288a-4f00-aef9-e0f7b4336725 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:25.195487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2f964-288a-4f00-aef9-e0f7b4336725 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:25.195639 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1127/2255] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:34:24 2021] DELETE /identity/v3/users/dadfb594bfad48aab7308f7e2c19a28b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:25.196138 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2f964-288a-4f00-aef9-e0f7b4336725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:25.232654 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c7d2f964-288a-4f00-aef9-e0f7b4336725 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:25.234889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c7d2f964-288a-4f00-aef9-e0f7b4336725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:25.352890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1129/2256] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:25.369525 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e42ac-b6df-4626-9f49-b6af8753903b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:25.371434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0d8e42ac-b6df-4626-9f49-b6af8753903b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:25.501364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e42ac-b6df-4626-9f49-b6af8753903b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:25.514064 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12790bcb-1f27-4aa6-9529-a4e5e68a4c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:25.515036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790bcb-1f27-4aa6-9529-a4e5e68a4c69 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:25.515473 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790bcb-1f27-4aa6-9529-a4e5e68a4c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:25.516283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790bcb-1f27-4aa6-9529-a4e5e68a4c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:25.538858 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12790bcb-1f27-4aa6-9529-a4e5e68a4c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:25.540586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12790bcb-1f27-4aa6-9529-a4e5e68a4c69 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:25.568976 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1128/2257] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:26.546807 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2f964-288a-4f00-aef9-e0f7b4336725 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:26.548529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c7d2f964-288a-4f00-aef9-e0f7b4336725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:26.582172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2f964-288a-4f00-aef9-e0f7b4336725 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:26.601766 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a142b6d-fad7-4dbb-b1ca-9623104034d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:26.602943 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142b6d-fad7-4dbb-b1ca-9623104034d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:26.603433 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142b6d-fad7-4dbb-b1ca-9623104034d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:26.603947 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142b6d-fad7-4dbb-b1ca-9623104034d8 admin admin] PATH_INFO: `/v3/projects/b7dec70c7a01458e8f02c1eeae473343` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:26.605418 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a142b6d-fad7-4dbb-b1ca-9623104034d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7dec70c7a01458e8f02c1eeae473343)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:26.607647 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a142b6d-fad7-4dbb-b1ca-9623104034d8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:26.690635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4a142b6d-fad7-4dbb-b1ca-9623104034d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7dec70c7a01458e8f02c1eeae473343', 'request_id': 'req-4a142b6d-fad7-4dbb-b1ca-9623104034d8'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:26.701941 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4a142b6d-fad7-4dbb-b1ca-9623104034d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7dec70c7a01458e8f02c1eeae473343', 'request_id': 'req-4a142b6d-fad7-4dbb-b1ca-9623104034d8'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:26.709126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4a142b6d-fad7-4dbb-b1ca-9623104034d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7dec70c7a01458e8f02c1eeae473343', 'request_id': 'req-4a142b6d-fad7-4dbb-b1ca-9623104034d8'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:26.730182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4a142b6d-fad7-4dbb-b1ca-9623104034d8 admin admin] The token cache is being invalidate because project b7dec70c7a01458e8f02c1eeae473343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:34:26.730808 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4a142b6d-fad7-4dbb-b1ca-9623104034d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:26.731667 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4a142b6d-fad7-4dbb-b1ca-9623104034d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:26.733865 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1130/2258] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:34:26 2021] DELETE /identity/v3/projects/b7dec70c7a01458e8f02c1eeae473343 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:26.739652 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c28870-994f-4d2a-9b7f-126891af8b2e None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:26.740660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c28870-994f-4d2a-9b7f-126891af8b2e None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:26.741159 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c28870-994f-4d2a-9b7f-126891af8b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:26.763449 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-44c28870-994f-4d2a-9b7f-126891af8b2e None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:26.765415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-44c28870-994f-4d2a-9b7f-126891af8b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:26.845615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1129/2259] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:34:26.853447 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215db2a-6b54-4a30-927c-90c122e04f0f None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:26.853716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215db2a-6b54-4a30-927c-90c122e04f0f None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:26.854058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215db2a-6b54-4a30-927c-90c122e04f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:26.882748 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-0215db2a-6b54-4a30-927c-90c122e04f0f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:26.884291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0215db2a-6b54-4a30-927c-90c122e04f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:26.902912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1131/2260] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:34:26.909124 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c28870-994f-4d2a-9b7f-126891af8b2e None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:26.924645 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c28870-994f-4d2a-9b7f-126891af8b2e None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:26.934803 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3898fbd-a0bb-41e8-9193-8c0c30115787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:26.936001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3898fbd-a0bb-41e8-9193-8c0c30115787 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:26.936505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3898fbd-a0bb-41e8-9193-8c0c30115787 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:26.949082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3898fbd-a0bb-41e8-9193-8c0c30115787 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:26.950389 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3898fbd-a0bb-41e8-9193-8c0c30115787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:34:26.950864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3898fbd-a0bb-41e8-9193-8c0c30115787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:26.959762 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3898fbd-a0bb-41e8-9193-8c0c30115787 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:27.007826 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1130/2261] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:34:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:34:27.013318 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215db2a-6b54-4a30-927c-90c122e04f0f None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:27.035113 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215db2a-6b54-4a30-927c-90c122e04f0f None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:27.061114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3fc7c-6ec3-4dbb-b89a-a488558a7ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:27.062129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3fc7c-6ec3-4dbb-b89a-a488558a7ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:27.062584 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3fc7c-6ec3-4dbb-b89a-a488558a7ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:27.063511 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3fc7c-6ec3-4dbb-b89a-a488558a7ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:27.065449 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3fc7c-6ec3-4dbb-b89a-a488558a7ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:27.074890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3fc7c-6ec3-4dbb-b89a-a488558a7ef8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:27.209126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1132/2262] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:34:27 2021] POST /identity/v3/projects => generated 399 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:27.209414 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3898fbd-a0bb-41e8-9193-8c0c30115787 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:27.229855 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3898fbd-a0bb-41e8-9193-8c0c30115787 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:27.419722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd65d1-ed02-44ef-b3be-ea00b3b5d17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:27.420424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd65d1-ed02-44ef-b3be-ea00b3b5d17a admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:27.420713 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd65d1-ed02-44ef-b3be-ea00b3b5d17a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:27.420996 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd65d1-ed02-44ef-b3be-ea00b3b5d17a admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:27.421722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd65d1-ed02-44ef-b3be-ea00b3b5d17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:27.423724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd65d1-ed02-44ef-b3be-ea00b3b5d17a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:27.470251 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1131/2263] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:34:27 2021] POST /identity/v3/users => generated 300 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:34:27.474927 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3fc7c-6ec3-4dbb-b89a-a488558a7ef8 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:27.491652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3fc7c-6ec3-4dbb-b89a-a488558a7ef8 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:27.520887 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275c2a5-432c-47a9-b129-8416534256b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:27.520887 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c2a5-432c-47a9-b129-8416534256b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:27.524144 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c2a5-432c-47a9-b129-8416534256b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:27.524452 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c2a5-432c-47a9-b129-8416534256b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:27.525260 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275c2a5-432c-47a9-b129-8416534256b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:27.526919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275c2a5-432c-47a9-b129-8416534256b8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:27.578494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1133/2264] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:27 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:27.582669 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd65d1-ed02-44ef-b3be-ea00b3b5d17a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:27.595122 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd65d1-ed02-44ef-b3be-ea00b3b5d17a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:27.600645 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3cd49-a3e7-4f3f-8910-f323b981bbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:27.601565 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3cd49-a3e7-4f3f-8910-f323b981bbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:27.606149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3cd49-a3e7-4f3f-8910-f323b981bbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:27.606365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3cd49-a3e7-4f3f-8910-f323b981bbf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:27.607235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3cd49-a3e7-4f3f-8910-f323b981bbf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:27.609003 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3cd49-a3e7-4f3f-8910-f323b981bbf4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:27.631485 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1132/2265] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:27 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:27.636733 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275c2a5-432c-47a9-b129-8416534256b8 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:27.647549 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275c2a5-432c-47a9-b129-8416534256b8 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:27.666863 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62447184-c562-4aec-9b41-48e386abc659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:27.667931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447184-c562-4aec-9b41-48e386abc659 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:27.668064 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447184-c562-4aec-9b41-48e386abc659 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:27.668546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62447184-c562-4aec-9b41-48e386abc659 admin admin] PATH_INFO: `/v3/projects/56e40fe7633c49d0812bec3fa71a8b8a/users/899f519e4415499e8b6fd402ccda03bc/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:27.703843 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62447184-c562-4aec-9b41-48e386abc659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e40fe7633c49d0812bec3fa71a8b8a, user_id=899f519e4415499e8b6fd402ccda03bc, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:27.710631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62447184-c562-4aec-9b41-48e386abc659 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:27.746095 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1134/2266] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:27 2021] PUT /identity/v3/projects/56e40fe7633c49d0812bec3fa71a8b8a/users/899f519e4415499e8b6fd402ccda03bc/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:27.756496 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bdc21-bf64-48d4-bfd0-57d151622496 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:27.757857 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bdc21-bf64-48d4-bfd0-57d151622496 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:27.758326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bdc21-bf64-48d4-bfd0-57d151622496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:27.818151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-a68bdc21-bf64-48d4-bfd0-57d151622496 None None] MFA Rules not processed for user `899f519e4415499e8b6fd402ccda03bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:27.819582 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a68bdc21-bf64-48d4-bfd0-57d151622496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:28.177293 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1133/2267] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:27 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:28.210047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62447184-c562-4aec-9b41-48e386abc659 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:28.214474 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-62447184-c562-4aec-9b41-48e386abc659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:28.409419 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62447184-c562-4aec-9b41-48e386abc659 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:28.428204 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f53fa4-16ff-4a8c-9c7f-7dc6bc5e3435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:28.429451 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f53fa4-16ff-4a8c-9c7f-7dc6bc5e3435 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:28.429748 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f53fa4-16ff-4a8c-9c7f-7dc6bc5e3435 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:28.430027 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f53fa4-16ff-4a8c-9c7f-7dc6bc5e3435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:28.455928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f53fa4-16ff-4a8c-9c7f-7dc6bc5e3435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:28.462275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f53fa4-16ff-4a8c-9c7f-7dc6bc5e3435 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:28.512757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1135/2268] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:28 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:28.808234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bdc21-bf64-48d4-bfd0-57d151622496 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:28.811244 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a68bdc21-bf64-48d4-bfd0-57d151622496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:28.972947 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bdc21-bf64-48d4-bfd0-57d151622496 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:28.986851 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb8647-3243-4ed1-aa90-af436626945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:28.987759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb8647-3243-4ed1-aa90-af436626945b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:28.989151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb8647-3243-4ed1-aa90-af436626945b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:28.989465 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb8647-3243-4ed1-aa90-af436626945b admin admin] PATH_INFO: `/v3/users/ce9fc4f3ce4044f994fa9b5dbe4af396` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:28.993058 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb8647-3243-4ed1-aa90-af436626945b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9fc4f3ce4044f994fa9b5dbe4af396)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:28.999316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb8647-3243-4ed1-aa90-af436626945b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:29.130513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f1cb8647-3243-4ed1-aa90-af436626945b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9fc4f3ce4044f994fa9b5dbe4af396'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:29.141436 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f1cb8647-3243-4ed1-aa90-af436626945b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9fc4f3ce4044f994fa9b5dbe4af396'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:29.165490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f1cb8647-3243-4ed1-aa90-af436626945b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9fc4f3ce4044f994fa9b5dbe4af396'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:29.200360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f1cb8647-3243-4ed1-aa90-af436626945b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9fc4f3ce4044f994fa9b5dbe4af396'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:29.209811 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f1cb8647-3243-4ed1-aa90-af436626945b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9fc4f3ce4044f994fa9b5dbe4af396'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:29.235556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1134/2269] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:34:28 2021] DELETE /identity/v3/users/ce9fc4f3ce4044f994fa9b5dbe4af396 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:29.239737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1e9ea-a103-41b0-b243-0b2a24155c86 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:29.240713 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1e9ea-a103-41b0-b243-0b2a24155c86 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:29.241219 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1e9ea-a103-41b0-b243-0b2a24155c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:29.281000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-d3b1e9ea-a103-41b0-b243-0b2a24155c86 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:29.284586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d3b1e9ea-a103-41b0-b243-0b2a24155c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:29.502895 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1136/2270] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:34:29.527144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb8647-3243-4ed1-aa90-af436626945b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:29.529667 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f1cb8647-3243-4ed1-aa90-af436626945b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:29.743626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb8647-3243-4ed1-aa90-af436626945b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:29.750127 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d76e0-39e7-4550-a215-4cc6056cd994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:29.751071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d76e0-39e7-4550-a215-4cc6056cd994 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:29.751444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d76e0-39e7-4550-a215-4cc6056cd994 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:29.752311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d76e0-39e7-4550-a215-4cc6056cd994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:29.768528 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d76e0-39e7-4550-a215-4cc6056cd994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:29.770936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d76e0-39e7-4550-a215-4cc6056cd994 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:29.785198 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1135/2271] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:30.477579 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1e9ea-a103-41b0-b243-0b2a24155c86 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:30.481040 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d3b1e9ea-a103-41b0-b243-0b2a24155c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:30.514856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1e9ea-a103-41b0-b243-0b2a24155c86 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:30.520676 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e6832-491b-41f8-abeb-6b7fac5077ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:30.522757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6832-491b-41f8-abeb-6b7fac5077ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:30.523313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6832-491b-41f8-abeb-6b7fac5077ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:30.523836 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6832-491b-41f8-abeb-6b7fac5077ed admin admin] PATH_INFO: `/v3/projects/a41c642e07a44136bfaeca28253040d5` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:30.526195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e6832-491b-41f8-abeb-6b7fac5077ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41c642e07a44136bfaeca28253040d5)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:30.528513 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e6832-491b-41f8-abeb-6b7fac5077ed admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:30.722407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-738e6832-491b-41f8-abeb-6b7fac5077ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41c642e07a44136bfaeca28253040d5', 'request_id': 'req-738e6832-491b-41f8-abeb-6b7fac5077ed'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:30.739536 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-738e6832-491b-41f8-abeb-6b7fac5077ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41c642e07a44136bfaeca28253040d5', 'request_id': 'req-738e6832-491b-41f8-abeb-6b7fac5077ed'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:30.751236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-738e6832-491b-41f8-abeb-6b7fac5077ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41c642e07a44136bfaeca28253040d5', 'request_id': 'req-738e6832-491b-41f8-abeb-6b7fac5077ed'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:30.819312 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-738e6832-491b-41f8-abeb-6b7fac5077ed admin admin] The token cache is being invalidate because project a41c642e07a44136bfaeca28253040d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:34:30.819607 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-738e6832-491b-41f8-abeb-6b7fac5077ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:30.855964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-738e6832-491b-41f8-abeb-6b7fac5077ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:30.865359 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d76e0-39e7-4550-a215-4cc6056cd994 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:30.865964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1137/2272] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:34:30 2021] DELETE /identity/v3/projects/a41c642e07a44136bfaeca28253040d5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:30.897861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d76e0-39e7-4550-a215-4cc6056cd994 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:31.002505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9151e2-a050-412a-b2c9-47077eaa0b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:31.003445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9151e2-a050-412a-b2c9-47077eaa0b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:31.003738 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9151e2-a050-412a-b2c9-47077eaa0b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:31.004024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9151e2-a050-412a-b2c9-47077eaa0b6c admin admin] PATH_INFO: `/v3/users/3fc171848f7c45f0a86956e9bfab0cab` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:31.005478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9151e2-a050-412a-b2c9-47077eaa0b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc171848f7c45f0a86956e9bfab0cab)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:31.012033 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9151e2-a050-412a-b2c9-47077eaa0b6c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:31.044887 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede6ec8-c6de-4e16-9d73-6991fc5f3f09 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:31.044887 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede6ec8-c6de-4e16-9d73-6991fc5f3f09 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:31.045106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede6ec8-c6de-4e16-9d73-6991fc5f3f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:31.085904 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-aede6ec8-c6de-4e16-9d73-6991fc5f3f09 None None] MFA Rules not processed for user `88e46a4841c54de49b291afb3c2edbdd`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:31.087190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-aede6ec8-c6de-4e16-9d73-6991fc5f3f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:31.129404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2a9151e2-a050-412a-b2c9-47077eaa0b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc171848f7c45f0a86956e9bfab0cab'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:31.149684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2a9151e2-a050-412a-b2c9-47077eaa0b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc171848f7c45f0a86956e9bfab0cab'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:31.171674 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2a9151e2-a050-412a-b2c9-47077eaa0b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc171848f7c45f0a86956e9bfab0cab'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:31.199275 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2a9151e2-a050-412a-b2c9-47077eaa0b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc171848f7c45f0a86956e9bfab0cab'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:31.200148 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2a9151e2-a050-412a-b2c9-47077eaa0b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc171848f7c45f0a86956e9bfab0cab'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:31.211693 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1136/2273] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:34:30 2021] DELETE /identity/v3/users/3fc171848f7c45f0a86956e9bfab0cab => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:31.229791 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1138/2274] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:31 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:31.234665 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9151e2-a050-412a-b2c9-47077eaa0b6c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:31.236218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2a9151e2-a050-412a-b2c9-47077eaa0b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:31.374019 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9151e2-a050-412a-b2c9-47077eaa0b6c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:31.382653 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c5aa1-183b-4b18-8a90-84e630b2ba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:31.383283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c5aa1-183b-4b18-8a90-84e630b2ba33 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:31.383985 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c5aa1-183b-4b18-8a90-84e630b2ba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:31.383985 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c5aa1-183b-4b18-8a90-84e630b2ba33 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:31.385142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c5aa1-183b-4b18-8a90-84e630b2ba33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:31.390088 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c5aa1-183b-4b18-8a90-84e630b2ba33 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:31.439969 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1137/2275] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:34:31 2021] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:31.441549 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede6ec8-c6de-4e16-9d73-6991fc5f3f09 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:31.490456 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede6ec8-c6de-4e16-9d73-6991fc5f3f09 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:31.622439 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0e845-6f0d-40d4-bba3-15ed618c4f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:31.623223 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0e845-6f0d-40d4-bba3-15ed618c4f85 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:31.623512 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0e845-6f0d-40d4-bba3-15ed618c4f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:31.623792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0e845-6f0d-40d4-bba3-15ed618c4f85 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:31.625062 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0e845-6f0d-40d4-bba3-15ed618c4f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:31.626527 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0e845-6f0d-40d4-bba3-15ed618c4f85 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:31.665788 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1139/2276] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:34:31 2021] POST /identity/v3/users => generated 295 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:31.669035 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c5aa1-183b-4b18-8a90-84e630b2ba33 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:31.679898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c5aa1-183b-4b18-8a90-84e630b2ba33 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:31.685437 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba86978-caf3-40ae-a77a-997dc3be1f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:31.686116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba86978-caf3-40ae-a77a-997dc3be1f96 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:31.686393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba86978-caf3-40ae-a77a-997dc3be1f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:31.686660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba86978-caf3-40ae-a77a-997dc3be1f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:31.687743 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba86978-caf3-40ae-a77a-997dc3be1f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:31.689214 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba86978-caf3-40ae-a77a-997dc3be1f96 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:31.705280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1138/2277] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:31 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:31.714140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0e845-6f0d-40d4-bba3-15ed618c4f85 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:31.724285 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba86978-caf3-40ae-a77a-997dc3be1f96 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:31.727367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8ba86978-caf3-40ae-a77a-997dc3be1f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:31.742050 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0e845-6f0d-40d4-bba3-15ed618c4f85 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:31.747634 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba86978-caf3-40ae-a77a-997dc3be1f96 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:31.753545 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:31.754563 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:31.754868 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:31.755260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013 admin admin] PATH_INFO: `/v3/projects/fdc0654ed23e4836a6760e31df58b02b` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:31.756543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc0654ed23e4836a6760e31df58b02b)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:31.763211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:31.766272 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a620b-8682-43f8-a3bb-3369cbd5d147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:31.767323 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a620b-8682-43f8-a3bb-3369cbd5d147 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:31.767710 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a620b-8682-43f8-a3bb-3369cbd5d147 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:31.769881 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a620b-8682-43f8-a3bb-3369cbd5d147 admin admin] PATH_INFO: `/v3/projects/47014035fda94779a6149e00ae441139/users/c92d8d3de2654e378ccd034c9b25c79e/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:31.828509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a620b-8682-43f8-a3bb-3369cbd5d147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47014035fda94779a6149e00ae441139, user_id=c92d8d3de2654e378ccd034c9b25c79e, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:31.833225 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a620b-8682-43f8-a3bb-3369cbd5d147 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:31.843390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc0654ed23e4836a6760e31df58b02b', 'request_id': 'req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:31.854418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc0654ed23e4836a6760e31df58b02b', 'request_id': 'req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:31.865222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc0654ed23e4836a6760e31df58b02b', 'request_id': 'req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:31.869665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1140/2278] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:31 2021] PUT /identity/v3/projects/47014035fda94779a6149e00ae441139/users/c92d8d3de2654e378ccd034c9b25c79e/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:34:31.873969 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a620b-8682-43f8-a3bb-3369cbd5d147 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:31.882989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013 admin admin] The token cache is being invalidate because project fdc0654ed23e4836a6760e31df58b02b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:34:31.883562 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:31.884005 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0ba0ede6-d2b4-4ea1-9a32-2fb9c6c8e013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:31.887174 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1139/2279] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:34:31 2021] DELETE /identity/v3/projects/fdc0654ed23e4836a6760e31df58b02b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:31.893788 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707afd12-27d2-440f-a29c-d97846a65810 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:31.894084 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707afd12-27d2-440f-a29c-d97846a65810 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:31.894372 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707afd12-27d2-440f-a29c-d97846a65810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:31.939979 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-707afd12-27d2-440f-a29c-d97846a65810 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:31.941234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-707afd12-27d2-440f-a29c-d97846a65810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:31.973407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a620b-8682-43f8-a3bb-3369cbd5d147 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:31.979820 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4eb262-b14e-4563-87f2-0aadc4bfdf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:31.980614 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4eb262-b14e-4563-87f2-0aadc4bfdf86 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:31.981085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4eb262-b14e-4563-87f2-0aadc4bfdf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:31.981376 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4eb262-b14e-4563-87f2-0aadc4bfdf86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:31.982123 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4eb262-b14e-4563-87f2-0aadc4bfdf86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:31.984027 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4eb262-b14e-4563-87f2-0aadc4bfdf86 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:32.006896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1141/2280] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:31 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:32.011768 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4eb262-b14e-4563-87f2-0aadc4bfdf86 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:32.013800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7b4eb262-b14e-4563-87f2-0aadc4bfdf86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:32.044011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4eb262-b14e-4563-87f2-0aadc4bfdf86 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:32.062056 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb09002-e8ef-42d3-b53d-92b28bc40f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:32.064977 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb09002-e8ef-42d3-b53d-92b28bc40f07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:32.066048 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb09002-e8ef-42d3-b53d-92b28bc40f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:32.066565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb09002-e8ef-42d3-b53d-92b28bc40f07 admin admin] PATH_INFO: `/v3/projects/47014035fda94779a6149e00ae441139/users/c92d8d3de2654e378ccd034c9b25c79e/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:32.070912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb09002-e8ef-42d3-b53d-92b28bc40f07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47014035fda94779a6149e00ae441139, user_id=c92d8d3de2654e378ccd034c9b25c79e, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:32.078430 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb09002-e8ef-42d3-b53d-92b28bc40f07 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:32.122304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1142/2281] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:32 2021] PUT /identity/v3/projects/47014035fda94779a6149e00ae441139/users/c92d8d3de2654e378ccd034c9b25c79e/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:32.124789 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1140/2282] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:34:32.142050 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47cd3b-e0f0-4153-b14b-8ea3ca156f40 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:32.142349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47cd3b-e0f0-4153-b14b-8ea3ca156f40 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:32.142648 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47cd3b-e0f0-4153-b14b-8ea3ca156f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:32.167602 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-3a47cd3b-e0f0-4153-b14b-8ea3ca156f40 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:32.168609 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3a47cd3b-e0f0-4153-b14b-8ea3ca156f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:32.316089 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1143/2283] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:32.320100 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707afd12-27d2-440f-a29c-d97846a65810 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:32.337027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707afd12-27d2-440f-a29c-d97846a65810 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:32.347249 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0635e28-2be4-4d51-a113-0992d4049152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:32.348025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635e28-2be4-4d51-a113-0992d4049152 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:32.348391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635e28-2be4-4d51-a113-0992d4049152 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:32.348776 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635e28-2be4-4d51-a113-0992d4049152 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:32.350080 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635e28-2be4-4d51-a113-0992d4049152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:34:32.352178 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635e28-2be4-4d51-a113-0992d4049152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:32.355752 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635e28-2be4-4d51-a113-0992d4049152 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:32.371105 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1141/2284] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:34:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:34:32.375890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47cd3b-e0f0-4153-b14b-8ea3ca156f40 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:32.387315 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47cd3b-e0f0-4153-b14b-8ea3ca156f40 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:32.393000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec055a-6ea1-4433-916a-53129ef7a988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:32.393995 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec055a-6ea1-4433-916a-53129ef7a988 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:32.394581 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec055a-6ea1-4433-916a-53129ef7a988 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:32.395111 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec055a-6ea1-4433-916a-53129ef7a988 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:32.396002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec055a-6ea1-4433-916a-53129ef7a988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:32.398178 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec055a-6ea1-4433-916a-53129ef7a988 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:32.437440 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1144/2285] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:34:32 2021] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:32.442227 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0635e28-2be4-4d51-a113-0992d4049152 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:32.456005 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0635e28-2be4-4d51-a113-0992d4049152 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:32.568533 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a919c-6e76-4649-b3ae-7a65f80adadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:32.569286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a919c-6e76-4649-b3ae-7a65f80adadc admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:32.569763 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a919c-6e76-4649-b3ae-7a65f80adadc admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:32.571189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a919c-6e76-4649-b3ae-7a65f80adadc admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:32.573122 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a919c-6e76-4649-b3ae-7a65f80adadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:32.576126 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a919c-6e76-4649-b3ae-7a65f80adadc admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:32.609473 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1142/2286] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:34:32 2021] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:32.613307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec055a-6ea1-4433-916a-53129ef7a988 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:32.623760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec055a-6ea1-4433-916a-53129ef7a988 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:32.632841 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdda4a1-61d7-4548-bda7-9432550c981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:32.633792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdda4a1-61d7-4548-bda7-9432550c981b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:32.634274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdda4a1-61d7-4548-bda7-9432550c981b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:32.635346 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdda4a1-61d7-4548-bda7-9432550c981b admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:32.636252 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdda4a1-61d7-4548-bda7-9432550c981b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:32.638073 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdda4a1-61d7-4548-bda7-9432550c981b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:32.653393 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1145/2287] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:32 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:32.657628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a919c-6e76-4649-b3ae-7a65f80adadc admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:32.668172 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a919c-6e76-4649-b3ae-7a65f80adadc admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:32.674386 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b1c58-536a-4614-ab34-c1fb135f240b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:32.675090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b1c58-536a-4614-ab34-c1fb135f240b admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:32.675373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b1c58-536a-4614-ab34-c1fb135f240b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:32.675651 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b1c58-536a-4614-ab34-c1fb135f240b admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:32.676379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b1c58-536a-4614-ab34-c1fb135f240b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:32.677981 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b1c58-536a-4614-ab34-c1fb135f240b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:32.691640 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1143/2288] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:32 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:34:32.696037 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdda4a1-61d7-4548-bda7-9432550c981b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:32.707683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdda4a1-61d7-4548-bda7-9432550c981b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:32.712541 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d3005-6a99-45e2-8514-d3c8987525c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:32.713575 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3005-6a99-45e2-8514-d3c8987525c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:32.713925 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3005-6a99-45e2-8514-d3c8987525c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:32.715120 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3005-6a99-45e2-8514-d3c8987525c9 admin admin] PATH_INFO: `/v3/projects/f998d36bd41c4605924f21792cadd716/users/138d237c2016443b8307c47832724eb2/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:32.742704 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d3005-6a99-45e2-8514-d3c8987525c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f998d36bd41c4605924f21792cadd716, user_id=138d237c2016443b8307c47832724eb2, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:32.747557 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d3005-6a99-45e2-8514-d3c8987525c9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:32.770890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1146/2289] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:32 2021] PUT /identity/v3/projects/f998d36bd41c4605924f21792cadd716/users/138d237c2016443b8307c47832724eb2/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:34:32.783282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0fa5-8404-499b-8d64-c714d6306ad3 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:32.783665 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0fa5-8404-499b-8d64-c714d6306ad3 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:32.783866 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0fa5-8404-499b-8d64-c714d6306ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:32.817320 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-a57b0fa5-8404-499b-8d64-c714d6306ad3 None None] MFA Rules not processed for user `138d237c2016443b8307c47832724eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:32.818629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a57b0fa5-8404-499b-8d64-c714d6306ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:32.838559 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28863cd4-c778-491d-90bf-5462be06da71 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:32.839183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28863cd4-c778-491d-90bf-5462be06da71 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:32.839617 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28863cd4-c778-491d-90bf-5462be06da71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:32.862541 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-28863cd4-c778-491d-90bf-5462be06da71 None None] MFA Rules not processed for user `1cfb6806de1c4f79bf7dd4aaf8b71aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:32.864088 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-28863cd4-c778-491d-90bf-5462be06da71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:32.904786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1144/2290] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:32 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:32.909031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0fa5-8404-499b-8d64-c714d6306ad3 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:32.941564 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1147/2291] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:32 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:34:32.985379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0fa5-8404-499b-8d64-c714d6306ad3 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:32.991584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25273ecd-7189-4ea2-b16d-bf5056b3a36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:32.992289 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273ecd-7189-4ea2-b16d-bf5056b3a36e admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:32.992647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273ecd-7189-4ea2-b16d-bf5056b3a36e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:32.992977 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273ecd-7189-4ea2-b16d-bf5056b3a36e admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:32.993770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25273ecd-7189-4ea2-b16d-bf5056b3a36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:32.995789 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25273ecd-7189-4ea2-b16d-bf5056b3a36e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:33.033459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1145/2292] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:34:32 2021] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:33.035832 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28863cd4-c778-491d-90bf-5462be06da71 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:33.048991 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28863cd4-c778-491d-90bf-5462be06da71 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:33.195327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f158489-850a-4eee-999f-edcf51be47ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:33.196283 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f158489-850a-4eee-999f-edcf51be47ee admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:33.196724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f158489-850a-4eee-999f-edcf51be47ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:33.197689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f158489-850a-4eee-999f-edcf51be47ee admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:33.198641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f158489-850a-4eee-999f-edcf51be47ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:33.200740 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f158489-850a-4eee-999f-edcf51be47ee admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:33.253312 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1148/2293] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:34:33 2021] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:34:33.254405 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25273ecd-7189-4ea2-b16d-bf5056b3a36e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:33.270312 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25273ecd-7189-4ea2-b16d-bf5056b3a36e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:33.285408 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c85a5e-90ee-4909-b8cd-a6c0f1f2e098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:33.286004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85a5e-90ee-4909-b8cd-a6c0f1f2e098 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:33.287551 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85a5e-90ee-4909-b8cd-a6c0f1f2e098 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:33.289753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85a5e-90ee-4909-b8cd-a6c0f1f2e098 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:33.290561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c85a5e-90ee-4909-b8cd-a6c0f1f2e098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:33.293283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c85a5e-90ee-4909-b8cd-a6c0f1f2e098 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:33.311661 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1146/2294] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:33 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:34:33.314823 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f158489-850a-4eee-999f-edcf51be47ee admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:33.338792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f158489-850a-4eee-999f-edcf51be47ee admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:33.353623 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60206d9-98bc-49fd-b871-5b529044059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:33.355008 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60206d9-98bc-49fd-b871-5b529044059e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:33.355468 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60206d9-98bc-49fd-b871-5b529044059e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:33.355896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60206d9-98bc-49fd-b871-5b529044059e admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:33.356791 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60206d9-98bc-49fd-b871-5b529044059e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:33.358588 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60206d9-98bc-49fd-b871-5b529044059e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:33.378720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1149/2295] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:33 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:33.382877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c85a5e-90ee-4909-b8cd-a6c0f1f2e098 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:33.397764 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c85a5e-90ee-4909-b8cd-a6c0f1f2e098 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:33.419543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617eebae-a8dc-4806-8978-7eaf0c53d6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:33.421154 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eebae-a8dc-4806-8978-7eaf0c53d6b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:33.421606 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eebae-a8dc-4806-8978-7eaf0c53d6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:33.422047 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eebae-a8dc-4806-8978-7eaf0c53d6b0 admin admin] PATH_INFO: `/v3/projects/c25106266e224a788bda76907515d690/users/cbb371a4ede84d9c97854c94fbf9f297/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:33.439847 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617eebae-a8dc-4806-8978-7eaf0c53d6b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25106266e224a788bda76907515d690, user_id=cbb371a4ede84d9c97854c94fbf9f297, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:33.442990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617eebae-a8dc-4806-8978-7eaf0c53d6b0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:33.470009 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1147/2296] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:33 2021] PUT /identity/v3/projects/c25106266e224a788bda76907515d690/users/cbb371a4ede84d9c97854c94fbf9f297/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:33.473671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a68f78-6682-42a0-83e8-27a64884c0f0 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:33.474425 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a68f78-6682-42a0-83e8-27a64884c0f0 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:33.475444 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a68f78-6682-42a0-83e8-27a64884c0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:33.505886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-84a68f78-6682-42a0-83e8-27a64884c0f0 None None] MFA Rules not processed for user `cbb371a4ede84d9c97854c94fbf9f297`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:33.507416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-84a68f78-6682-42a0-83e8-27a64884c0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:33.613584 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1150/2297] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:33 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:33.614689 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617eebae-a8dc-4806-8978-7eaf0c53d6b0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:33.768065 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617eebae-a8dc-4806-8978-7eaf0c53d6b0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:33.775546 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1253a-d08d-4a2a-bdd4-42a427a21985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:33.776357 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1253a-d08d-4a2a-bdd4-42a427a21985 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:33.776750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1253a-d08d-4a2a-bdd4-42a427a21985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:33.777137 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1253a-d08d-4a2a-bdd4-42a427a21985 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:33.777944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1253a-d08d-4a2a-bdd4-42a427a21985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:33.780168 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1253a-d08d-4a2a-bdd4-42a427a21985 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:33.814093 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1148/2298] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:34:33 2021] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:33.817827 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a68f78-6682-42a0-83e8-27a64884c0f0 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:33.835924 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a68f78-6682-42a0-83e8-27a64884c0f0 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:34.004085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398544b9-2fda-4da2-8b72-4b65923f7abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:34.004768 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398544b9-2fda-4da2-8b72-4b65923f7abc admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:34.005053 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398544b9-2fda-4da2-8b72-4b65923f7abc admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:34.005328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398544b9-2fda-4da2-8b72-4b65923f7abc admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:34.006015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398544b9-2fda-4da2-8b72-4b65923f7abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:34.008254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398544b9-2fda-4da2-8b72-4b65923f7abc admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:34.049557 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1151/2299] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:34:33 2021] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:34.053522 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1253a-d08d-4a2a-bdd4-42a427a21985 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:34.068561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1253a-d08d-4a2a-bdd4-42a427a21985 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:34.074710 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976173cb-5486-4899-97ea-260465c07d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:34.075749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976173cb-5486-4899-97ea-260465c07d00 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:34.076197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976173cb-5486-4899-97ea-260465c07d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:34.076649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976173cb-5486-4899-97ea-260465c07d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:34.077590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976173cb-5486-4899-97ea-260465c07d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:34.080154 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976173cb-5486-4899-97ea-260465c07d00 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:34.101423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398544b9-2fda-4da2-8b72-4b65923f7abc admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:34.103565 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1149/2300] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:34 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:34.127757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398544b9-2fda-4da2-8b72-4b65923f7abc admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:34.150589 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940518e-3df9-4575-a65b-ab6389c78011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:34.152003 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940518e-3df9-4575-a65b-ab6389c78011 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:34.152389 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940518e-3df9-4575-a65b-ab6389c78011 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:34.152869 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940518e-3df9-4575-a65b-ab6389c78011 admin admin] PATH_INFO: `/v3/projects/0ae73c1bbc0a4697b2c0acf758f94b7c/users/cf20c31ac47f4b8d9268fc7d4415b559/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:34.172323 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940518e-3df9-4575-a65b-ab6389c78011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae73c1bbc0a4697b2c0acf758f94b7c, user_id=cf20c31ac47f4b8d9268fc7d4415b559, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:34.175145 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940518e-3df9-4575-a65b-ab6389c78011 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:34.199455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1152/2301] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:34 2021] PUT /identity/v3/projects/0ae73c1bbc0a4697b2c0acf758f94b7c/users/cf20c31ac47f4b8d9268fc7d4415b559/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:34.199724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976173cb-5486-4899-97ea-260465c07d00 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:34.218920 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976173cb-5486-4899-97ea-260465c07d00 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:34.316102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b004d7-3e49-4ada-8a41-dd5e197b128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:34.316700 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b004d7-3e49-4ada-8a41-dd5e197b128c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:34.317033 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b004d7-3e49-4ada-8a41-dd5e197b128c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:34.317680 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b004d7-3e49-4ada-8a41-dd5e197b128c admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:34.319172 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b004d7-3e49-4ada-8a41-dd5e197b128c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:34.321169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b004d7-3e49-4ada-8a41-dd5e197b128c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:34.338920 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1150/2302] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:34 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:34:34.343202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940518e-3df9-4575-a65b-ab6389c78011 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:34.357763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940518e-3df9-4575-a65b-ab6389c78011 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:34.381823 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a73ebc-cfa9-4c30-9bff-df5f98da4cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:34.383087 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a73ebc-cfa9-4c30-9bff-df5f98da4cde admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:34.383641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a73ebc-cfa9-4c30-9bff-df5f98da4cde admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:34.384153 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a73ebc-cfa9-4c30-9bff-df5f98da4cde admin admin] PATH_INFO: `/v3/projects/0ae73c1bbc0a4697b2c0acf758f94b7c/users/cf20c31ac47f4b8d9268fc7d4415b559/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:34.393185 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a73ebc-cfa9-4c30-9bff-df5f98da4cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae73c1bbc0a4697b2c0acf758f94b7c, user_id=cf20c31ac47f4b8d9268fc7d4415b559, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:34.395968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a73ebc-cfa9-4c30-9bff-df5f98da4cde admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:34.415116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1153/2303] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:34 2021] PUT /identity/v3/projects/0ae73c1bbc0a4697b2c0acf758f94b7c/users/cf20c31ac47f4b8d9268fc7d4415b559/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:34.426587 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaf22e-a9f0-4347-b267-7fb0545622ee None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:34.427233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaf22e-a9f0-4347-b267-7fb0545622ee None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:34.427665 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaf22e-a9f0-4347-b267-7fb0545622ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:34.486061 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-60aaf22e-a9f0-4347-b267-7fb0545622ee None None] MFA Rules not processed for user `cf20c31ac47f4b8d9268fc7d4415b559`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:34.487454 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-60aaf22e-a9f0-4347-b267-7fb0545622ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:34.606542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1151/2304] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:34 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:34.619139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a73ebc-cfa9-4c30-9bff-df5f98da4cde admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:34.620866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-83a73ebc-cfa9-4c30-9bff-df5f98da4cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:34.709737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a73ebc-cfa9-4c30-9bff-df5f98da4cde admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:34.715861 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5674018-36af-4fb6-83ce-f29d6d603a95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:34.717568 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5674018-36af-4fb6-83ce-f29d6d603a95 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:34.718043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5674018-36af-4fb6-83ce-f29d6d603a95 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:34.728994 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5674018-36af-4fb6-83ce-f29d6d603a95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:34.858765 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5674018-36af-4fb6-83ce-f29d6d603a95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:34.860487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5674018-36af-4fb6-83ce-f29d6d603a95 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:34.888765 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1154/2305] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:34 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:38.330156 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde5ded-6dea-479c-885f-8201b6026b3a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:38.330811 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde5ded-6dea-479c-885f-8201b6026b3a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:38.330811 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde5ded-6dea-479c-885f-8201b6026b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:38.388808 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-4dde5ded-6dea-479c-885f-8201b6026b3a None None] MFA Rules not processed for user `f6af4c462c6347ff8abbcc8770874b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:38.390271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4dde5ded-6dea-479c-885f-8201b6026b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:38.505932 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1152/2306] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Nov 16 00:34:38 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:38.522655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5674018-36af-4fb6-83ce-f29d6d603a95 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:38.525425 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e5674018-36af-4fb6-83ce-f29d6d603a95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:38.622353 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5674018-36af-4fb6-83ce-f29d6d603a95 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:38.628688 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0d5f-ffcd-4ba3-aa34-5a2294c2976e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac32c6730654a889472a3bad95374bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:38.629713 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0d5f-ffcd-4ba3-aa34-5a2294c2976e service swift] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:38.630194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0d5f-ffcd-4ba3-aa34-5a2294c2976e service swift] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:38.630682 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0d5f-ffcd-4ba3-aa34-5a2294c2976e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:38.642887 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f0d5f-ffcd-4ba3-aa34-5a2294c2976e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:38.644528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f0d5f-ffcd-4ba3-aa34-5a2294c2976e service swift] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:38.673137 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1155/2307] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Nov 16 00:34:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 00:34:38.699132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1b1c9-1be1-4304-9ebe-758ff4d733da None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:38.699434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1b1c9-1be1-4304-9ebe-758ff4d733da None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:38.699715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1b1c9-1be1-4304-9ebe-758ff4d733da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:38.842147 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-63c1b1c9-1be1-4304-9ebe-758ff4d733da None None] MFA Rules not processed for user `c92d8d3de2654e378ccd034c9b25c79e`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:38.843489 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-63c1b1c9-1be1-4304-9ebe-758ff4d733da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:39.069158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0d5f-ffcd-4ba3-aa34-5a2294c2976e service swift] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:39.087992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0d5f-ffcd-4ba3-aa34-5a2294c2976e service swift] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:39.095040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1153/2308] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:38 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:39.107550 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6d935-de65-487c-b2f7-295b830eee80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:39.108365 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d935-de65-487c-b2f7-295b830eee80 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:39.108822 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d935-de65-487c-b2f7-295b830eee80 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:39.109206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d935-de65-487c-b2f7-295b830eee80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:39.240875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6d935-de65-487c-b2f7-295b830eee80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:39.242548 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6d935-de65-487c-b2f7-295b830eee80 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:39.324287 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1156/2309] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:39 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:39.406393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1b1c9-1be1-4304-9ebe-758ff4d733da None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:39.408275 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-63c1b1c9-1be1-4304-9ebe-758ff4d733da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:39.600886 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1b1c9-1be1-4304-9ebe-758ff4d733da None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:39.611188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4cbbf-79ec-4fd1-bc0a-ac535c120d2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:39.612844 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4cbbf-79ec-4fd1-bc0a-ac535c120d2b service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:39.613359 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4cbbf-79ec-4fd1-bc0a-ac535c120d2b service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:39.613983 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4cbbf-79ec-4fd1-bc0a-ac535c120d2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:39.616557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d5d4cbbf-79ec-4fd1-bc0a-ac535c120d2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:39.733199 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4cbbf-79ec-4fd1-bc0a-ac535c120d2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:39.736356 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4cbbf-79ec-4fd1-bc0a-ac535c120d2b service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:39.763958 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1154/2310] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:39 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:39.817846 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6d935-de65-487c-b2f7-295b830eee80 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:39.820261 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0cb6d935-de65-487c-b2f7-295b830eee80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:39.889573 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4cbbf-79ec-4fd1-bc0a-ac535c120d2b service nova] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:39.891313 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d5d4cbbf-79ec-4fd1-bc0a-ac535c120d2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:40.028900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6d935-de65-487c-b2f7-295b830eee80 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:40.040893 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550f7a1-38b2-4a3a-8945-da439edc6183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:40.041818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550f7a1-38b2-4a3a-8945-da439edc6183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:40.042957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550f7a1-38b2-4a3a-8945-da439edc6183 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:40.043569 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550f7a1-38b2-4a3a-8945-da439edc6183 admin admin] PATH_INFO: `/v3/users/79dcae6d1b1048569f7195f5cb0446e3` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:40.047555 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550f7a1-38b2-4a3a-8945-da439edc6183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79dcae6d1b1048569f7195f5cb0446e3)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:40.049699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550f7a1-38b2-4a3a-8945-da439edc6183 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:40.070483 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4cbbf-79ec-4fd1-bc0a-ac535c120d2b service nova] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:40.082008 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5195e-ff5e-4ccb-a1a9-ec984202ceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:40.086732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5195e-ff5e-4ccb-a1a9-ec984202ceed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:40.088021 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5195e-ff5e-4ccb-a1a9-ec984202ceed admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:40.088548 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5195e-ff5e-4ccb-a1a9-ec984202ceed admin admin] PATH_INFO: `/v3/users/899f519e4415499e8b6fd402ccda03bc` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:40.091989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5195e-ff5e-4ccb-a1a9-ec984202ceed admin admin] RBAC: Authorizing `identity:delete_user(user_id=899f519e4415499e8b6fd402ccda03bc)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:40.100708 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5195e-ff5e-4ccb-a1a9-ec984202ceed admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:40.130941 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c550f7a1-38b2-4a3a-8945-da439edc6183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79dcae6d1b1048569f7195f5cb0446e3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:40.140567 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c550f7a1-38b2-4a3a-8945-da439edc6183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79dcae6d1b1048569f7195f5cb0446e3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:40.141796 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c550f7a1-38b2-4a3a-8945-da439edc6183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79dcae6d1b1048569f7195f5cb0446e3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:40.169338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c550f7a1-38b2-4a3a-8945-da439edc6183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79dcae6d1b1048569f7195f5cb0446e3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:40.170456 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c550f7a1-38b2-4a3a-8945-da439edc6183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79dcae6d1b1048569f7195f5cb0446e3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:40.190594 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1157/2311] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:34:39 2021] DELETE /identity/v3/users/79dcae6d1b1048569f7195f5cb0446e3 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:40.192712 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccfbf8-4aa5-4e02-9581-ba5de2ce2b83 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:40.194471 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccfbf8-4aa5-4e02-9581-ba5de2ce2b83 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:40.195155 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccfbf8-4aa5-4e02-9581-ba5de2ce2b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:40.238203 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-adb5195e-ff5e-4ccb-a1a9-ec984202ceed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899f519e4415499e8b6fd402ccda03bc'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:40.239445 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-44ccfbf8-4aa5-4e02-9581-ba5de2ce2b83 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:40.240803 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-44ccfbf8-4aa5-4e02-9581-ba5de2ce2b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:40.260618 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-adb5195e-ff5e-4ccb-a1a9-ec984202ceed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899f519e4415499e8b6fd402ccda03bc'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:40.292234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-adb5195e-ff5e-4ccb-a1a9-ec984202ceed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899f519e4415499e8b6fd402ccda03bc'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:40.321629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-adb5195e-ff5e-4ccb-a1a9-ec984202ceed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899f519e4415499e8b6fd402ccda03bc'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:40.323292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-adb5195e-ff5e-4ccb-a1a9-ec984202ceed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899f519e4415499e8b6fd402ccda03bc'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:40.336121 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1155/2312] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:34:39 2021] DELETE /identity/v3/users/899f519e4415499e8b6fd402ccda03bc => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:34:40.340843 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aa118-2599-4fd3-a099-12d428c9662b None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:40.341511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aa118-2599-4fd3-a099-12d428c9662b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:40.342313 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aa118-2599-4fd3-a099-12d428c9662b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:40.381831 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-ad9aa118-2599-4fd3-a099-12d428c9662b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:40.383773 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ad9aa118-2599-4fd3-a099-12d428c9662b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:40.426074 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1158/2313] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:40.433727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccfbf8-4aa5-4e02-9581-ba5de2ce2b83 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:40.441936 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-44ccfbf8-4aa5-4e02-9581-ba5de2ce2b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:40.466819 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1156/2314] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:40.471947 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aa118-2599-4fd3-a099-12d428c9662b None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:40.475590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ad9aa118-2599-4fd3-a099-12d428c9662b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:40.560304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccfbf8-4aa5-4e02-9581-ba5de2ce2b83 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:40.601379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aa118-2599-4fd3-a099-12d428c9662b None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:40.610613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770a5ba-3e54-43b4-8243-f8c9d558efc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:40.612060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770a5ba-3e54-43b4-8243-f8c9d558efc9 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:40.612558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770a5ba-3e54-43b4-8243-f8c9d558efc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:40.613401 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770a5ba-3e54-43b4-8243-f8c9d558efc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:40.617341 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-5770a5ba-3e54-43b4-8243-f8c9d558efc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:40.624760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b38405-a4af-4061-acf2-599ebdec4056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:40.625863 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b38405-a4af-4061-acf2-599ebdec4056 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:40.626156 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b38405-a4af-4061-acf2-599ebdec4056 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:40.626437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b38405-a4af-4061-acf2-599ebdec4056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:40.639845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b38405-a4af-4061-acf2-599ebdec4056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:40.641723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b38405-a4af-4061-acf2-599ebdec4056 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:40.656578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1159/2315] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:34:40.657186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b38405-a4af-4061-acf2-599ebdec4056 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:40.670061 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b38405-a4af-4061-acf2-599ebdec4056 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:40.695715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7971a28-b046-481b-916b-a0a23494dc26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:40.700138 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7971a28-b046-481b-916b-a0a23494dc26 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:40.701012 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7971a28-b046-481b-916b-a0a23494dc26 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:40.702472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7971a28-b046-481b-916b-a0a23494dc26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:40.729396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7971a28-b046-481b-916b-a0a23494dc26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:40.733541 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7971a28-b046-481b-916b-a0a23494dc26 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:40.735840 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770a5ba-3e54-43b4-8243-f8c9d558efc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:40.740041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770a5ba-3e54-43b4-8243-f8c9d558efc9 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:40.756078 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1160/2316] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:40.758359 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1157/2317] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:40 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:41.482816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7971a28-b046-481b-916b-a0a23494dc26 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:41.484924 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e7971a28-b046-481b-916b-a0a23494dc26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:41.506305 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7971a28-b046-481b-916b-a0a23494dc26 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:41.518930 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b45324-50c3-4642-bbec-aece892c471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:41.520229 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b45324-50c3-4642-bbec-aece892c471d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:41.520614 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b45324-50c3-4642-bbec-aece892c471d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:41.520916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b45324-50c3-4642-bbec-aece892c471d admin admin] PATH_INFO: `/v3/projects/56e40fe7633c49d0812bec3fa71a8b8a` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:41.523147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b45324-50c3-4642-bbec-aece892c471d admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e40fe7633c49d0812bec3fa71a8b8a)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:41.525155 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b45324-50c3-4642-bbec-aece892c471d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:41.654017 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-55b45324-50c3-4642-bbec-aece892c471d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e40fe7633c49d0812bec3fa71a8b8a', 'request_id': 'req-55b45324-50c3-4642-bbec-aece892c471d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:41.688090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770a5ba-3e54-43b4-8243-f8c9d558efc9 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:41.689853 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-5770a5ba-3e54-43b4-8243-f8c9d558efc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:41.705806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-55b45324-50c3-4642-bbec-aece892c471d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e40fe7633c49d0812bec3fa71a8b8a', 'request_id': 'req-55b45324-50c3-4642-bbec-aece892c471d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:41.722343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770a5ba-3e54-43b4-8243-f8c9d558efc9 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:41.725216 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-55b45324-50c3-4642-bbec-aece892c471d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e40fe7633c49d0812bec3fa71a8b8a', 'request_id': 'req-55b45324-50c3-4642-bbec-aece892c471d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:41.747723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-55b45324-50c3-4642-bbec-aece892c471d admin admin] The token cache is being invalidate because project 56e40fe7633c49d0812bec3fa71a8b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:34:41.748051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-55b45324-50c3-4642-bbec-aece892c471d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:41.748934 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-55b45324-50c3-4642-bbec-aece892c471d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:41.757602 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1161/2318] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:34:41 2021] DELETE /identity/v3/projects/56e40fe7633c49d0812bec3fa71a8b8a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:41.760548 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d6353-f3a2-4ba1-a66a-846c61a69c92 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:41.760825 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d6353-f3a2-4ba1-a66a-846c61a69c92 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:41.761105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d6353-f3a2-4ba1-a66a-846c61a69c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:41.837805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ebbbf-7d33-496b-9661-aebb138e278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:41.842186 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ebbbf-7d33-496b-9661-aebb138e278d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:41.844902 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ebbbf-7d33-496b-9661-aebb138e278d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:41.845321 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ebbbf-7d33-496b-9661-aebb138e278d admin admin] PATH_INFO: `/v3/projects/8acc9a0774784312ae690cea7ea7a0da` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:41.850035 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ebbbf-7d33-496b-9661-aebb138e278d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8acc9a0774784312ae690cea7ea7a0da)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:41.856796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ebbbf-7d33-496b-9661-aebb138e278d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:41.869349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-e76d6353-f3a2-4ba1-a66a-846c61a69c92 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:41.871400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e76d6353-f3a2-4ba1-a66a-846c61a69c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:41.891322 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1162/2319] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:41.967840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782fabf-7d03-4da5-b253-4cd48253daf6 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:41.967840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782fabf-7d03-4da5-b253-4cd48253daf6 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:41.967840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782fabf-7d03-4da5-b253-4cd48253daf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:42.046965 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bc3ebbbf-7d33-496b-9661-aebb138e278d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8acc9a0774784312ae690cea7ea7a0da', 'request_id': 'req-bc3ebbbf-7d33-496b-9661-aebb138e278d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:42.052394 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-b782fabf-7d03-4da5-b253-4cd48253daf6 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:42.064992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b782fabf-7d03-4da5-b253-4cd48253daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:42.073568 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bc3ebbbf-7d33-496b-9661-aebb138e278d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8acc9a0774784312ae690cea7ea7a0da', 'request_id': 'req-bc3ebbbf-7d33-496b-9661-aebb138e278d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:42.104145 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bc3ebbbf-7d33-496b-9661-aebb138e278d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8acc9a0774784312ae690cea7ea7a0da', 'request_id': 'req-bc3ebbbf-7d33-496b-9661-aebb138e278d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:42.133426 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bc3ebbbf-7d33-496b-9661-aebb138e278d admin admin] The token cache is being invalidate because project 8acc9a0774784312ae690cea7ea7a0da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:34:42.136191 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bc3ebbbf-7d33-496b-9661-aebb138e278d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:42.136191 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bc3ebbbf-7d33-496b-9661-aebb138e278d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:42.145386 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1158/2320] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:34:41 2021] DELETE /identity/v3/projects/8acc9a0774784312ae690cea7ea7a0da => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:34:42.255494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1163/2321] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:42.260454 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ebbbf-7d33-496b-9661-aebb138e278d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:42.280722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ebbbf-7d33-496b-9661-aebb138e278d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:42.328449 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c7095-4d6c-4aad-9de9-32ba37cf332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:42.329593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c7095-4d6c-4aad-9de9-32ba37cf332f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:42.332792 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c7095-4d6c-4aad-9de9-32ba37cf332f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:42.333407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c7095-4d6c-4aad-9de9-32ba37cf332f admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:42.338233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c7095-4d6c-4aad-9de9-32ba37cf332f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:34:42.339085 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c7095-4d6c-4aad-9de9-32ba37cf332f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:42.344124 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c7095-4d6c-4aad-9de9-32ba37cf332f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:42.396254 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1159/2322] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:34:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:34:42.396596 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782fabf-7d03-4da5-b253-4cd48253daf6 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:42.409266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782fabf-7d03-4da5-b253-4cd48253daf6 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:42.432031 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194a7c3-2743-4f60-8c3b-12242ee71de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:42.432731 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194a7c3-2743-4f60-8c3b-12242ee71de8 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:42.433021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194a7c3-2743-4f60-8c3b-12242ee71de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:42.433303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194a7c3-2743-4f60-8c3b-12242ee71de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:42.434015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194a7c3-2743-4f60-8c3b-12242ee71de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:42.435991 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194a7c3-2743-4f60-8c3b-12242ee71de8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:42.491080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1164/2323] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:34:42 2021] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:42.491865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c7095-4d6c-4aad-9de9-32ba37cf332f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:42.505595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c7095-4d6c-4aad-9de9-32ba37cf332f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:42.655856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c1250-8f84-4b6c-b099-1de66e0b787a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:42.656678 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c1250-8f84-4b6c-b099-1de66e0b787a admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:42.657036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c1250-8f84-4b6c-b099-1de66e0b787a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:42.657380 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c1250-8f84-4b6c-b099-1de66e0b787a admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:42.658207 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c1250-8f84-4b6c-b099-1de66e0b787a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:42.661735 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c1250-8f84-4b6c-b099-1de66e0b787a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:42.715001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1160/2324] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:34:42 2021] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:42.718195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194a7c3-2743-4f60-8c3b-12242ee71de8 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:42.735435 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194a7c3-2743-4f60-8c3b-12242ee71de8 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:42.747538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12add5c4-f6ec-475a-8c43-da1d762931a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:42.748403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12add5c4-f6ec-475a-8c43-da1d762931a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:42.748698 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12add5c4-f6ec-475a-8c43-da1d762931a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:42.751028 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12add5c4-f6ec-475a-8c43-da1d762931a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:42.758629 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12add5c4-f6ec-475a-8c43-da1d762931a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:42.761122 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12add5c4-f6ec-475a-8c43-da1d762931a2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:42.802418 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1165/2325] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:42 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:42.803295 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c1250-8f84-4b6c-b099-1de66e0b787a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:42.814869 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c1250-8f84-4b6c-b099-1de66e0b787a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:42.835580 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fdcb0-2f6e-4643-8e90-90c12c737d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:42.836448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fdcb0-2f6e-4643-8e90-90c12c737d0f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:42.836864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fdcb0-2f6e-4643-8e90-90c12c737d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:42.837291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fdcb0-2f6e-4643-8e90-90c12c737d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:42.838373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fdcb0-2f6e-4643-8e90-90c12c737d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:42.840166 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fdcb0-2f6e-4643-8e90-90c12c737d0f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:42.879451 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12add5c4-f6ec-475a-8c43-da1d762931a2 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:42.882288 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1161/2326] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:42 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:42.894861 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12add5c4-f6ec-475a-8c43-da1d762931a2 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:42.906253 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd0b29-94b5-4ec2-b21d-57478dc3a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:42.908362 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd0b29-94b5-4ec2-b21d-57478dc3a45a admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:42.908660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd0b29-94b5-4ec2-b21d-57478dc3a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:42.908944 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd0b29-94b5-4ec2-b21d-57478dc3a45a admin admin] PATH_INFO: `/v3/projects/bc2de9688642406fb8c1b1a026b5ec0b/users/b4988a87648b402e9c2ab1f0e9af9257/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:42.956119 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd0b29-94b5-4ec2-b21d-57478dc3a45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2de9688642406fb8c1b1a026b5ec0b, user_id=b4988a87648b402e9c2ab1f0e9af9257, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:42.958796 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd0b29-94b5-4ec2-b21d-57478dc3a45a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:42.984522 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1166/2327] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:42 2021] PUT /identity/v3/projects/bc2de9688642406fb8c1b1a026b5ec0b/users/b4988a87648b402e9c2ab1f0e9af9257/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:42.990856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4b028-a60c-4fa8-a0e9-a52cf075a64e None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:42.991168 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4b028-a60c-4fa8-a0e9-a52cf075a64e None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:42.991798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4b028-a60c-4fa8-a0e9-a52cf075a64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:43.039883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-e2f4b028-a60c-4fa8-a0e9-a52cf075a64e None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:43.044063 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e2f4b028-a60c-4fa8-a0e9-a52cf075a64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:43.138341 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1162/2328] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:43.157825 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd0b29-94b5-4ec2-b21d-57478dc3a45a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:43.160134 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b1cd0b29-94b5-4ec2-b21d-57478dc3a45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:43.241418 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd0b29-94b5-4ec2-b21d-57478dc3a45a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:43.252218 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00efb49-1c0a-4ab1-ab56-c69f4d46a28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:43.252993 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00efb49-1c0a-4ab1-ab56-c69f4d46a28d service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:43.253350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00efb49-1c0a-4ab1-ab56-c69f4d46a28d service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:43.253641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00efb49-1c0a-4ab1-ab56-c69f4d46a28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:43.274354 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00efb49-1c0a-4ab1-ab56-c69f4d46a28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:43.276608 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00efb49-1c0a-4ab1-ab56-c69f4d46a28d service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:43.310805 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1167/2329] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:45.638310 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4b028-a60c-4fa8-a0e9-a52cf075a64e None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:45.640291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e2f4b028-a60c-4fa8-a0e9-a52cf075a64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:45.661562 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4b028-a60c-4fa8-a0e9-a52cf075a64e None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:45.674355 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce0bf9-e017-44d7-8402-899d303d01f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:45.675385 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce0bf9-e017-44d7-8402-899d303d01f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:45.675665 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce0bf9-e017-44d7-8402-899d303d01f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:45.676136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce0bf9-e017-44d7-8402-899d303d01f7 admin admin] PATH_INFO: `/v3/users/138d237c2016443b8307c47832724eb2` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:45.679706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce0bf9-e017-44d7-8402-899d303d01f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=138d237c2016443b8307c47832724eb2)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:45.682493 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce0bf9-e017-44d7-8402-899d303d01f7 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:45.797136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-93ce0bf9-e017-44d7-8402-899d303d01f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '138d237c2016443b8307c47832724eb2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:45.813382 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-93ce0bf9-e017-44d7-8402-899d303d01f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '138d237c2016443b8307c47832724eb2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:45.829606 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-93ce0bf9-e017-44d7-8402-899d303d01f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '138d237c2016443b8307c47832724eb2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:45.845780 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-93ce0bf9-e017-44d7-8402-899d303d01f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '138d237c2016443b8307c47832724eb2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:45.847142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-93ce0bf9-e017-44d7-8402-899d303d01f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '138d237c2016443b8307c47832724eb2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:45.854930 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1163/2330] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:34:45 2021] DELETE /identity/v3/users/138d237c2016443b8307c47832724eb2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:45.860895 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af3eb-acae-48a7-872c-632cfce7cfb3 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:45.861452 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af3eb-acae-48a7-872c-632cfce7cfb3 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:45.861663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af3eb-acae-48a7-872c-632cfce7cfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:45.901764 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-d00af3eb-acae-48a7-872c-632cfce7cfb3 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:45.912789 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d00af3eb-acae-48a7-872c-632cfce7cfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:46.054183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1168/2331] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:46.087041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce0bf9-e017-44d7-8402-899d303d01f7 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:46.089365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-93ce0bf9-e017-44d7-8402-899d303d01f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:46.218606 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce0bf9-e017-44d7-8402-899d303d01f7 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:46.224919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767453d2-b5ea-4ec4-9df0-3c9f40c8beb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:46.225580 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767453d2-b5ea-4ec4-9df0-3c9f40c8beb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:46.225861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767453d2-b5ea-4ec4-9df0-3c9f40c8beb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:46.226202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767453d2-b5ea-4ec4-9df0-3c9f40c8beb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:46.264216 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767453d2-b5ea-4ec4-9df0-3c9f40c8beb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:46.265999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767453d2-b5ea-4ec4-9df0-3c9f40c8beb9 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:46.278783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1164/2332] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:47.193599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00af3eb-acae-48a7-872c-632cfce7cfb3 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:47.194936 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d00af3eb-acae-48a7-872c-632cfce7cfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:47.207477 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00af3eb-acae-48a7-872c-632cfce7cfb3 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:47.215769 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:47.218188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:47.218654 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:47.220665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] PATH_INFO: `/v3/projects/f998d36bd41c4605924f21792cadd716` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:47.223509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f998d36bd41c4605924f21792cadd716)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:47.225882 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:47.382746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f998d36bd41c4605924f21792cadd716', 'request_id': 'req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:47.396351 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f998d36bd41c4605924f21792cadd716', 'request_id': 'req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:47.419625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f998d36bd41c4605924f21792cadd716', 'request_id': 'req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:47.442994 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] The token cache is being invalidate because project f998d36bd41c4605924f21792cadd716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:34:47.443626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:47.444488 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:47.448814 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1169/2333] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:34:47 2021] DELETE /identity/v3/projects/f998d36bd41c4605924f21792cadd716 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:47.452861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767453d2-b5ea-4ec4-9df0-3c9f40c8beb9 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:47.468880 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767453d2-b5ea-4ec4-9df0-3c9f40c8beb9 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:47.577697 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873bbae-bca0-4afd-b8b5-2d37ed1c3a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:47.579869 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873bbae-bca0-4afd-b8b5-2d37ed1c3a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:47.580459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873bbae-bca0-4afd-b8b5-2d37ed1c3a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:47.580995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873bbae-bca0-4afd-b8b5-2d37ed1c3a25 admin admin] PATH_INFO: `/v3/users/cbb371a4ede84d9c97854c94fbf9f297` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:47.583732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873bbae-bca0-4afd-b8b5-2d37ed1c3a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb371a4ede84d9c97854c94fbf9f297)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:47.589327 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873bbae-bca0-4afd-b8b5-2d37ed1c3a25 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:47.702448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f873bbae-bca0-4afd-b8b5-2d37ed1c3a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb371a4ede84d9c97854c94fbf9f297'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:47.724372 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f873bbae-bca0-4afd-b8b5-2d37ed1c3a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb371a4ede84d9c97854c94fbf9f297'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:47.745621 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f873bbae-bca0-4afd-b8b5-2d37ed1c3a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb371a4ede84d9c97854c94fbf9f297'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:47.829939 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f873bbae-bca0-4afd-b8b5-2d37ed1c3a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb371a4ede84d9c97854c94fbf9f297'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:47.831114 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f873bbae-bca0-4afd-b8b5-2d37ed1c3a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb371a4ede84d9c97854c94fbf9f297'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:47.838522 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1165/2334] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:34:47 2021] DELETE /identity/v3/users/cbb371a4ede84d9c97854c94fbf9f297 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:48.705720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:48.708453 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:48.770948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914b31e-ffab-4ea7-a9eb-e072d5e8dce9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:48.862624 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:48.863522 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:48.864398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:48.864688 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] PATH_INFO: `/v3/projects/c25106266e224a788bda76907515d690` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:48.865913 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c25106266e224a788bda76907515d690)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:48.869091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:49.038141 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c25106266e224a788bda76907515d690', 'request_id': 'req-98690b6e-4f82-428e-804b-4b2630dc98a7'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:49.048988 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c25106266e224a788bda76907515d690', 'request_id': 'req-98690b6e-4f82-428e-804b-4b2630dc98a7'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:49.059209 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c25106266e224a788bda76907515d690', 'request_id': 'req-98690b6e-4f82-428e-804b-4b2630dc98a7'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:49.103891 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] The token cache is being invalidate because project c25106266e224a788bda76907515d690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:34:49.104724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:49.105730 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:49.109493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1170/2335] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:34:48 2021] DELETE /identity/v3/projects/c25106266e224a788bda76907515d690 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:49.113858 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873bbae-bca0-4afd-b8b5-2d37ed1c3a25 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:49.115920 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f873bbae-bca0-4afd-b8b5-2d37ed1c3a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:49.132387 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873bbae-bca0-4afd-b8b5-2d37ed1c3a25 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:49.280415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08dba2-5b07-41a9-9e9f-08b3306eedde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:49.281849 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08dba2-5b07-41a9-9e9f-08b3306eedde admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:49.282355 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08dba2-5b07-41a9-9e9f-08b3306eedde admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:49.283102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08dba2-5b07-41a9-9e9f-08b3306eedde admin admin] PATH_INFO: `/v3/users/cf20c31ac47f4b8d9268fc7d4415b559` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:49.284650 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08dba2-5b07-41a9-9e9f-08b3306eedde admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf20c31ac47f4b8d9268fc7d4415b559)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:49.288391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08dba2-5b07-41a9-9e9f-08b3306eedde admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:49.395491 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0b08dba2-5b07-41a9-9e9f-08b3306eedde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf20c31ac47f4b8d9268fc7d4415b559'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:49.412497 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0b08dba2-5b07-41a9-9e9f-08b3306eedde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf20c31ac47f4b8d9268fc7d4415b559'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:49.425335 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0b08dba2-5b07-41a9-9e9f-08b3306eedde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf20c31ac47f4b8d9268fc7d4415b559'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:49.457155 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0b08dba2-5b07-41a9-9e9f-08b3306eedde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf20c31ac47f4b8d9268fc7d4415b559'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:49.459176 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0b08dba2-5b07-41a9-9e9f-08b3306eedde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf20c31ac47f4b8d9268fc7d4415b559'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:49.475829 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1166/2336] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:34:49 2021] DELETE /identity/v3/users/cf20c31ac47f4b8d9268fc7d4415b559 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:50.108014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:50.112856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:50.156161 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98690b6e-4f82-428e-804b-4b2630dc98a7 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:50.275082 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:50.276275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:50.276721 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:50.277157 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] PATH_INFO: `/v3/projects/0ae73c1bbc0a4697b2c0acf758f94b7c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:50.278761 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae73c1bbc0a4697b2c0acf758f94b7c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:50.281872 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:50.405566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae73c1bbc0a4697b2c0acf758f94b7c', 'request_id': 'req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:50.411736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae73c1bbc0a4697b2c0acf758f94b7c', 'request_id': 'req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:50.423079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae73c1bbc0a4697b2c0acf758f94b7c', 'request_id': 'req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:50.460860 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] The token cache is being invalidate because project 0ae73c1bbc0a4697b2c0acf758f94b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:34:50.461514 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:50.462592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:34:50.465116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1171/2337] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:34:50 2021] DELETE /identity/v3/projects/0ae73c1bbc0a4697b2c0acf758f94b7c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:51.155863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf43e3c-de2e-4c2d-a48b-263bab72e72c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:51.156722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf43e3c-de2e-4c2d-a48b-263bab72e72c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:51.157173 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf43e3c-de2e-4c2d-a48b-263bab72e72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:51.187015 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-edf43e3c-de2e-4c2d-a48b-263bab72e72c None None] MFA Rules not processed for user `b4988a87648b402e9c2ab1f0e9af9257`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:51.188241 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-edf43e3c-de2e-4c2d-a48b-263bab72e72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:51.294504 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1167/2338] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:51 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:51.299194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:51.301885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:51.391991 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089727e5-b0dc-48bf-bcf5-dc757f7ecad6 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:51.396815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709e5a3-dc94-4a8b-b2a1-fda4153990d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:51.397487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709e5a3-dc94-4a8b-b2a1-fda4153990d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:51.397771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709e5a3-dc94-4a8b-b2a1-fda4153990d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:51.398046 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709e5a3-dc94-4a8b-b2a1-fda4153990d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:51.398742 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709e5a3-dc94-4a8b-b2a1-fda4153990d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:51.400869 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709e5a3-dc94-4a8b-b2a1-fda4153990d7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:51.441359 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1172/2339] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:34:51 2021] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:51.445151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf43e3c-de2e-4c2d-a48b-263bab72e72c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:51.476995 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf43e3c-de2e-4c2d-a48b-263bab72e72c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:51.594051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734d219-dba6-4af3-b779-4ab1a9017b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:51.594749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734d219-dba6-4af3-b779-4ab1a9017b5d admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:51.595073 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734d219-dba6-4af3-b779-4ab1a9017b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:51.595390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734d219-dba6-4af3-b779-4ab1a9017b5d admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:51.596055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734d219-dba6-4af3-b779-4ab1a9017b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:51.598000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734d219-dba6-4af3-b779-4ab1a9017b5d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:51.622205 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1168/2340] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:34:51 2021] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:34:51.625828 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709e5a3-dc94-4a8b-b2a1-fda4153990d7 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:51.636144 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709e5a3-dc94-4a8b-b2a1-fda4153990d7 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:51.640707 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de048cc-ee79-41c3-9c81-88198ca05b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:51.641373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de048cc-ee79-41c3-9c81-88198ca05b06 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:51.641656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de048cc-ee79-41c3-9c81-88198ca05b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:51.641933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de048cc-ee79-41c3-9c81-88198ca05b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:51.642682 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de048cc-ee79-41c3-9c81-88198ca05b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:51.644310 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de048cc-ee79-41c3-9c81-88198ca05b06 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:51.655221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1173/2341] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:51.659986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734d219-dba6-4af3-b779-4ab1a9017b5d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:51.676336 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734d219-dba6-4af3-b779-4ab1a9017b5d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:51.693376 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50293ef9-2832-4fd0-87bb-8871f11b642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:51.694696 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50293ef9-2832-4fd0-87bb-8871f11b642c admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:51.695116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50293ef9-2832-4fd0-87bb-8871f11b642c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:51.695494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50293ef9-2832-4fd0-87bb-8871f11b642c admin admin] PATH_INFO: `/v3/projects/e0bb26d24b0c44ddb441a3d367ba4622/users/83a5595470af45b49c94b8c5988afb30/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:51.725202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50293ef9-2832-4fd0-87bb-8871f11b642c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bb26d24b0c44ddb441a3d367ba4622, user_id=83a5595470af45b49c94b8c5988afb30, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:51.730115 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50293ef9-2832-4fd0-87bb-8871f11b642c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:51.755310 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1169/2342] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:51 2021] PUT /identity/v3/projects/e0bb26d24b0c44ddb441a3d367ba4622/users/83a5595470af45b49c94b8c5988afb30/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:51.756446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de048cc-ee79-41c3-9c81-88198ca05b06 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:51.767444 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de048cc-ee79-41c3-9c81-88198ca05b06 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:51.827054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1dd25-8217-4183-b42a-99627c5fcffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:51.828062 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1dd25-8217-4183-b42a-99627c5fcffc admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:51.828515 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1dd25-8217-4183-b42a-99627c5fcffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:51.828950 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1dd25-8217-4183-b42a-99627c5fcffc admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:51.829896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1dd25-8217-4183-b42a-99627c5fcffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:51.831725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1dd25-8217-4183-b42a-99627c5fcffc admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:51.849079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1174/2343] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:34:51 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:34:51.853857 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50293ef9-2832-4fd0-87bb-8871f11b642c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:51.864564 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50293ef9-2832-4fd0-87bb-8871f11b642c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:51.869294 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c1f2e-4a7a-49c1-847c-1b40e7249162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:51.870176 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c1f2e-4a7a-49c1-847c-1b40e7249162 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:51.870461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c1f2e-4a7a-49c1-847c-1b40e7249162 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:51.870738 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c1f2e-4a7a-49c1-847c-1b40e7249162 admin admin] PATH_INFO: `/v3/projects/e0bb26d24b0c44ddb441a3d367ba4622/users/83a5595470af45b49c94b8c5988afb30/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:51.872821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c1f2e-4a7a-49c1-847c-1b40e7249162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bb26d24b0c44ddb441a3d367ba4622, user_id=83a5595470af45b49c94b8c5988afb30, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:51.875513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c1f2e-4a7a-49c1-847c-1b40e7249162 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:51.887159 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1170/2344] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:34:51 2021] PUT /identity/v3/projects/e0bb26d24b0c44ddb441a3d367ba4622/users/83a5595470af45b49c94b8c5988afb30/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:34:58.448262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1dd25-8217-4183-b42a-99627c5fcffc admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:58.450795 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-92a1dd25-8217-4183-b42a-99627c5fcffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:58.581539 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1dd25-8217-4183-b42a-99627c5fcffc admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:58.644116 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f910c97-6191-45de-81e4-dde5ba725a7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:58.644813 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f910c97-6191-45de-81e4-dde5ba725a7d service placement] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:58.645101 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f910c97-6191-45de-81e4-dde5ba725a7d service placement] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:58.645378 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f910c97-6191-45de-81e4-dde5ba725a7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:58.647180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7f910c97-6191-45de-81e4-dde5ba725a7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:58.658612 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f910c97-6191-45de-81e4-dde5ba725a7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:34:58.660246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f910c97-6191-45de-81e4-dde5ba725a7d service placement] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:34:58.671224 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1175/2345] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:58 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:34:59.442706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34762afb-dcf0-477f-ab5c-6994d21dea39 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:59.444032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34762afb-dcf0-477f-ab5c-6994d21dea39 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:59.444508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34762afb-dcf0-477f-ab5c-6994d21dea39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:34:59.498710 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-34762afb-dcf0-477f-ab5c-6994d21dea39 None None] MFA Rules not processed for user `83a5595470af45b49c94b8c5988afb30`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:34:59.500007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-34762afb-dcf0-477f-ab5c-6994d21dea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:59.595784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1171/2346] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:34:59 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:34:59.781641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f910c97-6191-45de-81e4-dde5ba725a7d service placement] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:34:59.783262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7f910c97-6191-45de-81e4-dde5ba725a7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:34:59.935139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f910c97-6191-45de-81e4-dde5ba725a7d service placement] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:34:59.940974 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73aab10-4e00-48bb-bd70-6648884e0dac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:34:59.941780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73aab10-4e00-48bb-bd70-6648884e0dac service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:34:59.942133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73aab10-4e00-48bb-bd70-6648884e0dac service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:34:59.942486 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73aab10-4e00-48bb-bd70-6648884e0dac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:00.005625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73aab10-4e00-48bb-bd70-6648884e0dac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:00.007250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73aab10-4e00-48bb-bd70-6648884e0dac service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:00.018551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1176/2347] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:34:59 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:35:01.537193 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2336aa-595c-4b69-a4cc-632d1b98950f None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:01.538190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2336aa-595c-4b69-a4cc-632d1b98950f None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:01.538553 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2336aa-595c-4b69-a4cc-632d1b98950f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:01.564081 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-1a2336aa-595c-4b69-a4cc-632d1b98950f None None] MFA Rules not processed for user `b4988a87648b402e9c2ab1f0e9af9257`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:01.565470 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1a2336aa-595c-4b69-a4cc-632d1b98950f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:01.574667 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1172/2348] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:01 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:35:11.928388 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349308b-e838-4a7d-92bd-46980cc4a26e None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:11.929337 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349308b-e838-4a7d-92bd-46980cc4a26e None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:11.929651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349308b-e838-4a7d-92bd-46980cc4a26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:11.949579 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-3349308b-e838-4a7d-92bd-46980cc4a26e None None] MFA Rules not processed for user `88e46a4841c54de49b291afb3c2edbdd`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:11.952095 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3349308b-e838-4a7d-92bd-46980cc4a26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:12.013500 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1177/2349] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:11 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:35:25.374171 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2336aa-595c-4b69-a4cc-632d1b98950f None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:25.375713 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1a2336aa-595c-4b69-a4cc-632d1b98950f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:25.441475 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2336aa-595c-4b69-a4cc-632d1b98950f None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:25.445053 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e3381-42f3-49a2-bead-17f2ce25ed47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:25.445705 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e3381-42f3-49a2-bead-17f2ce25ed47 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:25.445988 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e3381-42f3-49a2-bead-17f2ce25ed47 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:25.446894 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e3381-42f3-49a2-bead-17f2ce25ed47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:25.448793 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-677e3381-42f3-49a2-bead-17f2ce25ed47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:25.528237 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e3381-42f3-49a2-bead-17f2ce25ed47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:25.529692 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e3381-42f3-49a2-bead-17f2ce25ed47 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:25.544676 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1173/2350] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:35:25 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:35:34.461423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349308b-e838-4a7d-92bd-46980cc4a26e None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:34.462866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3349308b-e838-4a7d-92bd-46980cc4a26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:34.474384 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349308b-e838-4a7d-92bd-46980cc4a26e None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:34.478343 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d270c2-bbaf-41ba-982b-ffc64df0cc86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:34.479349 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d270c2-bbaf-41ba-982b-ffc64df0cc86 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:34.487809 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d270c2-bbaf-41ba-982b-ffc64df0cc86 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:34.488109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d270c2-bbaf-41ba-982b-ffc64df0cc86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:34.490113 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-56d270c2-bbaf-41ba-982b-ffc64df0cc86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:34.556278 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d270c2-bbaf-41ba-982b-ffc64df0cc86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:34.557838 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d270c2-bbaf-41ba-982b-ffc64df0cc86 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:34.567678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1178/2351] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:35:34 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:35:40.015690 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e3381-42f3-49a2-bead-17f2ce25ed47 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:40.017813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-677e3381-42f3-49a2-bead-17f2ce25ed47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:40.081284 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e3381-42f3-49a2-bead-17f2ce25ed47 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:40.085732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe30d6-3da3-43c6-b528-1382fd1f4a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:40.087736 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe30d6-3da3-43c6-b528-1382fd1f4a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:40.088026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe30d6-3da3-43c6-b528-1382fd1f4a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:40.088298 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe30d6-3da3-43c6-b528-1382fd1f4a67 admin admin] PATH_INFO: `/v3/users/75a772d36dc64b34ad0e9f2748cea24f` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:40.089509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe30d6-3da3-43c6-b528-1382fd1f4a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a772d36dc64b34ad0e9f2748cea24f)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:40.091467 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe30d6-3da3-43c6-b528-1382fd1f4a67 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:40.135906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-80fe30d6-3da3-43c6-b528-1382fd1f4a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a772d36dc64b34ad0e9f2748cea24f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:40.142664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-80fe30d6-3da3-43c6-b528-1382fd1f4a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a772d36dc64b34ad0e9f2748cea24f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:40.150749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-80fe30d6-3da3-43c6-b528-1382fd1f4a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a772d36dc64b34ad0e9f2748cea24f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:40.164057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-80fe30d6-3da3-43c6-b528-1382fd1f4a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a772d36dc64b34ad0e9f2748cea24f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:40.165844 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-80fe30d6-3da3-43c6-b528-1382fd1f4a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a772d36dc64b34ad0e9f2748cea24f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:40.174144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1174/2352] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:35:40 2021] DELETE /identity/v3/users/75a772d36dc64b34ad0e9f2748cea24f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:35:40.346159 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d270c2-bbaf-41ba-982b-ffc64df0cc86 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:40.366956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d270c2-bbaf-41ba-982b-ffc64df0cc86 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:40.438292 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:40.439645 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:40.439645 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:40.439915 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10 admin admin] PATH_INFO: `/v3/projects/f0fa8d3f36f744f486c77c8a5ed5bb9c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:40.441132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0fa8d3f36f744f486c77c8a5ed5bb9c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:40.443081 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:40.490809 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0fa8d3f36f744f486c77c8a5ed5bb9c', 'request_id': 'req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:40.497009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0fa8d3f36f744f486c77c8a5ed5bb9c', 'request_id': 'req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:40.503629 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0fa8d3f36f744f486c77c8a5ed5bb9c', 'request_id': 'req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:40.517453 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10 admin admin] The token cache is being invalidate because project f0fa8d3f36f744f486c77c8a5ed5bb9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:35:40.517828 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:40.518491 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-fcfe3e02-2954-4bd9-9bf7-e638b827ac10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:40.525115 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1179/2353] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:35:40 2021] DELETE /identity/v3/projects/f0fa8d3f36f744f486c77c8a5ed5bb9c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:35:40.526808 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b28402-cba2-4cd3-b647-85318ef7e372 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:40.527130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b28402-cba2-4cd3-b647-85318ef7e372 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:40.527408 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b28402-cba2-4cd3-b647-85318ef7e372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:40.547601 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-24b28402-cba2-4cd3-b647-85318ef7e372 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:40.548859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-24b28402-cba2-4cd3-b647-85318ef7e372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:40.608734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1175/2354] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:35:40.616478 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d38c3b-0350-4542-96d1-83bbfee2fb4d None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:40.616769 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d38c3b-0350-4542-96d1-83bbfee2fb4d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:40.617046 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d38c3b-0350-4542-96d1-83bbfee2fb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:40.636172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-84d38c3b-0350-4542-96d1-83bbfee2fb4d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:40.637373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-84d38c3b-0350-4542-96d1-83bbfee2fb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:40.645235 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1180/2355] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:35:40.649621 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b28402-cba2-4cd3-b647-85318ef7e372 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:40.659107 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b28402-cba2-4cd3-b647-85318ef7e372 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:40.663739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca321b-4add-488a-85ad-171dda1e3319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:40.664924 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca321b-4add-488a-85ad-171dda1e3319 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:40.665487 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca321b-4add-488a-85ad-171dda1e3319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:40.665718 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca321b-4add-488a-85ad-171dda1e3319 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:40.666445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca321b-4add-488a-85ad-171dda1e3319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:35:40.666758 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca321b-4add-488a-85ad-171dda1e3319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:40.668404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca321b-4add-488a-85ad-171dda1e3319 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:40.679635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1176/2356] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:35:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:35:40.684467 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d38c3b-0350-4542-96d1-83bbfee2fb4d None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:40.693393 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d38c3b-0350-4542-96d1-83bbfee2fb4d None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:40.698326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa399cea-4e55-4282-98c3-4ce014c7c44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:40.699015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa399cea-4e55-4282-98c3-4ce014c7c44e admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:40.699306 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa399cea-4e55-4282-98c3-4ce014c7c44e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:40.699587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa399cea-4e55-4282-98c3-4ce014c7c44e admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:40.700291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa399cea-4e55-4282-98c3-4ce014c7c44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:40.702183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa399cea-4e55-4282-98c3-4ce014c7c44e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:40.727490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1181/2357] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:35:40 2021] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:35:40.731758 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca321b-4add-488a-85ad-171dda1e3319 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:40.741585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca321b-4add-488a-85ad-171dda1e3319 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:40.796942 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d7b51-1021-4fc3-9424-6df01d47b888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:40.797801 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d7b51-1021-4fc3-9424-6df01d47b888 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:40.798094 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d7b51-1021-4fc3-9424-6df01d47b888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:40.798380 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d7b51-1021-4fc3-9424-6df01d47b888 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:40.799142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d7b51-1021-4fc3-9424-6df01d47b888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:40.801069 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d7b51-1021-4fc3-9424-6df01d47b888 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:40.821616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1177/2358] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:35:40 2021] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:35:40.825773 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa399cea-4e55-4282-98c3-4ce014c7c44e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:40.836146 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa399cea-4e55-4282-98c3-4ce014c7c44e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:40.845721 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4308f-0c17-4d1a-a26d-648540341783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:40.846511 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4308f-0c17-4d1a-a26d-648540341783 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:40.847095 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4308f-0c17-4d1a-a26d-648540341783 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:40.847706 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4308f-0c17-4d1a-a26d-648540341783 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:40.848962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4308f-0c17-4d1a-a26d-648540341783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:40.852756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4308f-0c17-4d1a-a26d-648540341783 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:40.865973 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1182/2359] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:35:40 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:35:40.870864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d7b51-1021-4fc3-9424-6df01d47b888 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:40.880943 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d7b51-1021-4fc3-9424-6df01d47b888 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:40.885856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770970f-306a-4ffc-8302-8753b1fd3311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:40.886511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770970f-306a-4ffc-8302-8753b1fd3311 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:40.886797 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770970f-306a-4ffc-8302-8753b1fd3311 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:40.887111 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770970f-306a-4ffc-8302-8753b1fd3311 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:40.887869 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770970f-306a-4ffc-8302-8753b1fd3311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:40.889470 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770970f-306a-4ffc-8302-8753b1fd3311 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:40.899886 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1178/2360] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:35:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:35:40.904034 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4308f-0c17-4d1a-a26d-648540341783 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:40.913877 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4308f-0c17-4d1a-a26d-648540341783 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:40.919426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3f0bc-5ceb-4363-8618-a1f8ae6d2f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:40.920295 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3f0bc-5ceb-4363-8618-a1f8ae6d2f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:40.920579 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3f0bc-5ceb-4363-8618-a1f8ae6d2f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:40.920857 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3f0bc-5ceb-4363-8618-a1f8ae6d2f6e admin admin] PATH_INFO: `/v3/projects/981ad95d98dc489ab7b8bafba4add829/users/0af06988c0f04a7d9edadcf8c2bf58e5/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:40.935242 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3f0bc-5ceb-4363-8618-a1f8ae6d2f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=981ad95d98dc489ab7b8bafba4add829, user_id=0af06988c0f04a7d9edadcf8c2bf58e5, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:40.937878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3f0bc-5ceb-4363-8618-a1f8ae6d2f6e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:40.950614 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1183/2361] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:35:40 2021] PUT /identity/v3/projects/981ad95d98dc489ab7b8bafba4add829/users/0af06988c0f04a7d9edadcf8c2bf58e5/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:35:40.960895 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562399fa-6dda-444e-b6bc-04bc88e6364a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:40.961186 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562399fa-6dda-444e-b6bc-04bc88e6364a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:40.962003 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562399fa-6dda-444e-b6bc-04bc88e6364a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:40.988282 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-562399fa-6dda-444e-b6bc-04bc88e6364a None None] MFA Rules not processed for user `0af06988c0f04a7d9edadcf8c2bf58e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:40.989487 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-562399fa-6dda-444e-b6bc-04bc88e6364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:41.050634 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1179/2362] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:40 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:35:41.055253 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3f0bc-5ceb-4363-8618-a1f8ae6d2f6e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:41.114524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3f0bc-5ceb-4363-8618-a1f8ae6d2f6e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:41.119553 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d1cb8-9e3e-4596-8e69-0b8bc6f89484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:41.120210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d1cb8-9e3e-4596-8e69-0b8bc6f89484 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:41.120500 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d1cb8-9e3e-4596-8e69-0b8bc6f89484 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:41.120780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d1cb8-9e3e-4596-8e69-0b8bc6f89484 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:41.121466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d1cb8-9e3e-4596-8e69-0b8bc6f89484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:41.123392 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d1cb8-9e3e-4596-8e69-0b8bc6f89484 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:41.147303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1184/2363] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:35:41 2021] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:35:41.151999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562399fa-6dda-444e-b6bc-04bc88e6364a None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:41.162511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562399fa-6dda-444e-b6bc-04bc88e6364a None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:41.216188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b8bf6-9397-44aa-bb6e-7f5ef87bed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:41.216855 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8bf6-9397-44aa-bb6e-7f5ef87bed95 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:41.217143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8bf6-9397-44aa-bb6e-7f5ef87bed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:41.217424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8bf6-9397-44aa-bb6e-7f5ef87bed95 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:41.218110 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b8bf6-9397-44aa-bb6e-7f5ef87bed95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:41.220057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b8bf6-9397-44aa-bb6e-7f5ef87bed95 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:41.241474 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1180/2364] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:35:41 2021] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:35:41.245509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d1cb8-9e3e-4596-8e69-0b8bc6f89484 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:41.255715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d1cb8-9e3e-4596-8e69-0b8bc6f89484 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:41.261125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aec71b-9760-4159-97e7-d27b50fb63f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:41.261780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aec71b-9760-4159-97e7-d27b50fb63f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:41.262065 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aec71b-9760-4159-97e7-d27b50fb63f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:41.262343 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aec71b-9760-4159-97e7-d27b50fb63f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:41.263188 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aec71b-9760-4159-97e7-d27b50fb63f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:41.264779 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aec71b-9760-4159-97e7-d27b50fb63f3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:41.275690 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1185/2365] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:35:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:35:41.279704 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b8bf6-9397-44aa-bb6e-7f5ef87bed95 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:41.289311 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b8bf6-9397-44aa-bb6e-7f5ef87bed95 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:41.294624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bef394-83a6-485c-bd49-46ac2d32f3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:41.295534 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bef394-83a6-485c-bd49-46ac2d32f3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:41.295817 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bef394-83a6-485c-bd49-46ac2d32f3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:41.296090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bef394-83a6-485c-bd49-46ac2d32f3ec admin admin] PATH_INFO: `/v3/projects/d118dc188f724765bfc52adb2c100f9e/users/fd6691b208184398a2c8c25b1e5e220d/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:41.312221 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bef394-83a6-485c-bd49-46ac2d32f3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d118dc188f724765bfc52adb2c100f9e, user_id=fd6691b208184398a2c8c25b1e5e220d, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:41.314893 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bef394-83a6-485c-bd49-46ac2d32f3ec admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:41.328212 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1181/2366] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:35:41 2021] PUT /identity/v3/projects/d118dc188f724765bfc52adb2c100f9e/users/fd6691b208184398a2c8c25b1e5e220d/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:35:41.332281 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aec71b-9760-4159-97e7-d27b50fb63f3 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:41.343441 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aec71b-9760-4159-97e7-d27b50fb63f3 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:41.398429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fb480-a0fa-4d7c-b2e9-ac59108957f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:41.400497 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fb480-a0fa-4d7c-b2e9-ac59108957f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:41.400779 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fb480-a0fa-4d7c-b2e9-ac59108957f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:41.401051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fb480-a0fa-4d7c-b2e9-ac59108957f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:41.401776 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fb480-a0fa-4d7c-b2e9-ac59108957f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:41.403406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fb480-a0fa-4d7c-b2e9-ac59108957f7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:41.413245 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1186/2367] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:35:41 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:35:41.418677 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bef394-83a6-485c-bd49-46ac2d32f3ec admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:41.428750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bef394-83a6-485c-bd49-46ac2d32f3ec admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:41.433722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113e67d-6c31-43b8-9c20-6119fb5e7b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:41.434607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113e67d-6c31-43b8-9c20-6119fb5e7b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:41.434919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113e67d-6c31-43b8-9c20-6119fb5e7b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:41.440770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113e67d-6c31-43b8-9c20-6119fb5e7b00 admin admin] PATH_INFO: `/v3/projects/d118dc188f724765bfc52adb2c100f9e/users/fd6691b208184398a2c8c25b1e5e220d/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:41.440770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113e67d-6c31-43b8-9c20-6119fb5e7b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d118dc188f724765bfc52adb2c100f9e, user_id=fd6691b208184398a2c8c25b1e5e220d, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:41.440770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113e67d-6c31-43b8-9c20-6119fb5e7b00 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:41.450763 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1182/2368] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:35:41 2021] PUT /identity/v3/projects/d118dc188f724765bfc52adb2c100f9e/users/fd6691b208184398a2c8c25b1e5e220d/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:35:41.461019 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11eee9-02dc-49d0-b935-6f4f29052b9d None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:41.461968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11eee9-02dc-49d0-b935-6f4f29052b9d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:41.462400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11eee9-02dc-49d0-b935-6f4f29052b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:41.488333 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-8d11eee9-02dc-49d0-b935-6f4f29052b9d None None] MFA Rules not processed for user `fd6691b208184398a2c8c25b1e5e220d`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:41.489557 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8d11eee9-02dc-49d0-b935-6f4f29052b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:41.556812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1187/2369] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:41 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:35:41.562161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113e67d-6c31-43b8-9c20-6119fb5e7b00 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:41.630388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113e67d-6c31-43b8-9c20-6119fb5e7b00 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:41.635869 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7663b-2bbd-4b82-9bda-ce56503f2967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:41.636665 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7663b-2bbd-4b82-9bda-ce56503f2967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:41.636946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7663b-2bbd-4b82-9bda-ce56503f2967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:41.637219 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7663b-2bbd-4b82-9bda-ce56503f2967 admin admin] PATH_INFO: `/v3/users/0af06988c0f04a7d9edadcf8c2bf58e5` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:41.638413 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7663b-2bbd-4b82-9bda-ce56503f2967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af06988c0f04a7d9edadcf8c2bf58e5)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:41.640373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7663b-2bbd-4b82-9bda-ce56503f2967 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:41.688993 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8fb7663b-2bbd-4b82-9bda-ce56503f2967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af06988c0f04a7d9edadcf8c2bf58e5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:41.696045 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8fb7663b-2bbd-4b82-9bda-ce56503f2967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af06988c0f04a7d9edadcf8c2bf58e5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:41.703603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8fb7663b-2bbd-4b82-9bda-ce56503f2967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af06988c0f04a7d9edadcf8c2bf58e5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:41.717589 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8fb7663b-2bbd-4b82-9bda-ce56503f2967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af06988c0f04a7d9edadcf8c2bf58e5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:41.718309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8fb7663b-2bbd-4b82-9bda-ce56503f2967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af06988c0f04a7d9edadcf8c2bf58e5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:41.724300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1183/2370] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:35:41 2021] DELETE /identity/v3/users/0af06988c0f04a7d9edadcf8c2bf58e5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:35:41.730005 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52556864-cc48-4a8c-b594-a368da49f78b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:41.730364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52556864-cc48-4a8c-b594-a368da49f78b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:41.730716 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52556864-cc48-4a8c-b594-a368da49f78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:41.748227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-52556864-cc48-4a8c-b594-a368da49f78b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:41.749537 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-52556864-cc48-4a8c-b594-a368da49f78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:41.809599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1188/2371] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:35:41.819569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7663b-2bbd-4b82-9bda-ce56503f2967 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:41.821465 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8fb7663b-2bbd-4b82-9bda-ce56503f2967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:41.877101 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7663b-2bbd-4b82-9bda-ce56503f2967 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:41.880718 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5c85e-96f9-4e33-be4e-0d46cb1061df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:41.881354 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5c85e-96f9-4e33-be4e-0d46cb1061df service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:41.881635 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5c85e-96f9-4e33-be4e-0d46cb1061df service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:41.881911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5c85e-96f9-4e33-be4e-0d46cb1061df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:41.891441 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5c85e-96f9-4e33-be4e-0d46cb1061df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:41.892805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5c85e-96f9-4e33-be4e-0d46cb1061df service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:41.902949 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1184/2372] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:35:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:35:42.154341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52556864-cc48-4a8c-b594-a368da49f78b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:42.156029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-52556864-cc48-4a8c-b594-a368da49f78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:42.169083 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52556864-cc48-4a8c-b594-a368da49f78b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:42.173945 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:42.174814 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:42.175128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:42.175411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] PATH_INFO: `/v3/projects/981ad95d98dc489ab7b8bafba4add829` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:42.177147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=981ad95d98dc489ab7b8bafba4add829)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:42.178566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:42.223195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '981ad95d98dc489ab7b8bafba4add829', 'request_id': 'req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.229158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '981ad95d98dc489ab7b8bafba4add829', 'request_id': 'req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.234958 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '981ad95d98dc489ab7b8bafba4add829', 'request_id': 'req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.246806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] The token cache is being invalidate because project 981ad95d98dc489ab7b8bafba4add829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:35:42.247128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.247742 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.249263 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1189/2373] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:35:42 2021] DELETE /identity/v3/projects/981ad95d98dc489ab7b8bafba4add829 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:35:42.253342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5c85e-96f9-4e33-be4e-0d46cb1061df service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:42.262950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5c85e-96f9-4e33-be4e-0d46cb1061df service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:42.317513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa2e13-25d9-4396-b5af-92787c54d9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:42.318373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa2e13-25d9-4396-b5af-92787c54d9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:42.318660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa2e13-25d9-4396-b5af-92787c54d9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:42.318971 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa2e13-25d9-4396-b5af-92787c54d9b2 admin admin] PATH_INFO: `/v3/users/fd6691b208184398a2c8c25b1e5e220d` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:42.320182 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa2e13-25d9-4396-b5af-92787c54d9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd6691b208184398a2c8c25b1e5e220d)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:42.322163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa2e13-25d9-4396-b5af-92787c54d9b2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:42.366760 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f6aa2e13-25d9-4396-b5af-92787c54d9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd6691b208184398a2c8c25b1e5e220d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.374326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f6aa2e13-25d9-4396-b5af-92787c54d9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd6691b208184398a2c8c25b1e5e220d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.381103 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f6aa2e13-25d9-4396-b5af-92787c54d9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd6691b208184398a2c8c25b1e5e220d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.392929 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f6aa2e13-25d9-4396-b5af-92787c54d9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd6691b208184398a2c8c25b1e5e220d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.393555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f6aa2e13-25d9-4396-b5af-92787c54d9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd6691b208184398a2c8c25b1e5e220d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.399936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1185/2374] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:35:42 2021] DELETE /identity/v3/users/fd6691b208184398a2c8c25b1e5e220d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:35:42.663335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:42.665745 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:42.678948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcf8c4-e363-4f54-a7a0-5dd56f5d61a6 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:42.734458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:42.735352 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:42.735636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:42.735911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2 admin admin] PATH_INFO: `/v3/projects/d118dc188f724765bfc52adb2c100f9e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:42.737079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d118dc188f724765bfc52adb2c100f9e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:42.739024 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:42.783620 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd118dc188f724765bfc52adb2c100f9e', 'request_id': 'req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.789488 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd118dc188f724765bfc52adb2c100f9e', 'request_id': 'req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.795793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd118dc188f724765bfc52adb2c100f9e', 'request_id': 'req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.810288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2 admin admin] The token cache is being invalidate because project d118dc188f724765bfc52adb2c100f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:35:42.810586 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.811404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-af4cb388-6e0e-4b51-b03b-d87ff6ad49b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:42.818722 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1190/2375] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:35:42 2021] DELETE /identity/v3/projects/d118dc188f724765bfc52adb2c100f9e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:35:42.820333 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144bb2f-6994-425a-a3c6-da9bb9bd78aa None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:42.821144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144bb2f-6994-425a-a3c6-da9bb9bd78aa None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:42.821468 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144bb2f-6994-425a-a3c6-da9bb9bd78aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:42.844050 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-d144bb2f-6994-425a-a3c6-da9bb9bd78aa None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:42.845256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d144bb2f-6994-425a-a3c6-da9bb9bd78aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:42.906717 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1186/2376] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:35:42.914387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b46783-8d60-4463-977d-819cbc88ee67 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:42.915648 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b46783-8d60-4463-977d-819cbc88ee67 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:42.915648 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b46783-8d60-4463-977d-819cbc88ee67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:42.936724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c9b46783-8d60-4463-977d-819cbc88ee67 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:42.937931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c9b46783-8d60-4463-977d-819cbc88ee67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:42.946409 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1191/2377] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:35:42.950801 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144bb2f-6994-425a-a3c6-da9bb9bd78aa None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:42.960519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144bb2f-6994-425a-a3c6-da9bb9bd78aa None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:42.966021 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19157508-921c-40af-8f14-a3651ad359ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:42.966713 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157508-921c-40af-8f14-a3651ad359ef admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:42.967038 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157508-921c-40af-8f14-a3651ad359ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:42.967318 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157508-921c-40af-8f14-a3651ad359ef admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:42.968163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19157508-921c-40af-8f14-a3651ad359ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:35:42.968478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19157508-921c-40af-8f14-a3651ad359ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:42.970083 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19157508-921c-40af-8f14-a3651ad359ef admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:42.981991 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1187/2378] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:35:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:35:42.986389 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b46783-8d60-4463-977d-819cbc88ee67 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:42.998576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b46783-8d60-4463-977d-819cbc88ee67 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:43.004642 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18569d9b-9881-47cb-b2c0-c74ff0cd64e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:43.005315 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18569d9b-9881-47cb-b2c0-c74ff0cd64e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:43.005602 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18569d9b-9881-47cb-b2c0-c74ff0cd64e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:43.006015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18569d9b-9881-47cb-b2c0-c74ff0cd64e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:43.006792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18569d9b-9881-47cb-b2c0-c74ff0cd64e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:43.009486 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18569d9b-9881-47cb-b2c0-c74ff0cd64e8 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:43.038275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1192/2379] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:35:42 2021] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:35:43.041066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19157508-921c-40af-8f14-a3651ad359ef admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:43.050795 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19157508-921c-40af-8f14-a3651ad359ef admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:43.106180 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5eb12-3a48-45cd-ad33-ead3f60d802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:43.106856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5eb12-3a48-45cd-ad33-ead3f60d802a admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:43.107157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5eb12-3a48-45cd-ad33-ead3f60d802a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:43.107434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5eb12-3a48-45cd-ad33-ead3f60d802a admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:43.108115 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5eb12-3a48-45cd-ad33-ead3f60d802a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:43.110021 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5eb12-3a48-45cd-ad33-ead3f60d802a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:43.129948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1188/2380] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:35:43 2021] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:35:43.135180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18569d9b-9881-47cb-b2c0-c74ff0cd64e8 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:43.145012 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18569d9b-9881-47cb-b2c0-c74ff0cd64e8 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:43.150137 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18424f-bf32-4033-86ea-ab23e86b554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:43.150790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18424f-bf32-4033-86ea-ab23e86b554c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:43.151104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18424f-bf32-4033-86ea-ab23e86b554c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:43.151382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18424f-bf32-4033-86ea-ab23e86b554c admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:43.152097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18424f-bf32-4033-86ea-ab23e86b554c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:43.153681 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18424f-bf32-4033-86ea-ab23e86b554c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:43.163733 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1193/2381] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:35:43.167681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5eb12-3a48-45cd-ad33-ead3f60d802a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:43.177752 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5eb12-3a48-45cd-ad33-ead3f60d802a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:43.182965 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dd140-5d13-423f-94ed-309708e6cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:43.183616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dd140-5d13-423f-94ed-309708e6cf9f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:43.183900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dd140-5d13-423f-94ed-309708e6cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:43.184179 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dd140-5d13-423f-94ed-309708e6cf9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:43.185054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dd140-5d13-423f-94ed-309708e6cf9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:43.186653 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dd140-5d13-423f-94ed-309708e6cf9f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:43.196976 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1189/2382] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:35:43.201194 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18424f-bf32-4033-86ea-ab23e86b554c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:43.211538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18424f-bf32-4033-86ea-ab23e86b554c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:43.217282 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8380fde-035e-4cfb-875c-62ce5cb69f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:43.218172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8380fde-035e-4cfb-875c-62ce5cb69f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:43.218453 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8380fde-035e-4cfb-875c-62ce5cb69f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:43.218724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8380fde-035e-4cfb-875c-62ce5cb69f8a admin admin] PATH_INFO: `/v3/projects/6bfae418d80a41b787465d48179e9180/users/e5d572d2ef0f42eaacef6f524c170076/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:43.234975 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8380fde-035e-4cfb-875c-62ce5cb69f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfae418d80a41b787465d48179e9180, user_id=e5d572d2ef0f42eaacef6f524c170076, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:43.237674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8380fde-035e-4cfb-875c-62ce5cb69f8a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:43.253278 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1194/2383] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:35:43 2021] PUT /identity/v3/projects/6bfae418d80a41b787465d48179e9180/users/e5d572d2ef0f42eaacef6f524c170076/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:35:43.265306 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17202a1-8bc3-48ff-ad3a-73eb4e813192 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:43.265830 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17202a1-8bc3-48ff-ad3a-73eb4e813192 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:43.265952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17202a1-8bc3-48ff-ad3a-73eb4e813192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:43.291973 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-e17202a1-8bc3-48ff-ad3a-73eb4e813192 None None] MFA Rules not processed for user `e5d572d2ef0f42eaacef6f524c170076`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:43.293211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e17202a1-8bc3-48ff-ad3a-73eb4e813192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:43.358922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1190/2384] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:43 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:35:43.363365 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8380fde-035e-4cfb-875c-62ce5cb69f8a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:43.424024 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8380fde-035e-4cfb-875c-62ce5cb69f8a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:43.428665 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7db32-cf1d-4565-9918-d66476f0eb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:43.429332 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7db32-cf1d-4565-9918-d66476f0eb98 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:43.429618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7db32-cf1d-4565-9918-d66476f0eb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:43.430378 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7db32-cf1d-4565-9918-d66476f0eb98 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:43.431109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7db32-cf1d-4565-9918-d66476f0eb98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:43.433020 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7db32-cf1d-4565-9918-d66476f0eb98 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:43.458732 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1195/2385] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:35:43 2021] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:35:43.463375 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17202a1-8bc3-48ff-ad3a-73eb4e813192 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:43.473867 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17202a1-8bc3-48ff-ad3a-73eb4e813192 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:43.537630 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c820c-4f93-4146-9671-a0be71694b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:43.538322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c820c-4f93-4146-9671-a0be71694b4c admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:43.538608 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c820c-4f93-4146-9671-a0be71694b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:43.538915 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c820c-4f93-4146-9671-a0be71694b4c admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:43.540435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c820c-4f93-4146-9671-a0be71694b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:43.542564 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c820c-4f93-4146-9671-a0be71694b4c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:43.566806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1191/2386] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:35:43 2021] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:35:43.572093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7db32-cf1d-4565-9918-d66476f0eb98 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:43.582802 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7db32-cf1d-4565-9918-d66476f0eb98 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:43.589039 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8a83b-d7b3-451c-b1ba-d304b458fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:43.589727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8a83b-d7b3-451c-b1ba-d304b458fd62 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:43.590094 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8a83b-d7b3-451c-b1ba-d304b458fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:43.590377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8a83b-d7b3-451c-b1ba-d304b458fd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:43.591221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8a83b-d7b3-451c-b1ba-d304b458fd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:43.592944 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8a83b-d7b3-451c-b1ba-d304b458fd62 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:43.605337 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1196/2387] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:35:43.609092 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c820c-4f93-4146-9671-a0be71694b4c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:43.621110 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c820c-4f93-4146-9671-a0be71694b4c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:43.626365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421db57-a781-4a3c-91e6-0aa864d74ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:43.627387 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421db57-a781-4a3c-91e6-0aa864d74ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:43.627749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421db57-a781-4a3c-91e6-0aa864d74ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:43.628102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421db57-a781-4a3c-91e6-0aa864d74ce8 admin admin] PATH_INFO: `/v3/projects/e987585188e04ef4aa5e900097daa467/users/10b00232c98143179401c577f7367d5f/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:43.646066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421db57-a781-4a3c-91e6-0aa864d74ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e987585188e04ef4aa5e900097daa467, user_id=10b00232c98143179401c577f7367d5f, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:43.650196 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421db57-a781-4a3c-91e6-0aa864d74ce8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:43.663732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1192/2388] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:35:43 2021] PUT /identity/v3/projects/e987585188e04ef4aa5e900097daa467/users/10b00232c98143179401c577f7367d5f/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:35:43.668096 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8a83b-d7b3-451c-b1ba-d304b458fd62 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:43.678222 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8a83b-d7b3-451c-b1ba-d304b458fd62 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:43.736701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b95d0-2304-47ad-8bdd-6cdda83c388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:43.737444 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b95d0-2304-47ad-8bdd-6cdda83c388d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:43.737738 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b95d0-2304-47ad-8bdd-6cdda83c388d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:43.738014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b95d0-2304-47ad-8bdd-6cdda83c388d admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:43.738742 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b95d0-2304-47ad-8bdd-6cdda83c388d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:43.741126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b95d0-2304-47ad-8bdd-6cdda83c388d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:43.751946 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1197/2389] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:35:43.756246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421db57-a781-4a3c-91e6-0aa864d74ce8 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:43.776790 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421db57-a781-4a3c-91e6-0aa864d74ce8 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:43.781842 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e75bc-5045-4ae5-a748-cf5030737e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:43.782820 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e75bc-5045-4ae5-a748-cf5030737e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:43.783212 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e75bc-5045-4ae5-a748-cf5030737e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:43.783561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e75bc-5045-4ae5-a748-cf5030737e8b admin admin] PATH_INFO: `/v3/projects/e987585188e04ef4aa5e900097daa467/users/10b00232c98143179401c577f7367d5f/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:43.786281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e75bc-5045-4ae5-a748-cf5030737e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e987585188e04ef4aa5e900097daa467, user_id=10b00232c98143179401c577f7367d5f, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:43.789170 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e75bc-5045-4ae5-a748-cf5030737e8b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:43.814120 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1193/2390] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:35:43 2021] PUT /identity/v3/projects/e987585188e04ef4aa5e900097daa467/users/10b00232c98143179401c577f7367d5f/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:35:43.817117 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c1d25-e1da-4a5c-b5fc-8dc5ac03129b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:43.817513 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c1d25-e1da-4a5c-b5fc-8dc5ac03129b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:43.817890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c1d25-e1da-4a5c-b5fc-8dc5ac03129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:43.850391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-0a7c1d25-e1da-4a5c-b5fc-8dc5ac03129b None None] MFA Rules not processed for user `10b00232c98143179401c577f7367d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:43.853772 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0a7c1d25-e1da-4a5c-b5fc-8dc5ac03129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:43.954850 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1198/2391] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:43 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:35:43.962320 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e75bc-5045-4ae5-a748-cf5030737e8b admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:43.964051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d06e75bc-5045-4ae5-a748-cf5030737e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:44.054338 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e75bc-5045-4ae5-a748-cf5030737e8b admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:44.060587 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740326a2-5204-4bc3-a206-aa5caeff1a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:44.061608 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740326a2-5204-4bc3-a206-aa5caeff1a83 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:44.062006 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740326a2-5204-4bc3-a206-aa5caeff1a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:44.062569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740326a2-5204-4bc3-a206-aa5caeff1a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:44.121296 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740326a2-5204-4bc3-a206-aa5caeff1a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:44.122964 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740326a2-5204-4bc3-a206-aa5caeff1a83 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:44.132713 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1194/2392] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:35:43 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:35:48.135637 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c1d25-e1da-4a5c-b5fc-8dc5ac03129b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:48.137224 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0a7c1d25-e1da-4a5c-b5fc-8dc5ac03129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:48.204626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c1d25-e1da-4a5c-b5fc-8dc5ac03129b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:48.210450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5307683-98fc-4b8a-ad1f-5dced0df40bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:48.212229 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5307683-98fc-4b8a-ad1f-5dced0df40bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:48.212478 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5307683-98fc-4b8a-ad1f-5dced0df40bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:48.212755 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5307683-98fc-4b8a-ad1f-5dced0df40bd admin admin] PATH_INFO: `/v3/users/8e7b025b18e74bb2b8094853d9ac2c3b` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:48.213997 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5307683-98fc-4b8a-ad1f-5dced0df40bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e7b025b18e74bb2b8094853d9ac2c3b)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:48.216066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5307683-98fc-4b8a-ad1f-5dced0df40bd admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:48.261551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b5307683-98fc-4b8a-ad1f-5dced0df40bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e7b025b18e74bb2b8094853d9ac2c3b'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:48.268220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b5307683-98fc-4b8a-ad1f-5dced0df40bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e7b025b18e74bb2b8094853d9ac2c3b'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:48.268897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b5307683-98fc-4b8a-ad1f-5dced0df40bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e7b025b18e74bb2b8094853d9ac2c3b'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:48.280368 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b5307683-98fc-4b8a-ad1f-5dced0df40bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e7b025b18e74bb2b8094853d9ac2c3b'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:48.281000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b5307683-98fc-4b8a-ad1f-5dced0df40bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e7b025b18e74bb2b8094853d9ac2c3b'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:48.297469 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1199/2393] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:35:48 2021] DELETE /identity/v3/users/8e7b025b18e74bb2b8094853d9ac2c3b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:35:48.468167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740326a2-5204-4bc3-a206-aa5caeff1a83 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:48.481885 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740326a2-5204-4bc3-a206-aa5caeff1a83 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:48.544697 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c28e9-0d47-48b1-9364-de251e4820a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:48.545560 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c28e9-0d47-48b1-9364-de251e4820a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:48.545850 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c28e9-0d47-48b1-9364-de251e4820a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:48.546132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c28e9-0d47-48b1-9364-de251e4820a2 admin admin] PATH_INFO: `/v3/projects/d0a228b9e92749489f5bfd15bc40e3ae` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:48.547384 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c28e9-0d47-48b1-9364-de251e4820a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a228b9e92749489f5bfd15bc40e3ae)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:48.549292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c28e9-0d47-48b1-9364-de251e4820a2 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:48.594482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ad7c28e9-0d47-48b1-9364-de251e4820a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a228b9e92749489f5bfd15bc40e3ae', 'request_id': 'req-ad7c28e9-0d47-48b1-9364-de251e4820a2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:48.600950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ad7c28e9-0d47-48b1-9364-de251e4820a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a228b9e92749489f5bfd15bc40e3ae', 'request_id': 'req-ad7c28e9-0d47-48b1-9364-de251e4820a2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:48.608178 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ad7c28e9-0d47-48b1-9364-de251e4820a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a228b9e92749489f5bfd15bc40e3ae', 'request_id': 'req-ad7c28e9-0d47-48b1-9364-de251e4820a2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:48.618572 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ad7c28e9-0d47-48b1-9364-de251e4820a2 admin admin] The token cache is being invalidate because project d0a228b9e92749489f5bfd15bc40e3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:35:48.618888 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ad7c28e9-0d47-48b1-9364-de251e4820a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:48.619520 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ad7c28e9-0d47-48b1-9364-de251e4820a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:35:48.621037 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1195/2394] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:35:48 2021] DELETE /identity/v3/projects/d0a228b9e92749489f5bfd15bc40e3ae => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:35:48.626790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283232e-3364-40e4-baa3-d851b8e37578 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:48.627115 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283232e-3364-40e4-baa3-d851b8e37578 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:48.627397 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283232e-3364-40e4-baa3-d851b8e37578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:48.645607 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-f283232e-3364-40e4-baa3-d851b8e37578 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:48.646844 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-f283232e-3364-40e4-baa3-d851b8e37578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:48.707389 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1200/2395] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:35:48.715402 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7379c00-ff78-46a5-84d7-f952f428cd1c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:48.715701 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7379c00-ff78-46a5-84d7-f952f428cd1c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:48.716058 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7379c00-ff78-46a5-84d7-f952f428cd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:48.736962 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-b7379c00-ff78-46a5-84d7-f952f428cd1c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:48.738194 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-b7379c00-ff78-46a5-84d7-f952f428cd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:48.748097 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1196/2396] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:35:48.752448 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283232e-3364-40e4-baa3-d851b8e37578 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:48.764692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283232e-3364-40e4-baa3-d851b8e37578 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:48.769683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315c771-dfa0-45c0-b9f0-8f3dae443b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:48.770488 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315c771-dfa0-45c0-b9f0-8f3dae443b30 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:48.770902 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315c771-dfa0-45c0-b9f0-8f3dae443b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:48.771398 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315c771-dfa0-45c0-b9f0-8f3dae443b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:48.772240 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315c771-dfa0-45c0-b9f0-8f3dae443b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:35:48.772662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315c771-dfa0-45c0-b9f0-8f3dae443b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:48.774479 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315c771-dfa0-45c0-b9f0-8f3dae443b30 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:48.790883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1201/2397] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:35:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:35:48.792956 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7379c00-ff78-46a5-84d7-f952f428cd1c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:48.803007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7379c00-ff78-46a5-84d7-f952f428cd1c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:48.808828 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad7c52-9774-417c-9e69-a0b6f013b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:48.809617 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad7c52-9774-417c-9e69-a0b6f013b2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:48.810013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad7c52-9774-417c-9e69-a0b6f013b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:48.810364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad7c52-9774-417c-9e69-a0b6f013b2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:48.811224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad7c52-9774-417c-9e69-a0b6f013b2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:48.814128 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad7c52-9774-417c-9e69-a0b6f013b2b1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:48.845813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1197/2398] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:35:48 2021] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:35:48.847940 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315c771-dfa0-45c0-b9f0-8f3dae443b30 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:48.859737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315c771-dfa0-45c0-b9f0-8f3dae443b30 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:48.919896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8ecfa-4627-4566-8ea2-93b57c7b55f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:48.920577 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8ecfa-4627-4566-8ea2-93b57c7b55f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:48.920864 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8ecfa-4627-4566-8ea2-93b57c7b55f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:48.921143 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8ecfa-4627-4566-8ea2-93b57c7b55f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:48.921836 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8ecfa-4627-4566-8ea2-93b57c7b55f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:48.924717 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8ecfa-4627-4566-8ea2-93b57c7b55f9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:48.949171 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1202/2399] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:35:48 2021] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:35:48.950231 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad7c52-9774-417c-9e69-a0b6f013b2b1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:48.960607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad7c52-9774-417c-9e69-a0b6f013b2b1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:48.965890 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a310c0-4b4d-47af-8a51-02c54442b9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:48.966492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a310c0-4b4d-47af-8a51-02c54442b9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:48.966781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a310c0-4b4d-47af-8a51-02c54442b9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:48.967096 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a310c0-4b4d-47af-8a51-02c54442b9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:48.967825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a310c0-4b4d-47af-8a51-02c54442b9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:48.969431 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a310c0-4b4d-47af-8a51-02c54442b9f6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:48.981340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1198/2400] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:35:48 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:35:48.985363 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8ecfa-4627-4566-8ea2-93b57c7b55f9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:48.996439 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8ecfa-4627-4566-8ea2-93b57c7b55f9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:49.001363 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ea1b5-0dce-4bad-8386-e30c71bfcca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:49.002026 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ea1b5-0dce-4bad-8386-e30c71bfcca0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:49.002312 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ea1b5-0dce-4bad-8386-e30c71bfcca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:49.002591 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ea1b5-0dce-4bad-8386-e30c71bfcca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:49.003414 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ea1b5-0dce-4bad-8386-e30c71bfcca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:49.005029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ea1b5-0dce-4bad-8386-e30c71bfcca0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:49.015230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1203/2401] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:35:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:35:49.019583 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a310c0-4b4d-47af-8a51-02c54442b9f6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:49.029874 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a310c0-4b4d-47af-8a51-02c54442b9f6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:49.034742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66341bfd-25bb-442a-98f8-b0a9bbd24b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:49.035709 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66341bfd-25bb-442a-98f8-b0a9bbd24b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:49.035997 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66341bfd-25bb-442a-98f8-b0a9bbd24b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:49.036276 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66341bfd-25bb-442a-98f8-b0a9bbd24b94 admin admin] PATH_INFO: `/v3/projects/d5af0d5138994a26903d6168c9ec362b/users/1d51fbb5c640469890668ef74f779e2d/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:49.051302 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66341bfd-25bb-442a-98f8-b0a9bbd24b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5af0d5138994a26903d6168c9ec362b, user_id=1d51fbb5c640469890668ef74f779e2d, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:49.053955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66341bfd-25bb-442a-98f8-b0a9bbd24b94 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:49.066805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1199/2402] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:35:49 2021] PUT /identity/v3/projects/d5af0d5138994a26903d6168c9ec362b/users/1d51fbb5c640469890668ef74f779e2d/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:35:49.072181 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab05954-4d5d-43cc-97ab-5235fbf8c9da None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:49.072471 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab05954-4d5d-43cc-97ab-5235fbf8c9da None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:49.072767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab05954-4d5d-43cc-97ab-5235fbf8c9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:49.090448 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-bab05954-4d5d-43cc-97ab-5235fbf8c9da None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:49.091699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-bab05954-4d5d-43cc-97ab-5235fbf8c9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:49.148263 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1204/2403] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:35:49.158596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66341bfd-25bb-442a-98f8-b0a9bbd24b94 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:49.160366 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-66341bfd-25bb-442a-98f8-b0a9bbd24b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:49.217557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66341bfd-25bb-442a-98f8-b0a9bbd24b94 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:49.221120 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62803e5-341b-4e92-94cb-9ff3da2695ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:49.221772 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62803e5-341b-4e92-94cb-9ff3da2695ae service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:49.222061 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62803e5-341b-4e92-94cb-9ff3da2695ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:49.222343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62803e5-341b-4e92-94cb-9ff3da2695ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:49.233028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62803e5-341b-4e92-94cb-9ff3da2695ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:49.234494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62803e5-341b-4e92-94cb-9ff3da2695ae service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:49.244553 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1200/2404] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:35:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:35:50.810689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab05954-4d5d-43cc-97ab-5235fbf8c9da None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:50.812181 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-bab05954-4d5d-43cc-97ab-5235fbf8c9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:50.895195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab05954-4d5d-43cc-97ab-5235fbf8c9da None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:50.901840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227f280-93da-4bf3-99ba-76f2b4ea2445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:50.902308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227f280-93da-4bf3-99ba-76f2b4ea2445 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:50.902593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227f280-93da-4bf3-99ba-76f2b4ea2445 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:50.902882 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227f280-93da-4bf3-99ba-76f2b4ea2445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:50.906383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-1227f280-93da-4bf3-99ba-76f2b4ea2445 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:50.981126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227f280-93da-4bf3-99ba-76f2b4ea2445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:50.982624 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227f280-93da-4bf3-99ba-76f2b4ea2445 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:50.992701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1205/2405] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:35:50 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:35:53.420824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5c8f0-5d51-4789-9017-79ad9e6f92e7 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:53.421326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5c8f0-5d51-4789-9017-79ad9e6f92e7 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:53.421440 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5c8f0-5d51-4789-9017-79ad9e6f92e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:53.449885 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-dcc5c8f0-5d51-4789-9017-79ad9e6f92e7 None None] MFA Rules not processed for user `1d51fbb5c640469890668ef74f779e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:53.451303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-dcc5c8f0-5d51-4789-9017-79ad9e6f92e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:53.541966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1201/2406] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:53 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:35:53.559113 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227f280-93da-4bf3-99ba-76f2b4ea2445 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:35:53.560692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-1227f280-93da-4bf3-99ba-76f2b4ea2445 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:53.643850 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227f280-93da-4bf3-99ba-76f2b4ea2445 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:35:53.650731 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2887a-392b-45ab-99a0-c524b62754e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:35:53.651618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2887a-392b-45ab-99a0-c524b62754e3 service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:53.651746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2887a-392b-45ab-99a0-c524b62754e3 service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:53.652003 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2887a-392b-45ab-99a0-c524b62754e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:53.660700 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2887a-392b-45ab-99a0-c524b62754e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:35:53.662312 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2887a-392b-45ab-99a0-c524b62754e3 service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:35:53.672915 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1206/2407] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:35:53 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:35:55.288656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6f6b9-d4bf-4049-b85b-b0921b222ed1 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:35:55.289370 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6f6b9-d4bf-4049-b85b-b0921b222ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:35:55.289601 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6f6b9-d4bf-4049-b85b-b0921b222ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:35:55.312008 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0ba6f6b9-d4bf-4049-b85b-b0921b222ed1 None None] MFA Rules not processed for user `1d51fbb5c640469890668ef74f779e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:35:55.313436 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0ba6f6b9-d4bf-4049-b85b-b0921b222ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:35:55.321525 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1202/2408] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:35:55 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:36:06.737280 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2887a-392b-45ab-99a0-c524b62754e3 service nova] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:06.738754 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c6a2887a-392b-45ab-99a0-c524b62754e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:06.750367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2887a-392b-45ab-99a0-c524b62754e3 service nova] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:06.753911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d166c-5588-4562-ade6-88f1d24ffa76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:06.754541 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d166c-5588-4562-ade6-88f1d24ffa76 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:06.754827 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d166c-5588-4562-ade6-88f1d24ffa76 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:06.755139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d166c-5588-4562-ade6-88f1d24ffa76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:06.756857 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ab5d166c-5588-4562-ade6-88f1d24ffa76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:06.816434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d166c-5588-4562-ade6-88f1d24ffa76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:06.817897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d166c-5588-4562-ade6-88f1d24ffa76 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:06.827734 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1207/2409] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:36:06 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:36:23.356339 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bddcf-c6dc-457f-a1c9-879cc4a3c419 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:23.356890 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bddcf-c6dc-457f-a1c9-879cc4a3c419 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:23.356890 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bddcf-c6dc-457f-a1c9-879cc4a3c419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:23.404698 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-c02bddcf-c6dc-457f-a1c9-879cc4a3c419 None None] MFA Rules not processed for user `f6af4c462c6347ff8abbcc8770874b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:23.405910 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-c02bddcf-c6dc-457f-a1c9-879cc4a3c419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:23.467692 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1203/2410] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Nov 16 00:36:23 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:23.508906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d166c-5588-4562-ade6-88f1d24ffa76 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:23.510326 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ab5d166c-5588-4562-ade6-88f1d24ffa76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:23.600885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d166c-5588-4562-ade6-88f1d24ffa76 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:23.606749 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac55e3-6c44-409f-8b2e-79495ec38b4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac32c6730654a889472a3bad95374bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:23.607435 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac55e3-6c44-409f-8b2e-79495ec38b4e service swift] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:23.607738 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac55e3-6c44-409f-8b2e-79495ec38b4e service swift] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:23.608006 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac55e3-6c44-409f-8b2e-79495ec38b4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:23.616950 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac55e3-6c44-409f-8b2e-79495ec38b4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:23.618578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac55e3-6c44-409f-8b2e-79495ec38b4e service swift] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:23.626674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1208/2411] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Nov 16 00:36:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 00:36:26.296309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bddcf-c6dc-457f-a1c9-879cc4a3c419 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:26.299241 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-c02bddcf-c6dc-457f-a1c9-879cc4a3c419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:26.320231 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bddcf-c6dc-457f-a1c9-879cc4a3c419 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:26.329203 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26f286-5964-423e-a73a-1b47df4de854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:26.331025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f286-5964-423e-a73a-1b47df4de854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:26.331499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f286-5964-423e-a73a-1b47df4de854 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:26.331942 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f286-5964-423e-a73a-1b47df4de854 admin admin] PATH_INFO: `/v3/users/e5d572d2ef0f42eaacef6f524c170076` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:26.333396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26f286-5964-423e-a73a-1b47df4de854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d572d2ef0f42eaacef6f524c170076)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:26.336193 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26f286-5964-423e-a73a-1b47df4de854 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:26.427082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-df26f286-5964-423e-a73a-1b47df4de854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d572d2ef0f42eaacef6f524c170076'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:26.435764 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-df26f286-5964-423e-a73a-1b47df4de854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d572d2ef0f42eaacef6f524c170076'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:26.448001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-df26f286-5964-423e-a73a-1b47df4de854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d572d2ef0f42eaacef6f524c170076'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:26.461531 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-df26f286-5964-423e-a73a-1b47df4de854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d572d2ef0f42eaacef6f524c170076'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:26.462516 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-df26f286-5964-423e-a73a-1b47df4de854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d572d2ef0f42eaacef6f524c170076'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:26.469763 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1204/2412] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:36:26 2021] DELETE /identity/v3/users/e5d572d2ef0f42eaacef6f524c170076 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:26.474780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8543d-b564-4891-8ec4-bcbc4be4ca1f None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:26.475344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8543d-b564-4891-8ec4-bcbc4be4ca1f None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:26.475344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8543d-b564-4891-8ec4-bcbc4be4ca1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:26.499091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-9bc8543d-b564-4891-8ec4-bcbc4be4ca1f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:26.500674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9bc8543d-b564-4891-8ec4-bcbc4be4ca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:26.583827 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1209/2413] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:26.602156 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26f286-5964-423e-a73a-1b47df4de854 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:26.605036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-df26f286-5964-423e-a73a-1b47df4de854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:26.680037 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26f286-5964-423e-a73a-1b47df4de854 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:26.683950 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a8a60-7601-4ca1-9560-8d90c7b0539b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:26.684634 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a8a60-7601-4ca1-9560-8d90c7b0539b service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:26.684991 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a8a60-7601-4ca1-9560-8d90c7b0539b service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:26.685386 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a8a60-7601-4ca1-9560-8d90c7b0539b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:26.698495 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a8a60-7601-4ca1-9560-8d90c7b0539b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:26.700007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a8a60-7601-4ca1-9560-8d90c7b0539b service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:26.711515 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1205/2414] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:36:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:36:27.137557 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8543d-b564-4891-8ec4-bcbc4be4ca1f None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:27.140109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9bc8543d-b564-4891-8ec4-bcbc4be4ca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:27.159108 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8543d-b564-4891-8ec4-bcbc4be4ca1f None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:27.167006 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:27.167977 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:27.168329 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:27.168677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] PATH_INFO: `/v3/projects/6bfae418d80a41b787465d48179e9180` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:27.170124 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfae418d80a41b787465d48179e9180)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:27.172731 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:27.249490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfae418d80a41b787465d48179e9180', 'request_id': 'req-1e825d72-f875-4f23-8876-ff6ba8cd21ca'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:27.265283 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfae418d80a41b787465d48179e9180', 'request_id': 'req-1e825d72-f875-4f23-8876-ff6ba8cd21ca'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:27.272943 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfae418d80a41b787465d48179e9180', 'request_id': 'req-1e825d72-f875-4f23-8876-ff6ba8cd21ca'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:27.288106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] The token cache is being invalidate because project 6bfae418d80a41b787465d48179e9180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:36:27.288737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:27.289059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:27.290880 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1210/2415] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:36:27 2021] DELETE /identity/v3/projects/6bfae418d80a41b787465d48179e9180 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:27.295441 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a8a60-7601-4ca1-9560-8d90c7b0539b service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:27.311779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a8a60-7601-4ca1-9560-8d90c7b0539b service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:27.375461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f259616-a4b2-4803-9382-ee40c2d0735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:27.376353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f259616-a4b2-4803-9382-ee40c2d0735a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:27.376642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f259616-a4b2-4803-9382-ee40c2d0735a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:27.376928 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f259616-a4b2-4803-9382-ee40c2d0735a admin admin] PATH_INFO: `/v3/users/10b00232c98143179401c577f7367d5f` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:27.378173 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f259616-a4b2-4803-9382-ee40c2d0735a admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b00232c98143179401c577f7367d5f)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:27.380256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f259616-a4b2-4803-9382-ee40c2d0735a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:27.437511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-3f259616-a4b2-4803-9382-ee40c2d0735a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b00232c98143179401c577f7367d5f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:27.446263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-3f259616-a4b2-4803-9382-ee40c2d0735a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b00232c98143179401c577f7367d5f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:27.454603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-3f259616-a4b2-4803-9382-ee40c2d0735a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b00232c98143179401c577f7367d5f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:27.468586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-3f259616-a4b2-4803-9382-ee40c2d0735a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b00232c98143179401c577f7367d5f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:27.469621 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-3f259616-a4b2-4803-9382-ee40c2d0735a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b00232c98143179401c577f7367d5f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:27.476427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1206/2416] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:36:27 2021] DELETE /identity/v3/users/10b00232c98143179401c577f7367d5f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:27.935628 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:27.937592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:27.989431 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e825d72-f875-4f23-8876-ff6ba8cd21ca admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:28.084859 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:28.085794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:28.086081 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:28.086356 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd admin admin] PATH_INFO: `/v3/projects/e987585188e04ef4aa5e900097daa467` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:28.087889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e987585188e04ef4aa5e900097daa467)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:28.091601 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:28.171589 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e987585188e04ef4aa5e900097daa467', 'request_id': 'req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:28.177248 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e987585188e04ef4aa5e900097daa467', 'request_id': 'req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:28.194276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e987585188e04ef4aa5e900097daa467', 'request_id': 'req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:28.216968 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd admin admin] The token cache is being invalidate because project e987585188e04ef4aa5e900097daa467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:36:28.217549 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:28.221327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ee65a9fa-4ad9-47fa-aaa9-23d2bb5b05dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:28.227060 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1211/2417] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:36:27 2021] DELETE /identity/v3/projects/e987585188e04ef4aa5e900097daa467 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:28.235066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190233a5-02b6-4376-b259-eb26781d91b0 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:28.235433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190233a5-02b6-4376-b259-eb26781d91b0 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:28.235810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190233a5-02b6-4376-b259-eb26781d91b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:28.259309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-190233a5-02b6-4376-b259-eb26781d91b0 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:28.261226 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-190233a5-02b6-4376-b259-eb26781d91b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:28.342343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1207/2418] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:36:28.344139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9409cd-fbc8-4ae7-bbb4-9917eb1e5790 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:28.344430 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9409cd-fbc8-4ae7-bbb4-9917eb1e5790 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:28.344721 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9409cd-fbc8-4ae7-bbb4-9917eb1e5790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:28.378523 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-6d9409cd-fbc8-4ae7-bbb4-9917eb1e5790 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:28.381268 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6d9409cd-fbc8-4ae7-bbb4-9917eb1e5790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:28.392017 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1212/2419] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:28.397003 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190233a5-02b6-4376-b259-eb26781d91b0 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:28.412054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190233a5-02b6-4376-b259-eb26781d91b0 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:28.418771 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743db246-2587-42e7-b0a8-1e45f4bc2bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:28.419906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743db246-2587-42e7-b0a8-1e45f4bc2bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:28.420463 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743db246-2587-42e7-b0a8-1e45f4bc2bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:28.420744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743db246-2587-42e7-b0a8-1e45f4bc2bb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:28.421484 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743db246-2587-42e7-b0a8-1e45f4bc2bb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:36:28.421799 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743db246-2587-42e7-b0a8-1e45f4bc2bb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:28.423487 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743db246-2587-42e7-b0a8-1e45f4bc2bb4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:28.444169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1208/2420] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:36:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:36:28.445287 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9409cd-fbc8-4ae7-bbb4-9917eb1e5790 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:28.455736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9409cd-fbc8-4ae7-bbb4-9917eb1e5790 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:28.461410 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3b8f5-7e86-4a25-a3c5-48d69ae0eec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:28.462105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3b8f5-7e86-4a25-a3c5-48d69ae0eec3 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:28.462389 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3b8f5-7e86-4a25-a3c5-48d69ae0eec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:28.462663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3b8f5-7e86-4a25-a3c5-48d69ae0eec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:28.463524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3b8f5-7e86-4a25-a3c5-48d69ae0eec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:28.465485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3b8f5-7e86-4a25-a3c5-48d69ae0eec3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:28.509690 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1213/2421] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:36:28 2021] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:36:28.512027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743db246-2587-42e7-b0a8-1e45f4bc2bb4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:28.524427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743db246-2587-42e7-b0a8-1e45f4bc2bb4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:28.602655 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b511f0-1671-4bca-a9a5-f3c97d721420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:28.604027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b511f0-1671-4bca-a9a5-f3c97d721420 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:28.604681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b511f0-1671-4bca-a9a5-f3c97d721420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:28.604859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b511f0-1671-4bca-a9a5-f3c97d721420 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:28.605844 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b511f0-1671-4bca-a9a5-f3c97d721420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:28.608009 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b511f0-1671-4bca-a9a5-f3c97d721420 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:28.639416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1209/2422] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:36:28 2021] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:36:28.643684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3b8f5-7e86-4a25-a3c5-48d69ae0eec3 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:28.658225 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3b8f5-7e86-4a25-a3c5-48d69ae0eec3 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:28.672287 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adab83-d15f-44ab-aec4-042f4c78ca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:28.672960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adab83-d15f-44ab-aec4-042f4c78ca7d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:28.673572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adab83-d15f-44ab-aec4-042f4c78ca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:28.673572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adab83-d15f-44ab-aec4-042f4c78ca7d admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:28.674291 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adab83-d15f-44ab-aec4-042f4c78ca7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:28.676056 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adab83-d15f-44ab-aec4-042f4c78ca7d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:28.692431 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1214/2423] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:36:28 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:36:28.698720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b511f0-1671-4bca-a9a5-f3c97d721420 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:28.711890 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b511f0-1671-4bca-a9a5-f3c97d721420 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:28.717895 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9f6ac-ba2e-46b8-b33c-e2721377dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:28.720416 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9f6ac-ba2e-46b8-b33c-e2721377dd16 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:28.720886 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9f6ac-ba2e-46b8-b33c-e2721377dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:28.721337 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9f6ac-ba2e-46b8-b33c-e2721377dd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:28.723424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9f6ac-ba2e-46b8-b33c-e2721377dd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:28.725504 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9f6ac-ba2e-46b8-b33c-e2721377dd16 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:28.741530 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1210/2424] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:36:28 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:36:28.746710 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adab83-d15f-44ab-aec4-042f4c78ca7d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:28.757907 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adab83-d15f-44ab-aec4-042f4c78ca7d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:28.763308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f9998-8f36-46bc-bfb9-84182950d08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:28.764330 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f9998-8f36-46bc-bfb9-84182950d08c admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:28.764722 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f9998-8f36-46bc-bfb9-84182950d08c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:28.765117 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f9998-8f36-46bc-bfb9-84182950d08c admin admin] PATH_INFO: `/v3/projects/b6d45815e795484a9953703b5e1312ae/users/57920721a798481f87f9b47ca42a5889/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:28.783856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f9998-8f36-46bc-bfb9-84182950d08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d45815e795484a9953703b5e1312ae, user_id=57920721a798481f87f9b47ca42a5889, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:28.786758 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f9998-8f36-46bc-bfb9-84182950d08c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:28.804652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1215/2425] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:36:28 2021] PUT /identity/v3/projects/b6d45815e795484a9953703b5e1312ae/users/57920721a798481f87f9b47ca42a5889/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:28.815986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c38e6-643b-4799-ba76-c95ea9755b44 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:28.816336 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c38e6-643b-4799-ba76-c95ea9755b44 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:28.816703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c38e6-643b-4799-ba76-c95ea9755b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:28.851023 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-941c38e6-643b-4799-ba76-c95ea9755b44 None None] MFA Rules not processed for user `57920721a798481f87f9b47ca42a5889`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:28.852744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-941c38e6-643b-4799-ba76-c95ea9755b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:28.954627 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1211/2426] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:28 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:28.959311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f9998-8f36-46bc-bfb9-84182950d08c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:29.072493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f9998-8f36-46bc-bfb9-84182950d08c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:29.081933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2d505-b6da-470f-a1f5-f7022a395ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:29.083510 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2d505-b6da-470f-a1f5-f7022a395ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:29.083969 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2d505-b6da-470f-a1f5-f7022a395ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:29.085645 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2d505-b6da-470f-a1f5-f7022a395ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:29.086542 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2d505-b6da-470f-a1f5-f7022a395ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:29.089065 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2d505-b6da-470f-a1f5-f7022a395ee3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:29.139393 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1216/2427] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:36:28 2021] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:36:29.139928 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c38e6-643b-4799-ba76-c95ea9755b44 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:29.158032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c38e6-643b-4799-ba76-c95ea9755b44 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:29.247739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e445b-d90d-4784-b675-9b8b5c814b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:29.248027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e445b-d90d-4784-b675-9b8b5c814b21 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:29.248392 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e445b-d90d-4784-b675-9b8b5c814b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:29.248659 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e445b-d90d-4784-b675-9b8b5c814b21 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:29.251215 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e445b-d90d-4784-b675-9b8b5c814b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:29.252106 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e445b-d90d-4784-b675-9b8b5c814b21 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:29.292089 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1212/2428] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:36:29 2021] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:36:29.295354 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2d505-b6da-470f-a1f5-f7022a395ee3 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:29.308427 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2d505-b6da-470f-a1f5-f7022a395ee3 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:29.316615 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b6cf5-2e2a-47dd-82e0-0a76b7fa0c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:29.317612 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b6cf5-2e2a-47dd-82e0-0a76b7fa0c0b admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:29.318266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b6cf5-2e2a-47dd-82e0-0a76b7fa0c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:29.332515 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b6cf5-2e2a-47dd-82e0-0a76b7fa0c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:29.333788 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b6cf5-2e2a-47dd-82e0-0a76b7fa0c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:29.337079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b6cf5-2e2a-47dd-82e0-0a76b7fa0c0b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:29.353777 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1217/2429] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:36:29 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:36:29.358453 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e445b-d90d-4784-b675-9b8b5c814b21 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:29.371720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e445b-d90d-4784-b675-9b8b5c814b21 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:29.381812 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76148fe3-560f-4f77-8f0c-09dd21e09270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:29.383150 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76148fe3-560f-4f77-8f0c-09dd21e09270 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:29.383646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76148fe3-560f-4f77-8f0c-09dd21e09270 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:29.384419 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76148fe3-560f-4f77-8f0c-09dd21e09270 admin admin] PATH_INFO: `/v3/projects/5c1a275d73c840d488e7cefb0ca31213/users/9c9d263281ae417ea2236e502c73bde4/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:29.402761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76148fe3-560f-4f77-8f0c-09dd21e09270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1a275d73c840d488e7cefb0ca31213, user_id=9c9d263281ae417ea2236e502c73bde4, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:29.405762 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76148fe3-560f-4f77-8f0c-09dd21e09270 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:29.426279 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1213/2430] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:36:29 2021] PUT /identity/v3/projects/5c1a275d73c840d488e7cefb0ca31213/users/9c9d263281ae417ea2236e502c73bde4/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:29.430132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b6cf5-2e2a-47dd-82e0-0a76b7fa0c0b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:29.444402 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b6cf5-2e2a-47dd-82e0-0a76b7fa0c0b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:29.544957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbefe70-c966-4bcc-9265-00fe73bac982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:29.545944 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbefe70-c966-4bcc-9265-00fe73bac982 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:29.546260 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbefe70-c966-4bcc-9265-00fe73bac982 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:29.546637 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbefe70-c966-4bcc-9265-00fe73bac982 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:29.547760 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbefe70-c966-4bcc-9265-00fe73bac982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:29.559204 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbefe70-c966-4bcc-9265-00fe73bac982 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:29.577532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1218/2431] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:36:29 2021] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:36:29.578817 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76148fe3-560f-4f77-8f0c-09dd21e09270 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:29.593963 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76148fe3-560f-4f77-8f0c-09dd21e09270 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:29.614544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f862ab-2af4-48be-9793-04e3fe998425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:29.615805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f862ab-2af4-48be-9793-04e3fe998425 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:29.616202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f862ab-2af4-48be-9793-04e3fe998425 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:29.616578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f862ab-2af4-48be-9793-04e3fe998425 admin admin] PATH_INFO: `/v3/projects/5c1a275d73c840d488e7cefb0ca31213/users/9c9d263281ae417ea2236e502c73bde4/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:29.621093 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f862ab-2af4-48be-9793-04e3fe998425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1a275d73c840d488e7cefb0ca31213, user_id=9c9d263281ae417ea2236e502c73bde4, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:29.626333 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f862ab-2af4-48be-9793-04e3fe998425 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:29.646885 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1214/2432] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:36:29 2021] PUT /identity/v3/projects/5c1a275d73c840d488e7cefb0ca31213/users/9c9d263281ae417ea2236e502c73bde4/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:29.656374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296892a-9755-44e5-8373-567d6353d20b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:29.656706 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296892a-9755-44e5-8373-567d6353d20b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:29.656937 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296892a-9755-44e5-8373-567d6353d20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:29.715528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-0296892a-9755-44e5-8373-567d6353d20b None None] MFA Rules not processed for user `9c9d263281ae417ea2236e502c73bde4`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:29.716929 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0296892a-9755-44e5-8373-567d6353d20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:29.824311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1219/2433] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:29 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:29.835845 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f862ab-2af4-48be-9793-04e3fe998425 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:29.837672 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f5f862ab-2af4-48be-9793-04e3fe998425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:29.909157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f862ab-2af4-48be-9793-04e3fe998425 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:29.919099 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc29950-0198-45bc-ba32-d8b4ae964f20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:29.919799 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc29950-0198-45bc-ba32-d8b4ae964f20 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:29.920069 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc29950-0198-45bc-ba32-d8b4ae964f20 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:29.920346 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc29950-0198-45bc-ba32-d8b4ae964f20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:29.938489 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc29950-0198-45bc-ba32-d8b4ae964f20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:29.940059 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc29950-0198-45bc-ba32-d8b4ae964f20 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:29.967932 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1215/2434] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:36:29 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:36:30.650975 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296892a-9755-44e5-8373-567d6353d20b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:30.662531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296892a-9755-44e5-8373-567d6353d20b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:30.668263 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fde78-73a2-492f-865f-1a98f45d93a0 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9d263281ae417ea2236e502c73bde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c1a275d73c840d488e7cefb0ca31213', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:30.669032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fde78-73a2-492f-865f-1a98f45d93a0 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:30.669240 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fde78-73a2-492f-865f-1a98f45d93a0 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:30.669745 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fde78-73a2-492f-865f-1a98f45d93a0 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:30.670497 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fde78-73a2-492f-865f-1a98f45d93a0 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:36:30.670812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fde78-73a2-492f-865f-1a98f45d93a0 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:30.672455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fde78-73a2-492f-865f-1a98f45d93a0 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:30.685644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1220/2435] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:36:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:36:30.689664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc29950-0198-45bc-ba32-d8b4ae964f20 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:30.701215 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc29950-0198-45bc-ba32-d8b4ae964f20 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:30.706370 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886ccc9-5fc6-483a-82e3-7aaf13161155 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9d263281ae417ea2236e502c73bde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c1a275d73c840d488e7cefb0ca31213', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:30.706924 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886ccc9-5fc6-483a-82e3-7aaf13161155 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:30.707213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886ccc9-5fc6-483a-82e3-7aaf13161155 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:30.707498 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886ccc9-5fc6-483a-82e3-7aaf13161155 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:30.708200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886ccc9-5fc6-483a-82e3-7aaf13161155 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:30.710108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886ccc9-5fc6-483a-82e3-7aaf13161155 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:30.777029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fde78-73a2-492f-865f-1a98f45d93a0 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:30.788380 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1216/2436] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:36:30 2021] POST /identity/v3/projects => generated 354 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:36:30.793741 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fde78-73a2-492f-865f-1a98f45d93a0 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:30.928660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a3c78-cd17-4563-9028-3d5d6c45b690 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9d263281ae417ea2236e502c73bde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c1a275d73c840d488e7cefb0ca31213', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:30.929369 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a3c78-cd17-4563-9028-3d5d6c45b690 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:30.929656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a3c78-cd17-4563-9028-3d5d6c45b690 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:30.929936 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a3c78-cd17-4563-9028-3d5d6c45b690 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:30.930669 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a3c78-cd17-4563-9028-3d5d6c45b690 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:36:30.931004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a3c78-cd17-4563-9028-3d5d6c45b690 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:30.932845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a3c78-cd17-4563-9028-3d5d6c45b690 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:30.959782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1221/2437] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:36:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:36:31.002663 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886ccc9-5fc6-483a-82e3-7aaf13161155 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:31.018750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886ccc9-5fc6-483a-82e3-7aaf13161155 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:31.028071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cbb64-5a8d-453e-950f-36afccad2524 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9d263281ae417ea2236e502c73bde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c1a275d73c840d488e7cefb0ca31213', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:31.028998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cbb64-5a8d-453e-950f-36afccad2524 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:31.029364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cbb64-5a8d-453e-950f-36afccad2524 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:31.029742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cbb64-5a8d-453e-950f-36afccad2524 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] PATH_INFO: `/v3/projects/abbecaccbddd4f0d9fd1ec760b8ea70a` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:31.035019 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cbb64-5a8d-453e-950f-36afccad2524 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] RBAC: Authorizing `identity:delete_project(project_id=abbecaccbddd4f0d9fd1ec760b8ea70a)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:31.037192 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cbb64-5a8d-453e-950f-36afccad2524 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:31.112910 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-620cbb64-5a8d-453e-950f-36afccad2524 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abbecaccbddd4f0d9fd1ec760b8ea70a', 'request_id': 'req-620cbb64-5a8d-453e-950f-36afccad2524'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:31.128825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-620cbb64-5a8d-453e-950f-36afccad2524 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abbecaccbddd4f0d9fd1ec760b8ea70a', 'request_id': 'req-620cbb64-5a8d-453e-950f-36afccad2524'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:31.143401 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-620cbb64-5a8d-453e-950f-36afccad2524 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abbecaccbddd4f0d9fd1ec760b8ea70a', 'request_id': 'req-620cbb64-5a8d-453e-950f-36afccad2524'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:31.156078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-620cbb64-5a8d-453e-950f-36afccad2524 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] The token cache is being invalidate because project abbecaccbddd4f0d9fd1ec760b8ea70a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:36:31.156597 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-620cbb64-5a8d-453e-950f-36afccad2524 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:31.157332 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-620cbb64-5a8d-453e-950f-36afccad2524 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:31.158939 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1217/2438] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:36:31 2021] DELETE /identity/v3/projects/abbecaccbddd4f0d9fd1ec760b8ea70a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:31.438240 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a3c78-cd17-4563-9028-3d5d6c45b690 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:31.441255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7a4a3c78-cd17-4563-9028-3d5d6c45b690 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:31.534614 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a3c78-cd17-4563-9028-3d5d6c45b690 tempest-VolumeQuotaClassesTest-838532612 tempest-VolumeQuotaClassesTest-838532612-project-admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:31.602061 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79814-cfc0-4e44-80c1-d451bade5ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:31.603025 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79814-cfc0-4e44-80c1-d451bade5ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:31.603312 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79814-cfc0-4e44-80c1-d451bade5ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:31.605137 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d79814-cfc0-4e44-80c1-d451bade5ff9 admin admin] PATH_INFO: `/v3/users/57920721a798481f87f9b47ca42a5889` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:31.606915 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d79814-cfc0-4e44-80c1-d451bade5ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57920721a798481f87f9b47ca42a5889)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:31.609229 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d79814-cfc0-4e44-80c1-d451bade5ff9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:31.702167 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-36d79814-cfc0-4e44-80c1-d451bade5ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57920721a798481f87f9b47ca42a5889'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:31.710673 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-36d79814-cfc0-4e44-80c1-d451bade5ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57920721a798481f87f9b47ca42a5889'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:31.711545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-36d79814-cfc0-4e44-80c1-d451bade5ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57920721a798481f87f9b47ca42a5889'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:31.725934 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-36d79814-cfc0-4e44-80c1-d451bade5ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57920721a798481f87f9b47ca42a5889'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:31.726676 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-36d79814-cfc0-4e44-80c1-d451bade5ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57920721a798481f87f9b47ca42a5889'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:31.747084 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1222/2439] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:36:31 2021] DELETE /identity/v3/users/57920721a798481f87f9b47ca42a5889 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:31.751478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d84abf-bfdb-412c-ac5d-c816f77ae2b1 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:31.752731 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d84abf-bfdb-412c-ac5d-c816f77ae2b1 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:31.753079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d84abf-bfdb-412c-ac5d-c816f77ae2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:31.771829 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-20d84abf-bfdb-412c-ac5d-c816f77ae2b1 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:31.773446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-20d84abf-bfdb-412c-ac5d-c816f77ae2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:31.851762 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1218/2440] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:36:31.861948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79814-cfc0-4e44-80c1-d451bade5ff9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:31.864525 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-36d79814-cfc0-4e44-80c1-d451bade5ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:31.927330 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d79814-cfc0-4e44-80c1-d451bade5ff9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:31.934262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7128e-f64b-42b2-b9ad-f2b09681d899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:31.935086 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7128e-f64b-42b2-b9ad-f2b09681d899 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:31.935435 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7128e-f64b-42b2-b9ad-f2b09681d899 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:31.935776 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7128e-f64b-42b2-b9ad-f2b09681d899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:31.945571 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7128e-f64b-42b2-b9ad-f2b09681d899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:31.948284 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7128e-f64b-42b2-b9ad-f2b09681d899 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:31.961534 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1223/2441] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:36:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:36:32.264945 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d84abf-bfdb-412c-ac5d-c816f77ae2b1 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:32.266410 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-20d84abf-bfdb-412c-ac5d-c816f77ae2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:32.280766 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d84abf-bfdb-412c-ac5d-c816f77ae2b1 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:32.286694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:32.287595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:32.287891 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:32.288150 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] PATH_INFO: `/v3/projects/b6d45815e795484a9953703b5e1312ae` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:32.290283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d45815e795484a9953703b5e1312ae)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:32.294213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:32.349913 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d45815e795484a9953703b5e1312ae', 'request_id': 'req-5766ecbe-da66-4832-8d7f-34e68bfee684'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:32.357438 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d45815e795484a9953703b5e1312ae', 'request_id': 'req-5766ecbe-da66-4832-8d7f-34e68bfee684'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:32.366024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d45815e795484a9953703b5e1312ae', 'request_id': 'req-5766ecbe-da66-4832-8d7f-34e68bfee684'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:32.378288 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] The token cache is being invalidate because project b6d45815e795484a9953703b5e1312ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:36:32.378513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:32.379360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:32.381525 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1219/2442] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:36:32 2021] DELETE /identity/v3/projects/b6d45815e795484a9953703b5e1312ae => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:32.386128 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7128e-f64b-42b2-b9ad-f2b09681d899 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:32.398155 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7128e-f64b-42b2-b9ad-f2b09681d899 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:32.476773 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aea825-631d-43c9-af1e-f639f8f2ea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:32.477679 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aea825-631d-43c9-af1e-f639f8f2ea3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:32.477960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aea825-631d-43c9-af1e-f639f8f2ea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:32.478234 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aea825-631d-43c9-af1e-f639f8f2ea3a admin admin] PATH_INFO: `/v3/users/9c9d263281ae417ea2236e502c73bde4` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:32.480167 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aea825-631d-43c9-af1e-f639f8f2ea3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9d263281ae417ea2236e502c73bde4)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:32.482113 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aea825-631d-43c9-af1e-f639f8f2ea3a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:32.538004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-50aea825-631d-43c9-af1e-f639f8f2ea3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9d263281ae417ea2236e502c73bde4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:32.547998 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-50aea825-631d-43c9-af1e-f639f8f2ea3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9d263281ae417ea2236e502c73bde4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:32.548784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-50aea825-631d-43c9-af1e-f639f8f2ea3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9d263281ae417ea2236e502c73bde4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:32.561351 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-50aea825-631d-43c9-af1e-f639f8f2ea3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9d263281ae417ea2236e502c73bde4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:32.562023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-50aea825-631d-43c9-af1e-f639f8f2ea3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9d263281ae417ea2236e502c73bde4'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:32.576569 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1224/2443] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:36:32 2021] DELETE /identity/v3/users/9c9d263281ae417ea2236e502c73bde4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:32.862177 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:32.863922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:32.886268 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766ecbe-da66-4832-8d7f-34e68bfee684 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:32.973689 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1cc2f-7f37-4285-8dfe-96183823efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:32.975184 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1cc2f-7f37-4285-8dfe-96183823efab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:32.975696 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1cc2f-7f37-4285-8dfe-96183823efab admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:32.976178 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1cc2f-7f37-4285-8dfe-96183823efab admin admin] PATH_INFO: `/v3/projects/5c1a275d73c840d488e7cefb0ca31213` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:32.977848 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1cc2f-7f37-4285-8dfe-96183823efab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1a275d73c840d488e7cefb0ca31213)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:32.980817 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1cc2f-7f37-4285-8dfe-96183823efab admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:33.085053 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f6d1cc2f-7f37-4285-8dfe-96183823efab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1a275d73c840d488e7cefb0ca31213', 'request_id': 'req-f6d1cc2f-7f37-4285-8dfe-96183823efab'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:33.096540 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f6d1cc2f-7f37-4285-8dfe-96183823efab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1a275d73c840d488e7cefb0ca31213', 'request_id': 'req-f6d1cc2f-7f37-4285-8dfe-96183823efab'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:33.108183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f6d1cc2f-7f37-4285-8dfe-96183823efab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1a275d73c840d488e7cefb0ca31213', 'request_id': 'req-f6d1cc2f-7f37-4285-8dfe-96183823efab'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:33.126074 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f6d1cc2f-7f37-4285-8dfe-96183823efab admin admin] The token cache is being invalidate because project 5c1a275d73c840d488e7cefb0ca31213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:36:33.126422 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f6d1cc2f-7f37-4285-8dfe-96183823efab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:33.127177 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-f6d1cc2f-7f37-4285-8dfe-96183823efab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:33.129098 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1220/2444] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:36:32 2021] DELETE /identity/v3/projects/5c1a275d73c840d488e7cefb0ca31213 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:33.134481 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27907988-0751-42f4-90e4-905f0e1d413c None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:33.135599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27907988-0751-42f4-90e4-905f0e1d413c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:33.135812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27907988-0751-42f4-90e4-905f0e1d413c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:33.160879 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-27907988-0751-42f4-90e4-905f0e1d413c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:33.162140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-27907988-0751-42f4-90e4-905f0e1d413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:33.242637 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1225/2445] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:33.253691 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aa3c9-19c1-4094-abb4-5218c96157b4 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:33.253990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aa3c9-19c1-4094-abb4-5218c96157b4 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:33.254310 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aa3c9-19c1-4094-abb4-5218c96157b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:33.285525 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f97aa3c9-19c1-4094-abb4-5218c96157b4 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:33.287351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f97aa3c9-19c1-4094-abb4-5218c96157b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:33.301417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1221/2446] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:33.306200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27907988-0751-42f4-90e4-905f0e1d413c None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:33.317309 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27907988-0751-42f4-90e4-905f0e1d413c None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:33.324076 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacce1e-e1db-424c-8ab8-516710cfcfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:33.324859 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacce1e-e1db-424c-8ab8-516710cfcfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:33.325219 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacce1e-e1db-424c-8ab8-516710cfcfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:33.325652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacce1e-e1db-424c-8ab8-516710cfcfd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:33.326882 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacce1e-e1db-424c-8ab8-516710cfcfd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:36:33.326882 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacce1e-e1db-424c-8ab8-516710cfcfd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:33.328523 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacce1e-e1db-424c-8ab8-516710cfcfd6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:33.341842 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1226/2447] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:36:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:36:33.350517 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97aa3c9-19c1-4094-abb4-5218c96157b4 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:33.361300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97aa3c9-19c1-4094-abb4-5218c96157b4 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:33.367390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486d717-d9f9-47a7-99f2-31743c7f45a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:33.368057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486d717-d9f9-47a7-99f2-31743c7f45a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:33.368351 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486d717-d9f9-47a7-99f2-31743c7f45a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:33.368626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486d717-d9f9-47a7-99f2-31743c7f45a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:33.369548 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486d717-d9f9-47a7-99f2-31743c7f45a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:33.371509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486d717-d9f9-47a7-99f2-31743c7f45a3 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:33.409296 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1222/2448] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:36:33 2021] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:36:33.418112 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacce1e-e1db-424c-8ab8-516710cfcfd6 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:33.431594 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacce1e-e1db-424c-8ab8-516710cfcfd6 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:33.511323 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f651365-7874-4c2e-94c4-56ae0077d6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:33.512387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f651365-7874-4c2e-94c4-56ae0077d6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:33.512842 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f651365-7874-4c2e-94c4-56ae0077d6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:33.513300 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f651365-7874-4c2e-94c4-56ae0077d6e6 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:33.514001 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f651365-7874-4c2e-94c4-56ae0077d6e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:33.516182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f651365-7874-4c2e-94c4-56ae0077d6e6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:33.537922 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1227/2449] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:36:33 2021] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:36:33.543580 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486d717-d9f9-47a7-99f2-31743c7f45a3 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:33.555079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486d717-d9f9-47a7-99f2-31743c7f45a3 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:33.564246 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782698b-870c-4b02-8a08-51c6ffec9b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:33.564924 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782698b-870c-4b02-8a08-51c6ffec9b67 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:33.565212 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782698b-870c-4b02-8a08-51c6ffec9b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:33.565495 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782698b-870c-4b02-8a08-51c6ffec9b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:33.566226 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782698b-870c-4b02-8a08-51c6ffec9b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:33.567963 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782698b-870c-4b02-8a08-51c6ffec9b67 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:33.583961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1223/2450] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:36:33 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:36:33.585621 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f651365-7874-4c2e-94c4-56ae0077d6e6 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:33.596640 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f651365-7874-4c2e-94c4-56ae0077d6e6 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:33.601764 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4882cf-7a34-4f7b-b98b-5b5b49e7c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:33.602428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4882cf-7a34-4f7b-b98b-5b5b49e7c7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:33.602718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4882cf-7a34-4f7b-b98b-5b5b49e7c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:33.603040 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4882cf-7a34-4f7b-b98b-5b5b49e7c7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:33.604058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4882cf-7a34-4f7b-b98b-5b5b49e7c7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:33.605794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4882cf-7a34-4f7b-b98b-5b5b49e7c7c3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:33.616721 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1228/2451] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:36:33 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:36:33.621831 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782698b-870c-4b02-8a08-51c6ffec9b67 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:33.633695 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782698b-870c-4b02-8a08-51c6ffec9b67 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:33.641235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5326b-39e5-4408-b0d0-c40a90a9aa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:33.642248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5326b-39e5-4408-b0d0-c40a90a9aa46 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:33.642627 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5326b-39e5-4408-b0d0-c40a90a9aa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:33.643230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5326b-39e5-4408-b0d0-c40a90a9aa46 admin admin] PATH_INFO: `/v3/projects/71d146f2b8ef4e3a807f6b89e47295cc/users/4cf3671aa0624a30a9d6151c081686a7/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:33.662236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5326b-39e5-4408-b0d0-c40a90a9aa46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d146f2b8ef4e3a807f6b89e47295cc, user_id=4cf3671aa0624a30a9d6151c081686a7, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:33.665244 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5326b-39e5-4408-b0d0-c40a90a9aa46 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:33.690900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1224/2452] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:36:33 2021] PUT /identity/v3/projects/71d146f2b8ef4e3a807f6b89e47295cc/users/4cf3671aa0624a30a9d6151c081686a7/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:33.707035 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686720c-da65-410d-b2fa-278b819e47ba None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:33.707420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686720c-da65-410d-b2fa-278b819e47ba None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:33.707709 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686720c-da65-410d-b2fa-278b819e47ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:33.742264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-4686720c-da65-410d-b2fa-278b819e47ba None None] MFA Rules not processed for user `4cf3671aa0624a30a9d6151c081686a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:33.743840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-4686720c-da65-410d-b2fa-278b819e47ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:33.866677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1229/2453] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:33 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:36:33.871809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5326b-39e5-4408-b0d0-c40a90a9aa46 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:33.946600 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5326b-39e5-4408-b0d0-c40a90a9aa46 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:33.957241 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e49dfd-3f39-499a-91a3-17e8fb269d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:33.958322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e49dfd-3f39-499a-91a3-17e8fb269d84 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:33.958779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e49dfd-3f39-499a-91a3-17e8fb269d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:33.959169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e49dfd-3f39-499a-91a3-17e8fb269d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:33.959956 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e49dfd-3f39-499a-91a3-17e8fb269d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:33.962065 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e49dfd-3f39-499a-91a3-17e8fb269d84 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:33.993164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1225/2454] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:36:33 2021] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:36:33.998678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686720c-da65-410d-b2fa-278b819e47ba None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:34.017379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686720c-da65-410d-b2fa-278b819e47ba None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:34.089851 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f8e33-38cf-42a8-bc43-23144a9d8178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:34.090738 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8e33-38cf-42a8-bc43-23144a9d8178 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:34.091123 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8e33-38cf-42a8-bc43-23144a9d8178 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:34.091453 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8e33-38cf-42a8-bc43-23144a9d8178 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:34.092336 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f8e33-38cf-42a8-bc43-23144a9d8178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:34.094559 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f8e33-38cf-42a8-bc43-23144a9d8178 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:34.128871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1230/2455] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:36:33 2021] POST /identity/v3/users => generated 303 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:36:34.134574 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e49dfd-3f39-499a-91a3-17e8fb269d84 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:34.152067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e49dfd-3f39-499a-91a3-17e8fb269d84 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:34.158082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0b016-33d3-49c5-81d3-f7aca1ad3c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:34.158763 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0b016-33d3-49c5-81d3-f7aca1ad3c06 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:34.159262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0b016-33d3-49c5-81d3-f7aca1ad3c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:34.159574 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0b016-33d3-49c5-81d3-f7aca1ad3c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:34.160310 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0b016-33d3-49c5-81d3-f7aca1ad3c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:34.162062 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0b016-33d3-49c5-81d3-f7aca1ad3c06 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:34.183124 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1226/2456] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:36:34 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:36:34.184453 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f8e33-38cf-42a8-bc43-23144a9d8178 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:34.196952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f8e33-38cf-42a8-bc43-23144a9d8178 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:34.203971 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b30f5-6a07-435c-869c-449a1d4cf658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:34.204988 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b30f5-6a07-435c-869c-449a1d4cf658 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:34.205340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b30f5-6a07-435c-869c-449a1d4cf658 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:34.205691 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b30f5-6a07-435c-869c-449a1d4cf658 admin admin] PATH_INFO: `/v3/projects/78e9d0db849849b09e5361be814a2c62/users/451cc96329f94d09b2a65441c70f3ede/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:34.233736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b30f5-6a07-435c-869c-449a1d4cf658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e9d0db849849b09e5361be814a2c62, user_id=451cc96329f94d09b2a65441c70f3ede, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:34.236569 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b30f5-6a07-435c-869c-449a1d4cf658 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:34.267694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1231/2457] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:36:34 2021] PUT /identity/v3/projects/78e9d0db849849b09e5361be814a2c62/users/451cc96329f94d09b2a65441c70f3ede/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:34.274431 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0b016-33d3-49c5-81d3-f7aca1ad3c06 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:34.290243 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0b016-33d3-49c5-81d3-f7aca1ad3c06 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:34.375347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c145d10-e133-4c27-9cf4-9c87d83abfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:34.376024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c145d10-e133-4c27-9cf4-9c87d83abfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:34.376346 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c145d10-e133-4c27-9cf4-9c87d83abfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:34.376587 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c145d10-e133-4c27-9cf4-9c87d83abfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:34.377309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c145d10-e133-4c27-9cf4-9c87d83abfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:34.381200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c145d10-e133-4c27-9cf4-9c87d83abfb1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:34.394872 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1227/2458] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:36:34 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:36:34.397573 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b30f5-6a07-435c-869c-449a1d4cf658 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:34.408430 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b30f5-6a07-435c-869c-449a1d4cf658 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:34.413989 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14694d7-7199-4c88-8c26-795f4db334de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:34.414932 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14694d7-7199-4c88-8c26-795f4db334de admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:34.415226 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14694d7-7199-4c88-8c26-795f4db334de admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:34.415507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14694d7-7199-4c88-8c26-795f4db334de admin admin] PATH_INFO: `/v3/projects/78e9d0db849849b09e5361be814a2c62/users/451cc96329f94d09b2a65441c70f3ede/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:34.418263 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14694d7-7199-4c88-8c26-795f4db334de admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e9d0db849849b09e5361be814a2c62, user_id=451cc96329f94d09b2a65441c70f3ede, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:34.421827 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14694d7-7199-4c88-8c26-795f4db334de admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:34.433878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1232/2459] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:36:34 2021] PUT /identity/v3/projects/78e9d0db849849b09e5361be814a2c62/users/451cc96329f94d09b2a65441c70f3ede/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:34.445353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1d1de-0bbc-465b-b4b1-cf101ac2e99e None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:34.445646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1d1de-0bbc-465b-b4b1-cf101ac2e99e None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:34.445924 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1d1de-0bbc-465b-b4b1-cf101ac2e99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:34.474558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-3dd1d1de-0bbc-465b-b4b1-cf101ac2e99e None None] MFA Rules not processed for user `451cc96329f94d09b2a65441c70f3ede`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:34.475824 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-3dd1d1de-0bbc-465b-b4b1-cf101ac2e99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:34.549214 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1228/2460] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:34 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:34.559662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14694d7-7199-4c88-8c26-795f4db334de admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:34.561352 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a14694d7-7199-4c88-8c26-795f4db334de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:34.622657 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14694d7-7199-4c88-8c26-795f4db334de admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:34.626466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e64008-2793-44b4-8f32-3a34ae7291f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:34.627190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e64008-2793-44b4-8f32-3a34ae7291f9 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:34.627328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e64008-2793-44b4-8f32-3a34ae7291f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:34.627607 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e64008-2793-44b4-8f32-3a34ae7291f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:34.637500 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e64008-2793-44b4-8f32-3a34ae7291f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:34.638928 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e64008-2793-44b4-8f32-3a34ae7291f9 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:34.648429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1233/2461] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:36:34 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:36:34.693861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1d1de-0bbc-465b-b4b1-cf101ac2e99e None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:34.695342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-3dd1d1de-0bbc-465b-b4b1-cf101ac2e99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:34.708597 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1d1de-0bbc-465b-b4b1-cf101ac2e99e None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:34.712258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd0164-a3a4-4eb3-80d3-36b700856cf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:34.712954 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd0164-a3a4-4eb3-80d3-36b700856cf7 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:34.714350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd0164-a3a4-4eb3-80d3-36b700856cf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:34.714631 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd0164-a3a4-4eb3-80d3-36b700856cf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:34.770017 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd0164-a3a4-4eb3-80d3-36b700856cf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:34.771502 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd0164-a3a4-4eb3-80d3-36b700856cf7 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:34.780891 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1229/2462] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:36:34 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:36:37.943979 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e64008-2793-44b4-8f32-3a34ae7291f9 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:38.004501 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e64008-2793-44b4-8f32-3a34ae7291f9 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:38.008982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b3cd7-f8e3-498c-91a9-739e66a5fd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:38.009850 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b3cd7-f8e3-498c-91a9-739e66a5fd82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:38.010138 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b3cd7-f8e3-498c-91a9-739e66a5fd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:38.010409 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b3cd7-f8e3-498c-91a9-739e66a5fd82 admin admin] PATH_INFO: `/v3/users/4cf3671aa0624a30a9d6151c081686a7` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:38.011616 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b3cd7-f8e3-498c-91a9-739e66a5fd82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cf3671aa0624a30a9d6151c081686a7)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:38.013538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b3cd7-f8e3-498c-91a9-739e66a5fd82 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:38.057942 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8a4b3cd7-f8e3-498c-91a9-739e66a5fd82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cf3671aa0624a30a9d6151c081686a7'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.064808 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8a4b3cd7-f8e3-498c-91a9-739e66a5fd82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cf3671aa0624a30a9d6151c081686a7'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.065475 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8a4b3cd7-f8e3-498c-91a9-739e66a5fd82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cf3671aa0624a30a9d6151c081686a7'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.076777 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8a4b3cd7-f8e3-498c-91a9-739e66a5fd82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cf3671aa0624a30a9d6151c081686a7'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.077406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8a4b3cd7-f8e3-498c-91a9-739e66a5fd82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cf3671aa0624a30a9d6151c081686a7'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.091166 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1234/2463] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:36:37 2021] DELETE /identity/v3/users/4cf3671aa0624a30a9d6151c081686a7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:38.095747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492737c1-3000-4a27-bdfc-6b7ed3e35c88 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:38.096240 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492737c1-3000-4a27-bdfc-6b7ed3e35c88 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:38.096357 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492737c1-3000-4a27-bdfc-6b7ed3e35c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:38.114256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-492737c1-3000-4a27-bdfc-6b7ed3e35c88 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:38.115479 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-492737c1-3000-4a27-bdfc-6b7ed3e35c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:38.171256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1230/2464] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:38.180976 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b3cd7-f8e3-498c-91a9-739e66a5fd82 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:38.182485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8a4b3cd7-f8e3-498c-91a9-739e66a5fd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:38.241940 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b3cd7-f8e3-498c-91a9-739e66a5fd82 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:38.245795 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b3d76-73b4-4f32-b164-d15351e64813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:38.246446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b3d76-73b4-4f32-b164-d15351e64813 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:38.246729 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b3d76-73b4-4f32-b164-d15351e64813 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:38.247036 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b3d76-73b4-4f32-b164-d15351e64813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:38.256208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b3d76-73b4-4f32-b164-d15351e64813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:38.257650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b3d76-73b4-4f32-b164-d15351e64813 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:38.269022 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1235/2465] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:36:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:36:38.524143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492737c1-3000-4a27-bdfc-6b7ed3e35c88 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:38.526172 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-492737c1-3000-4a27-bdfc-6b7ed3e35c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:38.538301 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492737c1-3000-4a27-bdfc-6b7ed3e35c88 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:38.543096 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:38.543964 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:38.544258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:38.544543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] PATH_INFO: `/v3/projects/71d146f2b8ef4e3a807f6b89e47295cc` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:38.545774 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d146f2b8ef4e3a807f6b89e47295cc)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:38.547777 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:38.593141 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d146f2b8ef4e3a807f6b89e47295cc', 'request_id': 'req-53d529a5-6235-40ee-ad1b-8024ace33e3a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.599067 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d146f2b8ef4e3a807f6b89e47295cc', 'request_id': 'req-53d529a5-6235-40ee-ad1b-8024ace33e3a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.607196 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d146f2b8ef4e3a807f6b89e47295cc', 'request_id': 'req-53d529a5-6235-40ee-ad1b-8024ace33e3a'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.617756 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] The token cache is being invalidate because project 71d146f2b8ef4e3a807f6b89e47295cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:36:38.617979 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.618621 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.620811 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1231/2466] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:36:38 2021] DELETE /identity/v3/projects/71d146f2b8ef4e3a807f6b89e47295cc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:38.624917 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b3d76-73b4-4f32-b164-d15351e64813 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:38.634200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b3d76-73b4-4f32-b164-d15351e64813 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:38.691023 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781567e-3e95-48a2-8fa3-45e038081c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:38.691908 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781567e-3e95-48a2-8fa3-45e038081c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:38.692195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781567e-3e95-48a2-8fa3-45e038081c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:38.692470 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781567e-3e95-48a2-8fa3-45e038081c36 admin admin] PATH_INFO: `/v3/users/451cc96329f94d09b2a65441c70f3ede` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:38.693672 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781567e-3e95-48a2-8fa3-45e038081c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=451cc96329f94d09b2a65441c70f3ede)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:38.695631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781567e-3e95-48a2-8fa3-45e038081c36 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:38.745438 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2781567e-3e95-48a2-8fa3-45e038081c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451cc96329f94d09b2a65441c70f3ede'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.752851 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2781567e-3e95-48a2-8fa3-45e038081c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451cc96329f94d09b2a65441c70f3ede'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.753551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2781567e-3e95-48a2-8fa3-45e038081c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451cc96329f94d09b2a65441c70f3ede'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.768554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2781567e-3e95-48a2-8fa3-45e038081c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451cc96329f94d09b2a65441c70f3ede'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.769266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2781567e-3e95-48a2-8fa3-45e038081c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451cc96329f94d09b2a65441c70f3ede'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:38.794108 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1236/2467] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:36:38 2021] DELETE /identity/v3/users/451cc96329f94d09b2a65441c70f3ede => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:39.089860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:39.091360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:39.108084 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d529a5-6235-40ee-ad1b-8024ace33e3a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:39.169435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ff0c7-a46f-4717-bb1d-8c036772892c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:39.170296 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff0c7-a46f-4717-bb1d-8c036772892c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.170586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff0c7-a46f-4717-bb1d-8c036772892c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.170898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff0c7-a46f-4717-bb1d-8c036772892c admin admin] PATH_INFO: `/v3/projects/78e9d0db849849b09e5361be814a2c62` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.172078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ff0c7-a46f-4717-bb1d-8c036772892c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78e9d0db849849b09e5361be814a2c62)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:39.173999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ff0c7-a46f-4717-bb1d-8c036772892c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:39.225340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-499ff0c7-a46f-4717-bb1d-8c036772892c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78e9d0db849849b09e5361be814a2c62', 'request_id': 'req-499ff0c7-a46f-4717-bb1d-8c036772892c'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:39.232491 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-499ff0c7-a46f-4717-bb1d-8c036772892c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78e9d0db849849b09e5361be814a2c62', 'request_id': 'req-499ff0c7-a46f-4717-bb1d-8c036772892c'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:39.239119 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-499ff0c7-a46f-4717-bb1d-8c036772892c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78e9d0db849849b09e5361be814a2c62', 'request_id': 'req-499ff0c7-a46f-4717-bb1d-8c036772892c'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:39.250072 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-499ff0c7-a46f-4717-bb1d-8c036772892c admin admin] The token cache is being invalidate because project 78e9d0db849849b09e5361be814a2c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:36:39.250373 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-499ff0c7-a46f-4717-bb1d-8c036772892c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:39.251037 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-499ff0c7-a46f-4717-bb1d-8c036772892c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:39.252575 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1232/2468] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:36:39 2021] DELETE /identity/v3/projects/78e9d0db849849b09e5361be814a2c62 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:39.258779 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f780c-b05b-42e8-a880-31ce46ca5870 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.259284 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f780c-b05b-42e8-a880-31ce46ca5870 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.259489 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f780c-b05b-42e8-a880-31ce46ca5870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.282327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-d25f780c-b05b-42e8-a880-31ce46ca5870 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:39.283640 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d25f780c-b05b-42e8-a880-31ce46ca5870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:39.356112 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1237/2469] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:39.363729 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc2874-ace1-408f-b103-453673cc459a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.364027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc2874-ace1-408f-b103-453673cc459a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.364322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc2874-ace1-408f-b103-453673cc459a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.382770 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-8abc2874-ace1-408f-b103-453673cc459a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:39.384131 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8abc2874-ace1-408f-b103-453673cc459a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:39.392632 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1233/2470] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:39.396816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f780c-b05b-42e8-a880-31ce46ca5870 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:39.406727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f780c-b05b-42e8-a880-31ce46ca5870 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:39.411388 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575bde7-21ae-42e7-9383-10c9415ae74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:39.412051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575bde7-21ae-42e7-9383-10c9415ae74d admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.412337 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575bde7-21ae-42e7-9383-10c9415ae74d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.412733 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575bde7-21ae-42e7-9383-10c9415ae74d admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.413459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575bde7-21ae-42e7-9383-10c9415ae74d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:36:39.413771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575bde7-21ae-42e7-9383-10c9415ae74d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:39.415406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575bde7-21ae-42e7-9383-10c9415ae74d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:39.432201 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1238/2471] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:36:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:36:39.434068 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc2874-ace1-408f-b103-453673cc459a None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:39.446211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc2874-ace1-408f-b103-453673cc459a None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:39.453590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e27d1-d6e7-4dd5-a527-a7981b45360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:39.454261 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e27d1-d6e7-4dd5-a527-a7981b45360d admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.454543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e27d1-d6e7-4dd5-a527-a7981b45360d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.454820 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e27d1-d6e7-4dd5-a527-a7981b45360d admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.455596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e27d1-d6e7-4dd5-a527-a7981b45360d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:39.457559 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e27d1-d6e7-4dd5-a527-a7981b45360d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:39.487918 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fc794-ff0f-4f94-b8c5-fd525e9d5b54 None None] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.488462 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fc794-ff0f-4f94-b8c5-fd525e9d5b54 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.488847 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fc794-ff0f-4f94-b8c5-fd525e9d5b54 None None] PATH_INFO: `/` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.490800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1239/2473] 10.222.0.50 () {54 vars in 921 bytes} [Tue Nov 16 00:36:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 00:36:39.494897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fc794-ff0f-4f94-b8c5-fd525e9d5b54 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:39.499031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1234/2472] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:36:39 2021] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:36:39.500692 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51558ab7-8d54-422b-96c9-e36af8f567d3 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.500983 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51558ab7-8d54-422b-96c9-e36af8f567d3 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.501270 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51558ab7-8d54-422b-96c9-e36af8f567d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.541821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-51558ab7-8d54-422b-96c9-e36af8f567d3 None None] MFA Rules not processed for user `442cc0e13dcb49f0a4a870c06e0edf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:39.543276 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-51558ab7-8d54-422b-96c9-e36af8f567d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:39.566175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fc794-ff0f-4f94-b8c5-fd525e9d5b54 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:39.574573 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16079345-7fc6-44f5-93d9-3c3124ff58b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:39.575295 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16079345-7fc6-44f5-93d9-3c3124ff58b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.575678 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16079345-7fc6-44f5-93d9-3c3124ff58b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.575980 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16079345-7fc6-44f5-93d9-3c3124ff58b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.576982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16079345-7fc6-44f5-93d9-3c3124ff58b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:39.580148 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16079345-7fc6-44f5-93d9-3c3124ff58b0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:39.602555 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1240/2474] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:36:39 2021] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:36:39.608216 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16079345-7fc6-44f5-93d9-3c3124ff58b0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:39.618038 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1235/2475] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Nov 16 00:36:39 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:36:39.619833 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16079345-7fc6-44f5-93d9-3c3124ff58b0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:39.627521 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b66b3b-015d-4c8d-b305-d4ca9570b156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:39.628276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b66b3b-015d-4c8d-b305-d4ca9570b156 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.628564 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b66b3b-015d-4c8d-b305-d4ca9570b156 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.628844 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b66b3b-015d-4c8d-b305-d4ca9570b156 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.629798 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b66b3b-015d-4c8d-b305-d4ca9570b156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:39.631161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51558ab7-8d54-422b-96c9-e36af8f567d3 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:39.631492 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b66b3b-015d-4c8d-b305-d4ca9570b156 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:39.632595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-51558ab7-8d54-422b-96c9-e36af8f567d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:39.644254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1241/2476] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:36:39 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:36:39.649208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b66b3b-015d-4c8d-b305-d4ca9570b156 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:39.660067 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b66b3b-015d-4c8d-b305-d4ca9570b156 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:39.664870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc5fdf-c9f7-40d5-b325-644c0f965f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:39.665543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc5fdf-c9f7-40d5-b325-644c0f965f76 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.666523 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc5fdf-c9f7-40d5-b325-644c0f965f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.666981 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc5fdf-c9f7-40d5-b325-644c0f965f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.667904 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc5fdf-c9f7-40d5-b325-644c0f965f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:39.669506 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc5fdf-c9f7-40d5-b325-644c0f965f76 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:39.679344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1242/2477] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:36:39 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 00:36:39.684049 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc5fdf-c9f7-40d5-b325-644c0f965f76 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:39.694017 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc5fdf-c9f7-40d5-b325-644c0f965f76 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:39.699500 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21474619-8d0d-4810-a9ec-f42ca76dcc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:39.700374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21474619-8d0d-4810-a9ec-f42ca76dcc32 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.700642 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21474619-8d0d-4810-a9ec-f42ca76dcc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.700916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21474619-8d0d-4810-a9ec-f42ca76dcc32 admin admin] PATH_INFO: `/v3/projects/e1924e4342194844a6d9523ecb6d0d24/users/76efb83d7e754622ac900586a92cb237/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.716149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21474619-8d0d-4810-a9ec-f42ca76dcc32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1924e4342194844a6d9523ecb6d0d24, user_id=76efb83d7e754622ac900586a92cb237, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:39.717453 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51558ab7-8d54-422b-96c9-e36af8f567d3 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:39.719064 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21474619-8d0d-4810-a9ec-f42ca76dcc32 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:39.721164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e131a7-1d11-4317-ad6d-ff7d6957a1ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cab78404d3c4980a4b99da09edab426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:39.721815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e131a7-1d11-4317-ad6d-ff7d6957a1ad service glance] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.722109 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e131a7-1d11-4317-ad6d-ff7d6957a1ad service glance] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.722387 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e131a7-1d11-4317-ad6d-ff7d6957a1ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.733164 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1243/2478] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:36:39 2021] PUT /identity/v3/projects/e1924e4342194844a6d9523ecb6d0d24/users/76efb83d7e754622ac900586a92cb237/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:36:39.739055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e131a7-1d11-4317-ad6d-ff7d6957a1ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:39.739055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e131a7-1d11-4317-ad6d-ff7d6957a1ad service glance] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:39.743005 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b063a-18cd-4794-beb6-0179ec451d31 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.743294 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b063a-18cd-4794-beb6-0179ec451d31 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.743568 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b063a-18cd-4794-beb6-0179ec451d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.746344 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1236/2479] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:36:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:36:39.769336 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-011b063a-18cd-4794-beb6-0179ec451d31 None None] MFA Rules not processed for user `76efb83d7e754622ac900586a92cb237`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:39.770520 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-011b063a-18cd-4794-beb6-0179ec451d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:39.818472 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc264442-febe-434e-80c9-648b8e587a0c None None] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.818911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc264442-febe-434e-80c9-648b8e587a0c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.819197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc264442-febe-434e-80c9-648b8e587a0c None None] PATH_INFO: `/` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.820993 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1237/2480] 10.222.0.50 () {54 vars in 921 bytes} [Tue Nov 16 00:36:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 00:36:39.826793 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060b89e-2f45-4dee-a1fb-598c82ccd6ee None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.827204 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060b89e-2f45-4dee-a1fb-598c82ccd6ee None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.827550 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060b89e-2f45-4dee-a1fb-598c82ccd6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.839668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1244/2481] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:39 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:36:39.846303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0060b89e-2f45-4dee-a1fb-598c82ccd6ee None None] MFA Rules not processed for user `7893cca0610b40abb9c45414f3690df0`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:39.847526 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0060b89e-2f45-4dee-a1fb-598c82ccd6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:39.850333 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b063a-18cd-4794-beb6-0179ec451d31 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:39.851866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-011b063a-18cd-4794-beb6-0179ec451d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:39.898919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1238/2482] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Nov 16 00:36:39 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 00:36:39.910167 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060b89e-2f45-4dee-a1fb-598c82ccd6ee None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:39.911612 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0060b89e-2f45-4dee-a1fb-598c82ccd6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:39.911738 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b063a-18cd-4794-beb6-0179ec451d31 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:39.916404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd93fba-8ed3-40a8-aeda-9c3eaded33f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:39.917373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd93fba-8ed3-40a8-aeda-9c3eaded33f4 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.918348 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd93fba-8ed3-40a8-aeda-9c3eaded33f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.918641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd93fba-8ed3-40a8-aeda-9c3eaded33f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.922470 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060b89e-2f45-4dee-a1fb-598c82ccd6ee None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:39.926281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73db6b-3b2e-4f77-9cc7-ad398793639f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:39.927059 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73db6b-3b2e-4f77-9cc7-ad398793639f service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:39.927383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73db6b-3b2e-4f77-9cc7-ad398793639f service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:39.927569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73db6b-3b2e-4f77-9cc7-ad398793639f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:39.928102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd93fba-8ed3-40a8-aeda-9c3eaded33f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:39.929554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd93fba-8ed3-40a8-aeda-9c3eaded33f4 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:39.936557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73db6b-3b2e-4f77-9cc7-ad398793639f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:39.938022 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73db6b-3b2e-4f77-9cc7-ad398793639f service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:39.940238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1245/2483] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:36:39 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:36:39.952041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1239/2484] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:36:39 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:36:39.964878 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd93fba-8ed3-40a8-aeda-9c3eaded33f4 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:40.031129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd93fba-8ed3-40a8-aeda-9c3eaded33f4 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:40.035704 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff19b8-2f8a-491f-84f1-5fe433e5b3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:40.036567 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff19b8-2f8a-491f-84f1-5fe433e5b3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:40.036845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff19b8-2f8a-491f-84f1-5fe433e5b3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:40.037114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff19b8-2f8a-491f-84f1-5fe433e5b3ed admin admin] PATH_INFO: `/v3/users/76efb83d7e754622ac900586a92cb237` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:40.038342 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff19b8-2f8a-491f-84f1-5fe433e5b3ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=76efb83d7e754622ac900586a92cb237)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:40.040279 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff19b8-2f8a-491f-84f1-5fe433e5b3ed admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:40.086332 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-56ff19b8-2f8a-491f-84f1-5fe433e5b3ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76efb83d7e754622ac900586a92cb237'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:40.093849 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-56ff19b8-2f8a-491f-84f1-5fe433e5b3ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76efb83d7e754622ac900586a92cb237'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:40.094587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-56ff19b8-2f8a-491f-84f1-5fe433e5b3ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76efb83d7e754622ac900586a92cb237'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:40.107085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-56ff19b8-2f8a-491f-84f1-5fe433e5b3ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76efb83d7e754622ac900586a92cb237'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:40.107778 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-56ff19b8-2f8a-491f-84f1-5fe433e5b3ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76efb83d7e754622ac900586a92cb237'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:40.121596 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1246/2485] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:36:39 2021] DELETE /identity/v3/users/76efb83d7e754622ac900586a92cb237 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:40.126462 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554c9d2-c795-4ea8-9118-159d807fea05 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:40.126462 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554c9d2-c795-4ea8-9118-159d807fea05 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:40.126953 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554c9d2-c795-4ea8-9118-159d807fea05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:40.144421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-2554c9d2-c795-4ea8-9118-159d807fea05 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:40.145704 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2554c9d2-c795-4ea8-9118-159d807fea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:40.206493 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1240/2486] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:40.217108 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff19b8-2f8a-491f-84f1-5fe433e5b3ed admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:40.218615 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-56ff19b8-2f8a-491f-84f1-5fe433e5b3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:40.274948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff19b8-2f8a-491f-84f1-5fe433e5b3ed admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:40.280757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4c566-9288-4c56-a5e8-f8f1849ad97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:40.281421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c566-9288-4c56-a5e8-f8f1849ad97e service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:40.281710 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c566-9288-4c56-a5e8-f8f1849ad97e service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:40.281992 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c566-9288-4c56-a5e8-f8f1849ad97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:40.293806 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4c566-9288-4c56-a5e8-f8f1849ad97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:40.295325 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4c566-9288-4c56-a5e8-f8f1849ad97e service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:40.305826 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1247/2487] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:36:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:36:40.565634 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554c9d2-c795-4ea8-9118-159d807fea05 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:40.567270 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2554c9d2-c795-4ea8-9118-159d807fea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:40.580496 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554c9d2-c795-4ea8-9118-159d807fea05 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:40.586368 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:40.587704 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:40.588796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:40.589300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8 admin admin] PATH_INFO: `/v3/projects/e1924e4342194844a6d9523ecb6d0d24` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:40.590671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1924e4342194844a6d9523ecb6d0d24)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:40.592781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:40.639034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1924e4342194844a6d9523ecb6d0d24', 'request_id': 'req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:40.644899 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1924e4342194844a6d9523ecb6d0d24', 'request_id': 'req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:40.653253 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1924e4342194844a6d9523ecb6d0d24', 'request_id': 'req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:40.663616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8 admin admin] The token cache is being invalidate because project e1924e4342194844a6d9523ecb6d0d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:36:40.663910 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:40.664552 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4b3d82bc-ae2c-4043-9d0c-d98f4c76f7b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:36:40.667625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1241/2488] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:36:40 2021] DELETE /identity/v3/projects/e1924e4342194844a6d9523ecb6d0d24 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 00:36:40.671783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c6ea3-af0c-4492-9241-c43fb8791557 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:40.672097 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c6ea3-af0c-4492-9241-c43fb8791557 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:40.672375 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c6ea3-af0c-4492-9241-c43fb8791557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:40.690598 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-fb4c6ea3-af0c-4492-9241-c43fb8791557 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:40.691859 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-fb4c6ea3-af0c-4492-9241-c43fb8791557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:40.751242 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1248/2489] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:40.760994 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705f7cc-5858-479f-b81b-a317826cf6ec None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:40.761284 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705f7cc-5858-479f-b81b-a317826cf6ec None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:40.761563 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705f7cc-5858-479f-b81b-a317826cf6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:40.781251 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f705f7cc-5858-479f-b81b-a317826cf6ec None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:40.782447 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f705f7cc-5858-479f-b81b-a317826cf6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:40.790810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1242/2490] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:40.795646 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c6ea3-af0c-4492-9241-c43fb8791557 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:40.805881 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c6ea3-af0c-4492-9241-c43fb8791557 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:40.811552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4e269-668a-41f3-8b6d-af935a433cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:40.812158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4e269-668a-41f3-8b6d-af935a433cde admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:40.812443 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4e269-668a-41f3-8b6d-af935a433cde admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:40.812723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4e269-668a-41f3-8b6d-af935a433cde admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:40.813445 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4e269-668a-41f3-8b6d-af935a433cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:36:40.813755 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4e269-668a-41f3-8b6d-af935a433cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:40.815432 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4e269-668a-41f3-8b6d-af935a433cde admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:40.828804 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1249/2491] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:36:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:36:40.833004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705f7cc-5858-479f-b81b-a317826cf6ec None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:40.842012 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705f7cc-5858-479f-b81b-a317826cf6ec None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:40.846641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5b1ea-e572-427b-a1b4-1b61c66f88a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:40.847332 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5b1ea-e572-427b-a1b4-1b61c66f88a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:40.847616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5b1ea-e572-427b-a1b4-1b61c66f88a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:40.847900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5b1ea-e572-427b-a1b4-1b61c66f88a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:40.848591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5b1ea-e572-427b-a1b4-1b61c66f88a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:40.850732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5b1ea-e572-427b-a1b4-1b61c66f88a4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:40.875355 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1243/2492] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:36:40 2021] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:36:40.879501 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4e269-668a-41f3-8b6d-af935a433cde admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:40.890491 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4e269-668a-41f3-8b6d-af935a433cde admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:40.942565 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bf78b-4c99-42aa-acd5-bab174ed264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:40.943269 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bf78b-4c99-42aa-acd5-bab174ed264e admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:40.943552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bf78b-4c99-42aa-acd5-bab174ed264e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:40.943825 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bf78b-4c99-42aa-acd5-bab174ed264e admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:40.944508 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bf78b-4c99-42aa-acd5-bab174ed264e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:40.946396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bf78b-4c99-42aa-acd5-bab174ed264e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:40.966182 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1250/2493] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:36:40 2021] POST /identity/v3/users => generated 285 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:36:40.970264 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5b1ea-e572-427b-a1b4-1b61c66f88a4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:40.981020 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5b1ea-e572-427b-a1b4-1b61c66f88a4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:40.985600 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570aa68-166b-4969-9414-6c6c23498898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:40.986249 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570aa68-166b-4969-9414-6c6c23498898 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:40.986531 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570aa68-166b-4969-9414-6c6c23498898 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:40.986810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570aa68-166b-4969-9414-6c6c23498898 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:40.987552 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570aa68-166b-4969-9414-6c6c23498898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:40.989143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570aa68-166b-4969-9414-6c6c23498898 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:40.999881 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1244/2494] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:36:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:36:41.003891 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bf78b-4c99-42aa-acd5-bab174ed264e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:41.015069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bf78b-4c99-42aa-acd5-bab174ed264e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:41.020388 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f844ba5-1681-402d-8ed8-6c7289b0ac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:41.021391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844ba5-1681-402d-8ed8-6c7289b0ac44 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:41.021966 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844ba5-1681-402d-8ed8-6c7289b0ac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:41.022331 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844ba5-1681-402d-8ed8-6c7289b0ac44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:41.023336 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f844ba5-1681-402d-8ed8-6c7289b0ac44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:41.025007 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f844ba5-1681-402d-8ed8-6c7289b0ac44 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:41.036071 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1251/2495] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:36:41 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:36:41.040215 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570aa68-166b-4969-9414-6c6c23498898 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:41.050733 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570aa68-166b-4969-9414-6c6c23498898 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:41.055699 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a001-1f97-41dd-9fc6-564d0b7e9f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:41.057421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a001-1f97-41dd-9fc6-564d0b7e9f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:41.057741 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a001-1f97-41dd-9fc6-564d0b7e9f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:41.058043 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a001-1f97-41dd-9fc6-564d0b7e9f93 admin admin] PATH_INFO: `/v3/projects/65f604c373c7454298235e43ad64d7d4/users/779d8f87ac7649cf82fd26c8935ea28b/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:41.073944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542a001-1f97-41dd-9fc6-564d0b7e9f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f604c373c7454298235e43ad64d7d4, user_id=779d8f87ac7649cf82fd26c8935ea28b, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:41.076762 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542a001-1f97-41dd-9fc6-564d0b7e9f93 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:41.089224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1245/2496] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:36:41 2021] PUT /identity/v3/projects/65f604c373c7454298235e43ad64d7d4/users/779d8f87ac7649cf82fd26c8935ea28b/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:36:41.099547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb07d9-f8bd-45e5-b135-c56b6fa1c9e4 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:41.099899 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb07d9-f8bd-45e5-b135-c56b6fa1c9e4 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:41.100375 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb07d9-f8bd-45e5-b135-c56b6fa1c9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:41.131450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-13fb07d9-f8bd-45e5-b135-c56b6fa1c9e4 None None] MFA Rules not processed for user `779d8f87ac7649cf82fd26c8935ea28b`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:41.132694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-13fb07d9-f8bd-45e5-b135-c56b6fa1c9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:41.198906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1252/2497] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:36:41 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:41.210737 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a001-1f97-41dd-9fc6-564d0b7e9f93 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:41.212582 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e542a001-1f97-41dd-9fc6-564d0b7e9f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:41.269187 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a001-1f97-41dd-9fc6-564d0b7e9f93 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:41.273192 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81418e-274b-4586-8420-143315324036 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cab78404d3c4980a4b99da09edab426', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:41.273837 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81418e-274b-4586-8420-143315324036 service glance] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:41.274121 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81418e-274b-4586-8420-143315324036 service glance] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:41.274394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81418e-274b-4586-8420-143315324036 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:41.283190 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81418e-274b-4586-8420-143315324036 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:41.284546 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81418e-274b-4586-8420-143315324036 service glance] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:41.294942 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1246/2498] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:36:41 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:36:42.633838 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda083d-6509-4d8f-9667-8bb353590de0 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:42.634329 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda083d-6509-4d8f-9667-8bb353590de0 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:42.634455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda083d-6509-4d8f-9667-8bb353590de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:42.653276 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-6cda083d-6509-4d8f-9667-8bb353590de0 None None] MFA Rules not processed for user `f6af4c462c6347ff8abbcc8770874b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:36:42.654520 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6cda083d-6509-4d8f-9667-8bb353590de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:42.715307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1253/2499] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Nov 16 00:36:42 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:36:42.728242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81418e-274b-4586-8420-143315324036 service glance] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:42.730347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2c81418e-274b-4586-8420-143315324036 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:42.798774 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81418e-274b-4586-8420-143315324036 service glance] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:42.803931 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb3d68-26b9-49d2-b327-671f0b302b25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac32c6730654a889472a3bad95374bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:42.804578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb3d68-26b9-49d2-b327-671f0b302b25 service swift] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:42.804866 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb3d68-26b9-49d2-b327-671f0b302b25 service swift] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:42.805148 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb3d68-26b9-49d2-b327-671f0b302b25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:42.813581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb3d68-26b9-49d2-b327-671f0b302b25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:42.815203 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb3d68-26b9-49d2-b327-671f0b302b25 service swift] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:42.823136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1247/2500] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Nov 16 00:36:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 00:36:44.257441 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda083d-6509-4d8f-9667-8bb353590de0 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:44.259006 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6cda083d-6509-4d8f-9667-8bb353590de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:44.313489 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda083d-6509-4d8f-9667-8bb353590de0 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:44.317095 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374a64f-2434-4803-93b5-7f6b288a14fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:44.317746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374a64f-2434-4803-93b5-7f6b288a14fe service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:44.318036 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374a64f-2434-4803-93b5-7f6b288a14fe service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:44.318315 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374a64f-2434-4803-93b5-7f6b288a14fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:44.320086 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e374a64f-2434-4803-93b5-7f6b288a14fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:44.393799 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374a64f-2434-4803-93b5-7f6b288a14fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:44.395374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374a64f-2434-4803-93b5-7f6b288a14fe service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:44.407394 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1254/2501] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:36:44 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:36:50.270481 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb3d68-26b9-49d2-b327-671f0b302b25 service swift] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:36:50.272020 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6bcb3d68-26b9-49d2-b327-671f0b302b25 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:50.288293 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb3d68-26b9-49d2-b327-671f0b302b25 service swift] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:36:50.293884 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d1a03-879e-43bd-b250-aaefc8753f90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:36:50.294540 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d1a03-879e-43bd-b250-aaefc8753f90 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:36:50.294825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d1a03-879e-43bd-b250-aaefc8753f90 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:36:50.295130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d1a03-879e-43bd-b250-aaefc8753f90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:36:50.296890 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-061d1a03-879e-43bd-b250-aaefc8753f90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:36:50.354568 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d1a03-879e-43bd-b250-aaefc8753f90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:36:50.356863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d1a03-879e-43bd-b250-aaefc8753f90 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:36:50.367119 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1248/2502] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:36:50 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:37:22.631484 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374a64f-2434-4803-93b5-7f6b288a14fe service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:22.691500 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374a64f-2434-4803-93b5-7f6b288a14fe service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:22.696056 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deeb68-59ca-4e62-a19b-fcb697d6ba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:22.696917 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deeb68-59ca-4e62-a19b-fcb697d6ba64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:22.697204 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deeb68-59ca-4e62-a19b-fcb697d6ba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:22.697486 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deeb68-59ca-4e62-a19b-fcb697d6ba64 admin admin] PATH_INFO: `/v3/users/779d8f87ac7649cf82fd26c8935ea28b` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:22.699277 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deeb68-59ca-4e62-a19b-fcb697d6ba64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=779d8f87ac7649cf82fd26c8935ea28b)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:22.701198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deeb68-59ca-4e62-a19b-fcb697d6ba64 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:22.746689 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b2deeb68-59ca-4e62-a19b-fcb697d6ba64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '779d8f87ac7649cf82fd26c8935ea28b'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:22.754792 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b2deeb68-59ca-4e62-a19b-fcb697d6ba64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '779d8f87ac7649cf82fd26c8935ea28b'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:22.755594 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b2deeb68-59ca-4e62-a19b-fcb697d6ba64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '779d8f87ac7649cf82fd26c8935ea28b'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:22.768498 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b2deeb68-59ca-4e62-a19b-fcb697d6ba64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '779d8f87ac7649cf82fd26c8935ea28b'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:22.769165 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b2deeb68-59ca-4e62-a19b-fcb697d6ba64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '779d8f87ac7649cf82fd26c8935ea28b'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:22.781870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1255/2503] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:37:22 2021] DELETE /identity/v3/users/779d8f87ac7649cf82fd26c8935ea28b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:37:22.786392 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40fb52-a1b0-486e-a8fc-d279f60b3bc0 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:22.786925 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40fb52-a1b0-486e-a8fc-d279f60b3bc0 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:22.787044 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40fb52-a1b0-486e-a8fc-d279f60b3bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:22.804183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0b40fb52-a1b0-486e-a8fc-d279f60b3bc0 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:37:22.805390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0b40fb52-a1b0-486e-a8fc-d279f60b3bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:22.861490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1249/2504] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:37:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:37:22.872410 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deeb68-59ca-4e62-a19b-fcb697d6ba64 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:22.873743 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b2deeb68-59ca-4e62-a19b-fcb697d6ba64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:22.935270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deeb68-59ca-4e62-a19b-fcb697d6ba64 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:22.939207 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96032fb-d48e-49fb-ad42-92bd2bb70309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:22.939865 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96032fb-d48e-49fb-ad42-92bd2bb70309 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:22.940149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96032fb-d48e-49fb-ad42-92bd2bb70309 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:22.940427 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96032fb-d48e-49fb-ad42-92bd2bb70309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:22.950909 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96032fb-d48e-49fb-ad42-92bd2bb70309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:22.952309 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96032fb-d48e-49fb-ad42-92bd2bb70309 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:22.964394 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1256/2505] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:37:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:37:23.232710 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40fb52-a1b0-486e-a8fc-d279f60b3bc0 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:23.234219 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0b40fb52-a1b0-486e-a8fc-d279f60b3bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:23.247658 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40fb52-a1b0-486e-a8fc-d279f60b3bc0 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:23.252709 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6c086-5589-4908-89da-50501eb7ca08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:23.253567 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6c086-5589-4908-89da-50501eb7ca08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:23.253857 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6c086-5589-4908-89da-50501eb7ca08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:23.254138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6c086-5589-4908-89da-50501eb7ca08 admin admin] PATH_INFO: `/v3/projects/65f604c373c7454298235e43ad64d7d4` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:23.255355 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6c086-5589-4908-89da-50501eb7ca08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f604c373c7454298235e43ad64d7d4)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:23.257379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6c086-5589-4908-89da-50501eb7ca08 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:23.304888 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4df6c086-5589-4908-89da-50501eb7ca08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f604c373c7454298235e43ad64d7d4', 'request_id': 'req-4df6c086-5589-4908-89da-50501eb7ca08'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:23.311854 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4df6c086-5589-4908-89da-50501eb7ca08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f604c373c7454298235e43ad64d7d4', 'request_id': 'req-4df6c086-5589-4908-89da-50501eb7ca08'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:23.318676 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4df6c086-5589-4908-89da-50501eb7ca08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f604c373c7454298235e43ad64d7d4', 'request_id': 'req-4df6c086-5589-4908-89da-50501eb7ca08'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:23.329128 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4df6c086-5589-4908-89da-50501eb7ca08 admin admin] The token cache is being invalidate because project 65f604c373c7454298235e43ad64d7d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:37:23.329413 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4df6c086-5589-4908-89da-50501eb7ca08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:23.330029 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4df6c086-5589-4908-89da-50501eb7ca08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:23.331568 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1250/2506] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:37:23 2021] DELETE /identity/v3/projects/65f604c373c7454298235e43ad64d7d4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:37:23.337218 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2614-781a-4a0a-8868-7f90bdabfc49 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:23.337538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2614-781a-4a0a-8868-7f90bdabfc49 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:23.337817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2614-781a-4a0a-8868-7f90bdabfc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:23.355570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c06a2614-781a-4a0a-8868-7f90bdabfc49 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:37:23.356776 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c06a2614-781a-4a0a-8868-7f90bdabfc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:23.415534 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1257/2507] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:37:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:37:23.424709 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2c61e-a8f5-4ef3-8362-cffa6f5ac24c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:23.425000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2c61e-a8f5-4ef3-8362-cffa6f5ac24c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:23.425288 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2c61e-a8f5-4ef3-8362-cffa6f5ac24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:23.444458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f8e2c61e-a8f5-4ef3-8362-cffa6f5ac24c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:37:23.445665 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f8e2c61e-a8f5-4ef3-8362-cffa6f5ac24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:23.453574 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1251/2508] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:37:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:37:23.457757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2614-781a-4a0a-8868-7f90bdabfc49 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:23.468298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2614-781a-4a0a-8868-7f90bdabfc49 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:23.472910 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f1c25-da9f-4bb6-ae6a-2c9eb513b0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:23.473561 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f1c25-da9f-4bb6-ae6a-2c9eb513b0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:23.473840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f1c25-da9f-4bb6-ae6a-2c9eb513b0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:23.474366 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f1c25-da9f-4bb6-ae6a-2c9eb513b0c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:23.475108 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f1c25-da9f-4bb6-ae6a-2c9eb513b0c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:37:23.475413 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f1c25-da9f-4bb6-ae6a-2c9eb513b0c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:23.477001 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f1c25-da9f-4bb6-ae6a-2c9eb513b0c4 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:23.488761 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1258/2509] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:37:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 00:37:23.492782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2c61e-a8f5-4ef3-8362-cffa6f5ac24c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:23.501859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2c61e-a8f5-4ef3-8362-cffa6f5ac24c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:23.506532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd35b6-f107-4c8c-83b9-7e2b931aca4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:23.507210 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd35b6-f107-4c8c-83b9-7e2b931aca4a admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:23.507497 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd35b6-f107-4c8c-83b9-7e2b931aca4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:23.507796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd35b6-f107-4c8c-83b9-7e2b931aca4a admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:23.508486 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd35b6-f107-4c8c-83b9-7e2b931aca4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:23.510381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd35b6-f107-4c8c-83b9-7e2b931aca4a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:23.535388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1252/2510] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:37:23 2021] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:37:23.539513 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f1c25-da9f-4bb6-ae6a-2c9eb513b0c4 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:23.549734 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f1c25-da9f-4bb6-ae6a-2c9eb513b0c4 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:23.602533 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a06d5-cffe-44e1-b3d0-06218095ce06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:23.603223 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a06d5-cffe-44e1-b3d0-06218095ce06 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:23.603508 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a06d5-cffe-44e1-b3d0-06218095ce06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:23.603831 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a06d5-cffe-44e1-b3d0-06218095ce06 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:23.604530 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a06d5-cffe-44e1-b3d0-06218095ce06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:23.607244 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a06d5-cffe-44e1-b3d0-06218095ce06 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:23.626999 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1259/2511] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:37:23 2021] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:37:23.631323 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd35b6-f107-4c8c-83b9-7e2b931aca4a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:23.641806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd35b6-f107-4c8c-83b9-7e2b931aca4a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:23.646433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c58bc-5680-44ca-9129-9af05bcc66ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:23.647123 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c58bc-5680-44ca-9129-9af05bcc66ff admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:23.647457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c58bc-5680-44ca-9129-9af05bcc66ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:23.647693 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c58bc-5680-44ca-9129-9af05bcc66ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:23.648407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c58bc-5680-44ca-9129-9af05bcc66ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:23.650040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c58bc-5680-44ca-9129-9af05bcc66ff admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:23.661132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1253/2512] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:37:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:37:23.664802 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a06d5-cffe-44e1-b3d0-06218095ce06 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:23.675662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a06d5-cffe-44e1-b3d0-06218095ce06 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:23.680239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2e56e-f991-48fd-98ed-9e99e2f53757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:23.680894 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2e56e-f991-48fd-98ed-9e99e2f53757 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:23.681180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2e56e-f991-48fd-98ed-9e99e2f53757 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:23.681458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2e56e-f991-48fd-98ed-9e99e2f53757 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:23.682181 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2e56e-f991-48fd-98ed-9e99e2f53757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:23.684547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2e56e-f991-48fd-98ed-9e99e2f53757 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:23.694331 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1260/2513] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:37:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:37:23.699683 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c58bc-5680-44ca-9129-9af05bcc66ff admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:23.709401 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c58bc-5680-44ca-9129-9af05bcc66ff admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:23.714035 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6014d-1c5b-4449-9a04-5cfacf0e23ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:23.715427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6014d-1c5b-4449-9a04-5cfacf0e23ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:23.715715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6014d-1c5b-4449-9a04-5cfacf0e23ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:23.715989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6014d-1c5b-4449-9a04-5cfacf0e23ad admin admin] PATH_INFO: `/v3/projects/0792570778f2411ba54e39035329a374/users/dc481d6a05a2408a9b279078aba5b81c/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:23.730330 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6014d-1c5b-4449-9a04-5cfacf0e23ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0792570778f2411ba54e39035329a374, user_id=dc481d6a05a2408a9b279078aba5b81c, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:23.733004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6014d-1c5b-4449-9a04-5cfacf0e23ad admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:23.746237 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1254/2514] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:37:23 2021] PUT /identity/v3/projects/0792570778f2411ba54e39035329a374/users/dc481d6a05a2408a9b279078aba5b81c/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:37:23.757060 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056880-3f4f-4e2c-a577-8e65b5dc399a None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:23.757613 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056880-3f4f-4e2c-a577-8e65b5dc399a None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:23.757927 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056880-3f4f-4e2c-a577-8e65b5dc399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:23.785310 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-94056880-3f4f-4e2c-a577-8e65b5dc399a None None] MFA Rules not processed for user `dc481d6a05a2408a9b279078aba5b81c`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:37:23.786503 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-94056880-3f4f-4e2c-a577-8e65b5dc399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:23.848745 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1261/2515] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:37:23 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:37:23.860040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6014d-1c5b-4449-9a04-5cfacf0e23ad admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:23.861799 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6fb6014d-1c5b-4449-9a04-5cfacf0e23ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:23.916610 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6014d-1c5b-4449-9a04-5cfacf0e23ad admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:23.920806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3339e3-b41e-4a71-a3cb-9730971b1b99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:23.921446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3339e3-b41e-4a71-a3cb-9730971b1b99 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:23.921732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3339e3-b41e-4a71-a3cb-9730971b1b99 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:23.922012 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3339e3-b41e-4a71-a3cb-9730971b1b99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:23.930372 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3339e3-b41e-4a71-a3cb-9730971b1b99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:23.931849 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3339e3-b41e-4a71-a3cb-9730971b1b99 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:23.941322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1255/2516] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:37:23 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:37:31.287883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94056880-3f4f-4e2c-a577-8e65b5dc399a None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:31.289298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-94056880-3f4f-4e2c-a577-8e65b5dc399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:31.342777 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94056880-3f4f-4e2c-a577-8e65b5dc399a None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:31.347341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69953ac4-31f4-430e-8c68-f14f5025b4d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:31.347981 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69953ac4-31f4-430e-8c68-f14f5025b4d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:31.348268 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69953ac4-31f4-430e-8c68-f14f5025b4d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:31.348547 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69953ac4-31f4-430e-8c68-f14f5025b4d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:31.350535 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-69953ac4-31f4-430e-8c68-f14f5025b4d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:31.416255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69953ac4-31f4-430e-8c68-f14f5025b4d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:31.417612 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69953ac4-31f4-430e-8c68-f14f5025b4d5 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:31.428226 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1262/2517] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:37:31 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:37:31.698435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3339e3-b41e-4a71-a3cb-9730971b1b99 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:31.700031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2e3339e3-b41e-4a71-a3cb-9730971b1b99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:31.713519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3339e3-b41e-4a71-a3cb-9730971b1b99 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:31.717055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378c33a-6831-4a87-a1f7-cad7ea336b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:31.717694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378c33a-6831-4a87-a1f7-cad7ea336b56 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:31.717975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378c33a-6831-4a87-a1f7-cad7ea336b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:31.718249 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378c33a-6831-4a87-a1f7-cad7ea336b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:31.720644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7378c33a-6831-4a87-a1f7-cad7ea336b56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:31.730853 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378c33a-6831-4a87-a1f7-cad7ea336b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:31.732324 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378c33a-6831-4a87-a1f7-cad7ea336b56 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:31.741266 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1256/2518] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:37:31 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:37:33.534161 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd8454-1f48-4a2c-8ce0-287328584fb8 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:33.534672 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd8454-1f48-4a2c-8ce0-287328584fb8 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:33.534779 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd8454-1f48-4a2c-8ce0-287328584fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:33.551984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-68dd8454-1f48-4a2c-8ce0-287328584fb8 None None] MFA Rules not processed for user `f6af4c462c6347ff8abbcc8770874b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:37:33.553186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-68dd8454-1f48-4a2c-8ce0-287328584fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:33.607385 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1263/2519] 10.222.0.50 () {58 vars in 967 bytes} [Tue Nov 16 00:37:33 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:37:33.628883 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378c33a-6831-4a87-a1f7-cad7ea336b56 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:33.630316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7378c33a-6831-4a87-a1f7-cad7ea336b56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:33.700709 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378c33a-6831-4a87-a1f7-cad7ea336b56 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:33.706298 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212774f7-ac46-4156-91b4-e8b128dde198 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac32c6730654a889472a3bad95374bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:33.707383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212774f7-ac46-4156-91b4-e8b128dde198 service swift] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:33.707383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212774f7-ac46-4156-91b4-e8b128dde198 service swift] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:33.707623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212774f7-ac46-4156-91b4-e8b128dde198 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:33.716027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212774f7-ac46-4156-91b4-e8b128dde198 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:33.717627 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212774f7-ac46-4156-91b4-e8b128dde198 service swift] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:33.726823 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1257/2520] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Nov 16 00:37:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 00:37:33.959338 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd8454-1f48-4a2c-8ce0-287328584fb8 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:34.031581 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd8454-1f48-4a2c-8ce0-287328584fb8 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:34.037169 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406fd49-afb6-499f-9403-756a90e35433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:34.038061 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406fd49-afb6-499f-9403-756a90e35433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:34.038346 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406fd49-afb6-499f-9403-756a90e35433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:34.038635 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406fd49-afb6-499f-9403-756a90e35433 admin admin] PATH_INFO: `/v3/users/dc481d6a05a2408a9b279078aba5b81c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:34.039880 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406fd49-afb6-499f-9403-756a90e35433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc481d6a05a2408a9b279078aba5b81c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:34.041837 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406fd49-afb6-499f-9403-756a90e35433 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:34.086845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b406fd49-afb6-499f-9403-756a90e35433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc481d6a05a2408a9b279078aba5b81c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:34.093415 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b406fd49-afb6-499f-9403-756a90e35433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc481d6a05a2408a9b279078aba5b81c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:34.094203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b406fd49-afb6-499f-9403-756a90e35433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc481d6a05a2408a9b279078aba5b81c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:34.105919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b406fd49-afb6-499f-9403-756a90e35433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc481d6a05a2408a9b279078aba5b81c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:34.106568 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-b406fd49-afb6-499f-9403-756a90e35433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc481d6a05a2408a9b279078aba5b81c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:34.119130 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1264/2521] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:37:33 2021] DELETE /identity/v3/users/dc481d6a05a2408a9b279078aba5b81c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:37:34.123628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a3230-0e1f-4092-9085-7cbc1da73493 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:34.123923 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a3230-0e1f-4092-9085-7cbc1da73493 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:34.124206 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a3230-0e1f-4092-9085-7cbc1da73493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:34.143339 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-bc6a3230-0e1f-4092-9085-7cbc1da73493 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:37:34.144549 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-bc6a3230-0e1f-4092-9085-7cbc1da73493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:34.215969 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1258/2522] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:37:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:37:34.227233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406fd49-afb6-499f-9403-756a90e35433 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:34.228769 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b406fd49-afb6-499f-9403-756a90e35433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:34.289863 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406fd49-afb6-499f-9403-756a90e35433 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:34.294270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d73a5-de17-4a50-bf38-9adec27a90ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:34.295027 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d73a5-de17-4a50-bf38-9adec27a90ad service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:34.295383 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d73a5-de17-4a50-bf38-9adec27a90ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:34.295725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d73a5-de17-4a50-bf38-9adec27a90ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:34.305681 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d73a5-de17-4a50-bf38-9adec27a90ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:34.307604 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d73a5-de17-4a50-bf38-9adec27a90ad service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:34.317826 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1265/2523] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:37:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:37:34.578566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a3230-0e1f-4092-9085-7cbc1da73493 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:34.579786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-bc6a3230-0e1f-4092-9085-7cbc1da73493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:34.607049 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a3230-0e1f-4092-9085-7cbc1da73493 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:34.613180 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a502018-6f17-47e3-9177-250fb0cd4e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:34.614049 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a502018-6f17-47e3-9177-250fb0cd4e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:34.614338 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a502018-6f17-47e3-9177-250fb0cd4e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:34.614646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a502018-6f17-47e3-9177-250fb0cd4e7b admin admin] PATH_INFO: `/v3/projects/0792570778f2411ba54e39035329a374` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:34.615900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a502018-6f17-47e3-9177-250fb0cd4e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0792570778f2411ba54e39035329a374)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:34.617807 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a502018-6f17-47e3-9177-250fb0cd4e7b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:34.661872 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0a502018-6f17-47e3-9177-250fb0cd4e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0792570778f2411ba54e39035329a374', 'request_id': 'req-0a502018-6f17-47e3-9177-250fb0cd4e7b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:34.667789 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0a502018-6f17-47e3-9177-250fb0cd4e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0792570778f2411ba54e39035329a374', 'request_id': 'req-0a502018-6f17-47e3-9177-250fb0cd4e7b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:34.675224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0a502018-6f17-47e3-9177-250fb0cd4e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0792570778f2411ba54e39035329a374', 'request_id': 'req-0a502018-6f17-47e3-9177-250fb0cd4e7b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:34.685501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0a502018-6f17-47e3-9177-250fb0cd4e7b admin admin] The token cache is being invalidate because project 0792570778f2411ba54e39035329a374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:37:34.685796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0a502018-6f17-47e3-9177-250fb0cd4e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:34.686432 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-0a502018-6f17-47e3-9177-250fb0cd4e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:37:34.688321 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1259/2524] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:37:34 2021] DELETE /identity/v3/projects/0792570778f2411ba54e39035329a374 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:37:34.693903 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065becc-26b2-4a55-8d03-facda159ce0c None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:34.694352 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065becc-26b2-4a55-8d03-facda159ce0c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:34.694483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065becc-26b2-4a55-8d03-facda159ce0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:34.712274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-8065becc-26b2-4a55-8d03-facda159ce0c None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:37:34.713443 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8065becc-26b2-4a55-8d03-facda159ce0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:34.770975 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1266/2525] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:37:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:37:34.779396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e9bd3-5ed1-46b2-9d56-8819e58d0c37 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:34.779687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e9bd3-5ed1-46b2-9d56-8819e58d0c37 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:34.780002 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e9bd3-5ed1-46b2-9d56-8819e58d0c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:34.799474 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-ed0e9bd3-5ed1-46b2-9d56-8819e58d0c37 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:37:34.800705 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ed0e9bd3-5ed1-46b2-9d56-8819e58d0c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:34.808579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1260/2526] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:37:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:37:34.812774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065becc-26b2-4a55-8d03-facda159ce0c None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:34.823658 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065becc-26b2-4a55-8d03-facda159ce0c None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:34.828201 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68a1bf-aa38-40f9-a2d3-6d54c516dbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:34.828864 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68a1bf-aa38-40f9-a2d3-6d54c516dbfe admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:34.829147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68a1bf-aa38-40f9-a2d3-6d54c516dbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:34.829424 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68a1bf-aa38-40f9-a2d3-6d54c516dbfe admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:34.830149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68a1bf-aa38-40f9-a2d3-6d54c516dbfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 00:37:34.830459 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68a1bf-aa38-40f9-a2d3-6d54c516dbfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:34.832107 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68a1bf-aa38-40f9-a2d3-6d54c516dbfe admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:34.843296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1267/2527] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 00:37:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 00:37:34.848286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e9bd3-5ed1-46b2-9d56-8819e58d0c37 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:34.857627 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e9bd3-5ed1-46b2-9d56-8819e58d0c37 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:34.862944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdd38a-f5c7-44d3-89e1-8fd89da79ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:34.863593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdd38a-f5c7-44d3-89e1-8fd89da79ceb admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:34.863878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdd38a-f5c7-44d3-89e1-8fd89da79ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:34.864153 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdd38a-f5c7-44d3-89e1-8fd89da79ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:34.864845 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdd38a-f5c7-44d3-89e1-8fd89da79ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:34.866743 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdd38a-f5c7-44d3-89e1-8fd89da79ceb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:34.891338 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1261/2528] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 00:37:34 2021] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 00:37:34.895102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68a1bf-aa38-40f9-a2d3-6d54c516dbfe admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:34.905191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68a1bf-aa38-40f9-a2d3-6d54c516dbfe admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:34.964101 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6183c46-d0a4-4744-b080-a740560a1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:34.964780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6183c46-d0a4-4744-b080-a740560a1d67 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:34.965077 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6183c46-d0a4-4744-b080-a740560a1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:34.965359 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6183c46-d0a4-4744-b080-a740560a1d67 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:34.966080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6183c46-d0a4-4744-b080-a740560a1d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:34.968054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6183c46-d0a4-4744-b080-a740560a1d67 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:34.990720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1268/2529] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 00:37:34 2021] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 00:37:34.994546 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdd38a-f5c7-44d3-89e1-8fd89da79ceb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:35.006164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdd38a-f5c7-44d3-89e1-8fd89da79ceb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:35.010808 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36e57b-cc03-48dc-982e-18c46004bf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:35.011495 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36e57b-cc03-48dc-982e-18c46004bf29 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:35.011777 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36e57b-cc03-48dc-982e-18c46004bf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:35.012240 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36e57b-cc03-48dc-982e-18c46004bf29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:35.012996 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36e57b-cc03-48dc-982e-18c46004bf29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:35.014586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36e57b-cc03-48dc-982e-18c46004bf29 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:35.025810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1262/2530] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:37:34 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:37:35.030573 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6183c46-d0a4-4744-b080-a740560a1d67 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:35.041246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6183c46-d0a4-4744-b080-a740560a1d67 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:35.045982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cf05d-f604-42c3-b439-f2d5648ff4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:35.046728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cf05d-f604-42c3-b439-f2d5648ff4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:35.047663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cf05d-f604-42c3-b439-f2d5648ff4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:35.048341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cf05d-f604-42c3-b439-f2d5648ff4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:35.049069 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cf05d-f604-42c3-b439-f2d5648ff4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:35.050648 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cf05d-f604-42c3-b439-f2d5648ff4d0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:35.063227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1269/2531] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 00:37:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 00:37:35.065291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36e57b-cc03-48dc-982e-18c46004bf29 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:35.075272 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36e57b-cc03-48dc-982e-18c46004bf29 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:35.079981 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f8d96-6cff-4f79-9959-4b5a5b5baea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:35.080850 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f8d96-6cff-4f79-9959-4b5a5b5baea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:35.081151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f8d96-6cff-4f79-9959-4b5a5b5baea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:35.081415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f8d96-6cff-4f79-9959-4b5a5b5baea6 admin admin] PATH_INFO: `/v3/projects/678286f0a95542d4bff18dc16b593434/users/d8197174f38346748b8225819b6d1e8c/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:35.095761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f8d96-6cff-4f79-9959-4b5a5b5baea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=678286f0a95542d4bff18dc16b593434, user_id=d8197174f38346748b8225819b6d1e8c, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:35.098422 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f8d96-6cff-4f79-9959-4b5a5b5baea6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:35.111779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1263/2532] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 00:37:35 2021] PUT /identity/v3/projects/678286f0a95542d4bff18dc16b593434/users/d8197174f38346748b8225819b6d1e8c/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:37:35.116786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb93dd6-85d1-47a3-b3f7-9337c21e82a7 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:35.117108 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb93dd6-85d1-47a3-b3f7-9337c21e82a7 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:35.117409 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb93dd6-85d1-47a3-b3f7-9337c21e82a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:35.137118 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-cdb93dd6-85d1-47a3-b3f7-9337c21e82a7 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:37:35.138335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-cdb93dd6-85d1-47a3-b3f7-9337c21e82a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:35.193929 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1270/2533] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:37:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:37:35.203700 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f8d96-6cff-4f79-9959-4b5a5b5baea6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:35.205379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-069f8d96-6cff-4f79-9959-4b5a5b5baea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:35.261108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f8d96-6cff-4f79-9959-4b5a5b5baea6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:35.264835 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477dd9-b0be-4bad-aa70-b05a33d489f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:35.265484 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477dd9-b0be-4bad-aa70-b05a33d489f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:35.265906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477dd9-b0be-4bad-aa70-b05a33d489f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:35.266234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477dd9-b0be-4bad-aa70-b05a33d489f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:35.275119 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf477dd9-b0be-4bad-aa70-b05a33d489f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:35.276560 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf477dd9-b0be-4bad-aa70-b05a33d489f9 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:35.286123 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1264/2534] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:37:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:37:35.873470 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a402734-2b17-49a0-8f60-e1df9da3319f None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:35.874014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a402734-2b17-49a0-8f60-e1df9da3319f None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:35.874111 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a402734-2b17-49a0-8f60-e1df9da3319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:35.902725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-2a402734-2b17-49a0-8f60-e1df9da3319f None None] MFA Rules not processed for user `d8197174f38346748b8225819b6d1e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:37:35.904009 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-2a402734-2b17-49a0-8f60-e1df9da3319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:35.973850 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1271/2535] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:37:35 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:37:35.983858 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477dd9-b0be-4bad-aa70-b05a33d489f9 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:35.985336 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-cf477dd9-b0be-4bad-aa70-b05a33d489f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:36.045485 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477dd9-b0be-4bad-aa70-b05a33d489f9 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:36.049739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08bcaf-9f23-4987-adca-2137990cbb96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:36.050592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08bcaf-9f23-4987-adca-2137990cbb96 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:36.050907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08bcaf-9f23-4987-adca-2137990cbb96 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:36.051215 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08bcaf-9f23-4987-adca-2137990cbb96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:36.059741 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08bcaf-9f23-4987-adca-2137990cbb96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:36.061182 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08bcaf-9f23-4987-adca-2137990cbb96 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:36.070696 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1265/2536] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:37:35 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:37:37.416264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f6b6-2a21-4738-b8af-b443d4f0e7fc None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:37.416746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f6b6-2a21-4738-b8af-b443d4f0e7fc None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:37.416865 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f6b6-2a21-4738-b8af-b443d4f0e7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:37.433977 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-2f18f6b6-2a21-4738-b8af-b443d4f0e7fc None None] MFA Rules not processed for user `d8197174f38346748b8225819b6d1e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:37:37.435186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-2f18f6b6-2a21-4738-b8af-b443d4f0e7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:37.441935 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1272/2537] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:37:37 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:37:37.666580 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08bcaf-9f23-4987-adca-2137990cbb96 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:37.668028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-dd08bcaf-9f23-4987-adca-2137990cbb96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:37.680057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08bcaf-9f23-4987-adca-2137990cbb96 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:37.683654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e833876-7152-4ceb-bb54-bad60b339ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:37.684278 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833876-7152-4ceb-bb54-bad60b339ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:37.684561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833876-7152-4ceb-bb54-bad60b339ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:37.684837 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833876-7152-4ceb-bb54-bad60b339ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:37.686566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-3e833876-7152-4ceb-bb54-bad60b339ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:37.696687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e833876-7152-4ceb-bb54-bad60b339ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:37.698131 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e833876-7152-4ceb-bb54-bad60b339ad1 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:37.708000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1266/2538] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:37:37 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:37:38.012066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18f6b6-2a21-4738-b8af-b443d4f0e7fc None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:38.013551 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-2f18f6b6-2a21-4738-b8af-b443d4f0e7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:38.084963 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18f6b6-2a21-4738-b8af-b443d4f0e7fc None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:38.089899 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e65d0-edec-4615-803f-3e391ee7b8dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:38.090545 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e65d0-edec-4615-803f-3e391ee7b8dd service placement] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:38.090849 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e65d0-edec-4615-803f-3e391ee7b8dd service placement] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:38.091149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e65d0-edec-4615-803f-3e391ee7b8dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:38.092893 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-965e65d0-edec-4615-803f-3e391ee7b8dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:38.104972 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e65d0-edec-4615-803f-3e391ee7b8dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:38.106662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e65d0-edec-4615-803f-3e391ee7b8dd service placement] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:38.117190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1273/2539] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:37:38 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:37:40.669948 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e833876-7152-4ceb-bb54-bad60b339ad1 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:40.671360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-3e833876-7152-4ceb-bb54-bad60b339ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:40.746444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e833876-7152-4ceb-bb54-bad60b339ad1 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:40.752718 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee6ae3-4050-4785-8213-b9404d79e385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:40.753460 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6ae3-4050-4785-8213-b9404d79e385 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:40.753813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6ae3-4050-4785-8213-b9404d79e385 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:40.754178 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6ae3-4050-4785-8213-b9404d79e385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:40.756055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9dee6ae3-4050-4785-8213-b9404d79e385 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:40.769138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee6ae3-4050-4785-8213-b9404d79e385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:40.770747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee6ae3-4050-4785-8213-b9404d79e385 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:40.781371 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1267/2540] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:37:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:37:47.262139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e65d0-edec-4615-803f-3e391ee7b8dd service placement] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:37:47.275311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e65d0-edec-4615-803f-3e391ee7b8dd service placement] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:37:47.280895 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ce846-9a4b-439c-961c-f1e838f47cc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:37:47.282404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ce846-9a4b-439c-961c-f1e838f47cc0 service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:37:47.282697 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ce846-9a4b-439c-961c-f1e838f47cc0 service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:37:47.283019 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ce846-9a4b-439c-961c-f1e838f47cc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:37:47.284823 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-4f7ce846-9a4b-439c-961c-f1e838f47cc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:37:47.296986 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ce846-9a4b-439c-961c-f1e838f47cc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:37:47.298584 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ce846-9a4b-439c-961c-f1e838f47cc0 service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:37:47.309511 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1274/2541] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:37:47 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:39:05.123771 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee6ae3-4050-4785-8213-b9404d79e385 service nova] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:39:05.140476 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee6ae3-4050-4785-8213-b9404d79e385 service nova] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:39:05.168495 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fef781-d26d-4f41-b3e2-ca4d17717d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:39:05.169205 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fef781-d26d-4f41-b3e2-ca4d17717d5b service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:39:05.169499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fef781-d26d-4f41-b3e2-ca4d17717d5b service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:39:05.169826 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fef781-d26d-4f41-b3e2-ca4d17717d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:39:05.174663 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-34fef781-d26d-4f41-b3e2-ca4d17717d5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:39:05.200706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fef781-d26d-4f41-b3e2-ca4d17717d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:39:05.202327 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fef781-d26d-4f41-b3e2-ca4d17717d5b service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:39:05.221016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1268/2542] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:39:05 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:39:14.919636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ce846-9a4b-439c-961c-f1e838f47cc0 service nova] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:39:14.921060 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-4f7ce846-9a4b-439c-961c-f1e838f47cc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:39:14.935638 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ce846-9a4b-439c-961c-f1e838f47cc0 service nova] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:39:14.941181 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830fb70-2dae-45ae-9130-f25c9c26bb0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:39:14.941825 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830fb70-2dae-45ae-9130-f25c9c26bb0b service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:39:14.942109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830fb70-2dae-45ae-9130-f25c9c26bb0b service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:39:14.942390 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830fb70-2dae-45ae-9130-f25c9c26bb0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:39:14.944906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3830fb70-2dae-45ae-9130-f25c9c26bb0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:39:15.002495 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830fb70-2dae-45ae-9130-f25c9c26bb0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:39:15.004144 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830fb70-2dae-45ae-9130-f25c9c26bb0b service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:39:15.013812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1275/2543] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:39:14 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:39:40.404892 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fef781-d26d-4f41-b3e2-ca4d17717d5b service nova] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:39:40.416297 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fef781-d26d-4f41-b3e2-ca4d17717d5b service nova] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:39:40.421916 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad744ce1-3955-4994-a3e3-8cfaf4a1309f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:39:40.422545 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad744ce1-3955-4994-a3e3-8cfaf4a1309f service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:39:40.422851 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad744ce1-3955-4994-a3e3-8cfaf4a1309f service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:39:40.423149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad744ce1-3955-4994-a3e3-8cfaf4a1309f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:39:40.424918 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ad744ce1-3955-4994-a3e3-8cfaf4a1309f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:39:40.481984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad744ce1-3955-4994-a3e3-8cfaf4a1309f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:39:40.483630 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad744ce1-3955-4994-a3e3-8cfaf4a1309f service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:39:40.495777 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1269/2544] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:39:40 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:40:00.388396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830fb70-2dae-45ae-9130-f25c9c26bb0b service nova] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:40:00.399981 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830fb70-2dae-45ae-9130-f25c9c26bb0b service nova] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:40:00.405752 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa972c5-6643-4caa-a4f0-b4e5a4e0bb6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:40:00.406404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa972c5-6643-4caa-a4f0-b4e5a4e0bb6b service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:40:00.406692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa972c5-6643-4caa-a4f0-b4e5a4e0bb6b service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:40:00.407011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa972c5-6643-4caa-a4f0-b4e5a4e0bb6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:40:00.408780 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-5fa972c5-6643-4caa-a4f0-b4e5a4e0bb6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:40:00.464589 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa972c5-6643-4caa-a4f0-b4e5a4e0bb6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:40:00.466104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa972c5-6643-4caa-a4f0-b4e5a4e0bb6b service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:40:00.475185 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1276/2545] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:40:00 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:40:47.342601 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad744ce1-3955-4994-a3e3-8cfaf4a1309f service nova] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:40:47.344071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ad744ce1-3955-4994-a3e3-8cfaf4a1309f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:40:47.358930 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad744ce1-3955-4994-a3e3-8cfaf4a1309f service nova] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:40:47.363909 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bab72-17cc-421a-a30b-aeaba90c68d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:40:47.364549 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bab72-17cc-421a-a30b-aeaba90c68d9 service placement] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:40:47.364839 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bab72-17cc-421a-a30b-aeaba90c68d9 service placement] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:40:47.365121 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bab72-17cc-421a-a30b-aeaba90c68d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:40:47.366815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f51bab72-17cc-421a-a30b-aeaba90c68d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:40:47.378666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bab72-17cc-421a-a30b-aeaba90c68d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:40:47.380322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bab72-17cc-421a-a30b-aeaba90c68d9 service placement] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:40:47.390149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1270/2546] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:40:47 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:41:20.992449 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa972c5-6643-4caa-a4f0-b4e5a4e0bb6b service nova] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:41:20.994508 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-5fa972c5-6643-4caa-a4f0-b4e5a4e0bb6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:41:21.006051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa972c5-6643-4caa-a4f0-b4e5a4e0bb6b service nova] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:41:21.010339 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb952e-f723-47ad-ad62-69273bc08070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:41:21.011031 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb952e-f723-47ad-ad62-69273bc08070 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:41:21.011320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb952e-f723-47ad-ad62-69273bc08070 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:41:21.011599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb952e-f723-47ad-ad62-69273bc08070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:41:21.013327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-67eb952e-f723-47ad-ad62-69273bc08070 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:41:21.081426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb952e-f723-47ad-ad62-69273bc08070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:41:21.082912 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb952e-f723-47ad-ad62-69273bc08070 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:41:21.093391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1277/2547] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:41:20 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:41:22.309570 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f3f8e-2ff3-45fa-a066-d3ee6bdc8c80 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:41:22.310130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f3f8e-2ff3-45fa-a066-d3ee6bdc8c80 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:41:22.310130 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f3f8e-2ff3-45fa-a066-d3ee6bdc8c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:41:22.328828 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-154f3f8e-2ff3-45fa-a066-d3ee6bdc8c80 None None] MFA Rules not processed for user `88e46a4841c54de49b291afb3c2edbdd`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:41:22.330016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-154f3f8e-2ff3-45fa-a066-d3ee6bdc8c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:41:22.336845 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1271/2548] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:41:22 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:41:50.710998 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb952e-f723-47ad-ad62-69273bc08070 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:41:50.725879 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb952e-f723-47ad-ad62-69273bc08070 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:41:50.731782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c56e67-5c06-4715-96ab-b64f3f34870b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:41:50.732425 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c56e67-5c06-4715-96ab-b64f3f34870b service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:41:50.732764 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c56e67-5c06-4715-96ab-b64f3f34870b service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:41:50.733042 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c56e67-5c06-4715-96ab-b64f3f34870b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:41:50.734783 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-92c56e67-5c06-4715-96ab-b64f3f34870b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:41:50.821081 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c56e67-5c06-4715-96ab-b64f3f34870b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:41:50.823066 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c56e67-5c06-4715-96ab-b64f3f34870b service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:41:50.832524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1278/2549] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:41:50 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:42:57.959898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f3f8e-2ff3-45fa-a066-d3ee6bdc8c80 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:42:57.969391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f3f8e-2ff3-45fa-a066-d3ee6bdc8c80 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:42:57.974538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c8931-7e01-40ed-906e-768ba02855bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:42:57.975218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c8931-7e01-40ed-906e-768ba02855bf service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:42:57.975505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c8931-7e01-40ed-906e-768ba02855bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:42:57.975783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c8931-7e01-40ed-906e-768ba02855bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:42:57.977522 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-968c8931-7e01-40ed-906e-768ba02855bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:42:57.986909 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c8931-7e01-40ed-906e-768ba02855bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:42:57.988390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c8931-7e01-40ed-906e-768ba02855bf service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:42:57.997283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1272/2550] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:42:57 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:43:21.370875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c56e67-5c06-4715-96ab-b64f3f34870b service nova] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:43:21.379911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c56e67-5c06-4715-96ab-b64f3f34870b service nova] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:43:21.383684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa56796-9f1a-4247-bb5c-6d86084af4d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:43:21.384323 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56796-9f1a-4247-bb5c-6d86084af4d2 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:43:21.384591 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56796-9f1a-4247-bb5c-6d86084af4d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:43:21.384868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56796-9f1a-4247-bb5c-6d86084af4d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:43:21.386627 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-efa56796-9f1a-4247-bb5c-6d86084af4d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:43:21.402017 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa56796-9f1a-4247-bb5c-6d86084af4d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:43:21.403507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa56796-9f1a-4247-bb5c-6d86084af4d2 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:43:21.415399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1279/2551] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:43:21 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:43:21.470933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c8931-7e01-40ed-906e-768ba02855bf service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:43:21.481490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c8931-7e01-40ed-906e-768ba02855bf service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:43:21.485275 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8a93a-ff02-4383-8f29-582ed5891205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:43:21.485910 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8a93a-ff02-4383-8f29-582ed5891205 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:43:21.486200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8a93a-ff02-4383-8f29-582ed5891205 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:43:21.486484 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8a93a-ff02-4383-8f29-582ed5891205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:43:21.495057 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8a93a-ff02-4383-8f29-582ed5891205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:43:21.496509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8a93a-ff02-4383-8f29-582ed5891205 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:43:21.505654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1273/2552] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:43:21 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:43:21.583371 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa56796-9f1a-4247-bb5c-6d86084af4d2 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:43:21.592320 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa56796-9f1a-4247-bb5c-6d86084af4d2 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:43:21.596118 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f9ad-cffd-4083-bd51-7238efa36fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:43:21.596763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f9ad-cffd-4083-bd51-7238efa36fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:43:21.597090 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f9ad-cffd-4083-bd51-7238efa36fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:43:21.597378 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f9ad-cffd-4083-bd51-7238efa36fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:43:21.599546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-41f3f9ad-cffd-4083-bd51-7238efa36fc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:43:21.613872 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3f9ad-cffd-4083-bd51-7238efa36fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:43:21.615446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3f9ad-cffd-4083-bd51-7238efa36fc3 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:43:21.626771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1280/2553] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:43:21 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:43:21.715043 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8a93a-ff02-4383-8f29-582ed5891205 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:43:21.724636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8a93a-ff02-4383-8f29-582ed5891205 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:43:21.728638 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5bb22-0b6c-4112-afd2-d3957e90c538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:43:21.729343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5bb22-0b6c-4112-afd2-d3957e90c538 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:43:21.729695 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5bb22-0b6c-4112-afd2-d3957e90c538 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:43:21.730142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5bb22-0b6c-4112-afd2-d3957e90c538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:43:21.738012 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5bb22-0b6c-4112-afd2-d3957e90c538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:43:21.739491 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5bb22-0b6c-4112-afd2-d3957e90c538 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:43:21.748317 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1274/2554] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:43:21 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:44:15.553167 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f9ad-cffd-4083-bd51-7238efa36fc3 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:44:15.565015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f9ad-cffd-4083-bd51-7238efa36fc3 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:44:15.570583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3c946-e255-41e0-bd44-4c4a8c3c35d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:44:15.571255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3c946-e255-41e0-bd44-4c4a8c3c35d9 service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:44:15.571552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3c946-e255-41e0-bd44-4c4a8c3c35d9 service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:44:15.571830 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3c946-e255-41e0-bd44-4c4a8c3c35d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:44:15.579668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3c946-e255-41e0-bd44-4c4a8c3c35d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:44:15.581237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3c946-e255-41e0-bd44-4c4a8c3c35d9 service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:44:15.607564 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1281/2555] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:44:15 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:44:38.904521 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5bb22-0b6c-4112-afd2-d3957e90c538 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:44:38.930219 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5bb22-0b6c-4112-afd2-d3957e90c538 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:44:38.934029 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5d2e7-efbe-4a06-b073-1b5a0852609e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:44:38.934707 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d2e7-efbe-4a06-b073-1b5a0852609e service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:44:38.935028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d2e7-efbe-4a06-b073-1b5a0852609e service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:44:38.935309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d2e7-efbe-4a06-b073-1b5a0852609e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:44:38.958735 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5d2e7-efbe-4a06-b073-1b5a0852609e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:44:38.960195 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5d2e7-efbe-4a06-b073-1b5a0852609e service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:44:38.987228 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1275/2556] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:44:38 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:44:59.100634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3c946-e255-41e0-bd44-4c4a8c3c35d9 service nova] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:44:59.143238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3c946-e255-41e0-bd44-4c4a8c3c35d9 service nova] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:44:59.149047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a88d7-ad26-485d-835b-9bde8561c99c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:44:59.149699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a88d7-ad26-485d-835b-9bde8561c99c service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:44:59.150022 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a88d7-ad26-485d-835b-9bde8561c99c service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:44:59.150303 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a88d7-ad26-485d-835b-9bde8561c99c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:44:59.158325 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a88d7-ad26-485d-835b-9bde8561c99c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:44:59.159926 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a88d7-ad26-485d-835b-9bde8561c99c service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:44:59.186571 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1282/2557] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:44:59 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:45:13.098160 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5d2e7-efbe-4a06-b073-1b5a0852609e service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:45:13.139260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5d2e7-efbe-4a06-b073-1b5a0852609e service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:45:13.147856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a572ebf-4800-484e-ad5c-2ab2c34114af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:45:13.148740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a572ebf-4800-484e-ad5c-2ab2c34114af service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:45:13.149121 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a572ebf-4800-484e-ad5c-2ab2c34114af service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:45:13.149501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a572ebf-4800-484e-ad5c-2ab2c34114af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:45:13.162810 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a572ebf-4800-484e-ad5c-2ab2c34114af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:45:13.166144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a572ebf-4800-484e-ad5c-2ab2c34114af service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:45:13.180519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1276/2558] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:45:13 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:45:50.341887 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a88d7-ad26-485d-835b-9bde8561c99c service nova] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:45:50.363377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a88d7-ad26-485d-835b-9bde8561c99c service nova] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:45:50.368340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d56485-b81c-418d-9c18-cde276cefa98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:45:50.368972 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d56485-b81c-418d-9c18-cde276cefa98 service placement] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:45:50.369258 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d56485-b81c-418d-9c18-cde276cefa98 service placement] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:45:50.369532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d56485-b81c-418d-9c18-cde276cefa98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:45:50.378014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d56485-b81c-418d-9c18-cde276cefa98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:45:50.379632 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d56485-b81c-418d-9c18-cde276cefa98 service placement] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:45:50.389090 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1283/2559] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:45:50 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:47:14.230056 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a572ebf-4800-484e-ad5c-2ab2c34114af service nova] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:47:14.249607 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a572ebf-4800-484e-ad5c-2ab2c34114af service nova] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:47:14.253464 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c25b2-71fd-498a-accf-1724cbc644c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:47:14.254151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c25b2-71fd-498a-accf-1724cbc644c1 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:47:14.254440 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c25b2-71fd-498a-accf-1724cbc644c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:47:14.254936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c25b2-71fd-498a-accf-1724cbc644c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:47:14.263530 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c25b2-71fd-498a-accf-1724cbc644c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:47:14.264962 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c25b2-71fd-498a-accf-1724cbc644c1 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:47:14.283112 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1277/2560] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:47:14 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:47:14.379241 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d56485-b81c-418d-9c18-cde276cefa98 service placement] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:47:14.388512 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d56485-b81c-418d-9c18-cde276cefa98 service placement] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:47:14.392117 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bdf5b-0aa2-4c6d-9201-ab54aa1c6d57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:47:14.392750 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bdf5b-0aa2-4c6d-9201-ab54aa1c6d57 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:47:14.393035 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bdf5b-0aa2-4c6d-9201-ab54aa1c6d57 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:47:14.393316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bdf5b-0aa2-4c6d-9201-ab54aa1c6d57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:47:14.401578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bdf5b-0aa2-4c6d-9201-ab54aa1c6d57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:47:14.403067 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bdf5b-0aa2-4c6d-9201-ab54aa1c6d57 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:47:14.430755 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1284/2561] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:47:14 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:47:16.059909 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c25b2-71fd-498a-accf-1724cbc644c1 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:47:16.078574 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c25b2-71fd-498a-accf-1724cbc644c1 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:47:16.082709 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfcb41-4873-49bf-827c-199de2af21a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:47:16.083374 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfcb41-4873-49bf-827c-199de2af21a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:47:16.083659 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfcb41-4873-49bf-827c-199de2af21a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:47:16.084234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfcb41-4873-49bf-827c-199de2af21a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:47:16.085981 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-54cfcb41-4873-49bf-827c-199de2af21a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:47:16.127903 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfcb41-4873-49bf-827c-199de2af21a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:47:16.129395 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfcb41-4873-49bf-827c-199de2af21a7 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:47:16.149449 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1278/2562] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:47:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:47:22.662284 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bdf5b-0aa2-4c6d-9201-ab54aa1c6d57 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:47:22.663744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-902bdf5b-0aa2-4c6d-9201-ab54aa1c6d57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:47:22.679183 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bdf5b-0aa2-4c6d-9201-ab54aa1c6d57 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:47:22.684019 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d5ddb-e3e3-4fa5-a456-d57c7980e7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:47:22.684892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5ddb-e3e3-4fa5-a456-d57c7980e7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:47:22.685177 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5ddb-e3e3-4fa5-a456-d57c7980e7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:47:22.685450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5ddb-e3e3-4fa5-a456-d57c7980e7ed admin admin] PATH_INFO: `/v3/users/b4988a87648b402e9c2ab1f0e9af9257` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:47:22.700752 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d5ddb-e3e3-4fa5-a456-d57c7980e7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4988a87648b402e9c2ab1f0e9af9257)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:47:22.703881 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d5ddb-e3e3-4fa5-a456-d57c7980e7ed admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:47:22.753130 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-cf9d5ddb-e3e3-4fa5-a456-d57c7980e7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4988a87648b402e9c2ab1f0e9af9257'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:22.760379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-cf9d5ddb-e3e3-4fa5-a456-d57c7980e7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4988a87648b402e9c2ab1f0e9af9257'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:22.761048 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-cf9d5ddb-e3e3-4fa5-a456-d57c7980e7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4988a87648b402e9c2ab1f0e9af9257'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:22.772210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-cf9d5ddb-e3e3-4fa5-a456-d57c7980e7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4988a87648b402e9c2ab1f0e9af9257'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:22.772837 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-cf9d5ddb-e3e3-4fa5-a456-d57c7980e7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4988a87648b402e9c2ab1f0e9af9257'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:22.785176 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1285/2563] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:47:22 2021] DELETE /identity/v3/users/b4988a87648b402e9c2ab1f0e9af9257 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:47:22.952418 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfcb41-4873-49bf-827c-199de2af21a7 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:47:22.962228 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfcb41-4873-49bf-827c-199de2af21a7 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:47:23.019853 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:47:23.020791 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:47:23.021082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:47:23.021367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] PATH_INFO: `/v3/projects/bc2de9688642406fb8c1b1a026b5ec0b` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:47:23.022626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc2de9688642406fb8c1b1a026b5ec0b)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:47:23.025071 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:47:23.077370 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2de9688642406fb8c1b1a026b5ec0b', 'request_id': 'req-6cafc536-0377-4c4d-9101-bde5b610fadf'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.084265 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2de9688642406fb8c1b1a026b5ec0b', 'request_id': 'req-6cafc536-0377-4c4d-9101-bde5b610fadf'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.091696 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2de9688642406fb8c1b1a026b5ec0b', 'request_id': 'req-6cafc536-0377-4c4d-9101-bde5b610fadf'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.102705 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] The token cache is being invalidate because project bc2de9688642406fb8c1b1a026b5ec0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:47:23.103028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.103742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.105464 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1279/2564] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:47:22 2021] DELETE /identity/v3/projects/bc2de9688642406fb8c1b1a026b5ec0b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:47:23.109413 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d5ddb-e3e3-4fa5-a456-d57c7980e7ed admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:47:23.110818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-cf9d5ddb-e3e3-4fa5-a456-d57c7980e7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:47:23.124298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d5ddb-e3e3-4fa5-a456-d57c7980e7ed admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:47:23.179477 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b23ab9-9375-4923-8938-3382097d5c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:47:23.180382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b23ab9-9375-4923-8938-3382097d5c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:47:23.180834 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b23ab9-9375-4923-8938-3382097d5c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:47:23.180940 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b23ab9-9375-4923-8938-3382097d5c3f admin admin] PATH_INFO: `/v3/users/83a5595470af45b49c94b8c5988afb30` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:47:23.194387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b23ab9-9375-4923-8938-3382097d5c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a5595470af45b49c94b8c5988afb30)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:47:23.196466 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b23ab9-9375-4923-8938-3382097d5c3f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:47:23.244270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-31b23ab9-9375-4923-8938-3382097d5c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a5595470af45b49c94b8c5988afb30'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.251078 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-31b23ab9-9375-4923-8938-3382097d5c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a5595470af45b49c94b8c5988afb30'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.251866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-31b23ab9-9375-4923-8938-3382097d5c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a5595470af45b49c94b8c5988afb30'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.263650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-31b23ab9-9375-4923-8938-3382097d5c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a5595470af45b49c94b8c5988afb30'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.264323 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-31b23ab9-9375-4923-8938-3382097d5c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a5595470af45b49c94b8c5988afb30'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.278136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1286/2565] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:47:23 2021] DELETE /identity/v3/users/83a5595470af45b49c94b8c5988afb30 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:47:23.444137 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:47:23.445590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:47:23.459237 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafc536-0377-4c4d-9101-bde5b610fadf admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:47:23.517511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:47:23.518567 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:47:23.518877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:47:23.519163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] PATH_INFO: `/v3/projects/e0bb26d24b0c44ddb441a3d367ba4622` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:47:23.531502 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0bb26d24b0c44ddb441a3d367ba4622)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:47:23.533498 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:47:23.582579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0bb26d24b0c44ddb441a3d367ba4622', 'request_id': 'req-99dfccd4-ecba-4198-9857-e958f3482194'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.589448 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0bb26d24b0c44ddb441a3d367ba4622', 'request_id': 'req-99dfccd4-ecba-4198-9857-e958f3482194'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.596724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0bb26d24b0c44ddb441a3d367ba4622', 'request_id': 'req-99dfccd4-ecba-4198-9857-e958f3482194'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.608292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] The token cache is being invalidate because project e0bb26d24b0c44ddb441a3d367ba4622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:47:23.608584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.609292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:47:23.610813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1280/2566] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:47:23 2021] DELETE /identity/v3/projects/e0bb26d24b0c44ddb441a3d367ba4622 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:47:59.943205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b23ab9-9375-4923-8938-3382097d5c3f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:47:59.944633 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-31b23ab9-9375-4923-8938-3382097d5c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:48:00.012260 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b23ab9-9375-4923-8938-3382097d5c3f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:48:00.060762 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4eb22c-475e-4208-9357-8faff2f5fdba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:48:00.061429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4eb22c-475e-4208-9357-8faff2f5fdba service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:48:00.061711 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4eb22c-475e-4208-9357-8faff2f5fdba service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:48:00.061984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4eb22c-475e-4208-9357-8faff2f5fdba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:48:00.063819 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3a4eb22c-475e-4208-9357-8faff2f5fdba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:48:00.075298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4eb22c-475e-4208-9357-8faff2f5fdba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:48:00.076741 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4eb22c-475e-4208-9357-8faff2f5fdba service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:48:00.086050 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1287/2567] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:47:59 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 00:48:22.403296 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:48:22.404767 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:48:22.471613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfccd4-ecba-4198-9857-e958f3482194 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:48:22.475626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb29af-a695-4bc8-864e-f514c80f9b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:48:22.476266 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb29af-a695-4bc8-864e-f514c80f9b50 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:48:22.476552 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb29af-a695-4bc8-864e-f514c80f9b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:48:22.476826 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb29af-a695-4bc8-864e-f514c80f9b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:48:22.478813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-09eb29af-a695-4bc8-864e-f514c80f9b50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:48:22.556403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb29af-a695-4bc8-864e-f514c80f9b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:48:22.557840 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb29af-a695-4bc8-864e-f514c80f9b50 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:48:22.576309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1281/2568] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:48:22 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:49:14.933875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4eb22c-475e-4208-9357-8faff2f5fdba service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:49:14.943076 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4eb22c-475e-4208-9357-8faff2f5fdba service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:49:14.946618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c98d5b-c235-40f0-9ed7-75d26faabd4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:49:14.947299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c98d5b-c235-40f0-9ed7-75d26faabd4d service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:49:14.947589 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c98d5b-c235-40f0-9ed7-75d26faabd4d service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:49:14.947866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c98d5b-c235-40f0-9ed7-75d26faabd4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:49:14.949646 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-85c98d5b-c235-40f0-9ed7-75d26faabd4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:49:15.019034 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c98d5b-c235-40f0-9ed7-75d26faabd4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:49:15.020748 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c98d5b-c235-40f0-9ed7-75d26faabd4d service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:49:15.029771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1288/2569] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:49:14 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:49:21.870691 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb29af-a695-4bc8-864e-f514c80f9b50 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:49:21.872129 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-09eb29af-a695-4bc8-864e-f514c80f9b50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:49:21.884411 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb29af-a695-4bc8-864e-f514c80f9b50 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:49:21.888059 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ab7fb-57df-4d1a-b049-00fb32d99916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:49:21.888702 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab7fb-57df-4d1a-b049-00fb32d99916 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:49:21.888990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab7fb-57df-4d1a-b049-00fb32d99916 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:49:21.889275 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab7fb-57df-4d1a-b049-00fb32d99916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:49:21.891043 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-376ab7fb-57df-4d1a-b049-00fb32d99916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:49:21.952262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ab7fb-57df-4d1a-b049-00fb32d99916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:49:21.953717 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ab7fb-57df-4d1a-b049-00fb32d99916 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:49:21.963590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1282/2570] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:49:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:49:27.995327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c98d5b-c235-40f0-9ed7-75d26faabd4d service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:49:27.996957 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-85c98d5b-c235-40f0-9ed7-75d26faabd4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:49:28.011850 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c98d5b-c235-40f0-9ed7-75d26faabd4d service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:49:28.016715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca286a2-e9dd-464a-a3f7-4f7111967355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:49:28.017762 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca286a2-e9dd-464a-a3f7-4f7111967355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:49:28.018056 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca286a2-e9dd-464a-a3f7-4f7111967355 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:49:28.018334 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca286a2-e9dd-464a-a3f7-4f7111967355 admin admin] PATH_INFO: `/v3/users/88e46a4841c54de49b291afb3c2edbdd` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:49:28.034156 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca286a2-e9dd-464a-a3f7-4f7111967355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e46a4841c54de49b291afb3c2edbdd)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:49:28.037335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca286a2-e9dd-464a-a3f7-4f7111967355 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:49:28.083592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-eca286a2-e9dd-464a-a3f7-4f7111967355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e46a4841c54de49b291afb3c2edbdd'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.091250 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-eca286a2-e9dd-464a-a3f7-4f7111967355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e46a4841c54de49b291afb3c2edbdd'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.091974 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-eca286a2-e9dd-464a-a3f7-4f7111967355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e46a4841c54de49b291afb3c2edbdd'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.111809 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-eca286a2-e9dd-464a-a3f7-4f7111967355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e46a4841c54de49b291afb3c2edbdd'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.112554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-eca286a2-e9dd-464a-a3f7-4f7111967355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e46a4841c54de49b291afb3c2edbdd'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.126288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1289/2571] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:49:27 2021] DELETE /identity/v3/users/88e46a4841c54de49b291afb3c2edbdd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:49:28.292951 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ab7fb-57df-4d1a-b049-00fb32d99916 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:49:28.304434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ab7fb-57df-4d1a-b049-00fb32d99916 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:49:28.360146 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:49:28.360938 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:49:28.361224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:49:28.361505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] PATH_INFO: `/v3/projects/b4d7780222934efaa7ea2e666bdc2b7b` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:49:28.362700 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4d7780222934efaa7ea2e666bdc2b7b)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:49:28.365321 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:49:28.408775 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4d7780222934efaa7ea2e666bdc2b7b', 'request_id': 'req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.415574 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4d7780222934efaa7ea2e666bdc2b7b', 'request_id': 'req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.422717 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4d7780222934efaa7ea2e666bdc2b7b', 'request_id': 'req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.433484 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] The token cache is being invalidate because project b4d7780222934efaa7ea2e666bdc2b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:49:28.433772 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.434390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.435926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1283/2572] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:49:28 2021] DELETE /identity/v3/projects/b4d7780222934efaa7ea2e666bdc2b7b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:49:28.439883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca286a2-e9dd-464a-a3f7-4f7111967355 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:49:28.441275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-eca286a2-e9dd-464a-a3f7-4f7111967355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:49:28.454293 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca286a2-e9dd-464a-a3f7-4f7111967355 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:49:28.509055 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f003664-32ad-4eae-b7db-aed4be17f29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:49:28.509922 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f003664-32ad-4eae-b7db-aed4be17f29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:49:28.510210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f003664-32ad-4eae-b7db-aed4be17f29d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:49:28.510491 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f003664-32ad-4eae-b7db-aed4be17f29d admin admin] PATH_INFO: `/v3/users/c92d8d3de2654e378ccd034c9b25c79e` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:49:28.523262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f003664-32ad-4eae-b7db-aed4be17f29d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92d8d3de2654e378ccd034c9b25c79e)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:49:28.525202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f003664-32ad-4eae-b7db-aed4be17f29d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:49:28.568424 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3f003664-32ad-4eae-b7db-aed4be17f29d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92d8d3de2654e378ccd034c9b25c79e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.574875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3f003664-32ad-4eae-b7db-aed4be17f29d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92d8d3de2654e378ccd034c9b25c79e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.575560 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3f003664-32ad-4eae-b7db-aed4be17f29d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92d8d3de2654e378ccd034c9b25c79e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.587222 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3f003664-32ad-4eae-b7db-aed4be17f29d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92d8d3de2654e378ccd034c9b25c79e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.587844 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3f003664-32ad-4eae-b7db-aed4be17f29d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92d8d3de2654e378ccd034c9b25c79e'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.600306 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1290/2573] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:49:28 2021] DELETE /identity/v3/users/c92d8d3de2654e378ccd034c9b25c79e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:49:28.768844 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:49:28.771200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:49:28.783864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94e51c-b47d-4c38-97eb-ce64b884d8f9 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:49:28.839378 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:49:28.840242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:49:28.840527 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:49:28.840806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] PATH_INFO: `/v3/projects/47014035fda94779a6149e00ae441139` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:49:28.851517 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] RBAC: Authorizing `identity:delete_project(project_id=47014035fda94779a6149e00ae441139)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:49:28.853700 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:49:28.900061 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47014035fda94779a6149e00ae441139', 'request_id': 'req-adcf4a0d-818b-4207-b5f0-d6fe868362de'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.906561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47014035fda94779a6149e00ae441139', 'request_id': 'req-adcf4a0d-818b-4207-b5f0-d6fe868362de'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.915922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47014035fda94779a6149e00ae441139', 'request_id': 'req-adcf4a0d-818b-4207-b5f0-d6fe868362de'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.927163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] The token cache is being invalidate because project 47014035fda94779a6149e00ae441139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:49:28.927462 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.928119 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:49:28.929972 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1284/2574] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:49:28 2021] DELETE /identity/v3/projects/47014035fda94779a6149e00ae441139 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:50:23.325729 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f003664-32ad-4eae-b7db-aed4be17f29d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:50:23.327190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3f003664-32ad-4eae-b7db-aed4be17f29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:50:23.382604 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f003664-32ad-4eae-b7db-aed4be17f29d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:50:23.431772 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176aea3-9010-4fa7-bda7-33a95533216e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:50:23.432432 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176aea3-9010-4fa7-bda7-33a95533216e service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:50:23.432713 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176aea3-9010-4fa7-bda7-33a95533216e service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:50:23.432985 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176aea3-9010-4fa7-bda7-33a95533216e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:50:23.434791 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6176aea3-9010-4fa7-bda7-33a95533216e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:50:23.513634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176aea3-9010-4fa7-bda7-33a95533216e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:50:23.515118 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176aea3-9010-4fa7-bda7-33a95533216e service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:50:23.526269 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1291/2575] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:50:23 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:50:25.081665 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:50:25.083367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:50:25.102507 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf4a0d-818b-4207-b5f0-d6fe868362de admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:50:25.109497 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653920b9-2a2c-4b9b-b11b-1f83cfe7a601 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:50:25.110331 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653920b9-2a2c-4b9b-b11b-1f83cfe7a601 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:50:25.110651 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653920b9-2a2c-4b9b-b11b-1f83cfe7a601 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:50:25.110965 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653920b9-2a2c-4b9b-b11b-1f83cfe7a601 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:50:25.113749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-653920b9-2a2c-4b9b-b11b-1f83cfe7a601 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:50:25.127660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653920b9-2a2c-4b9b-b11b-1f83cfe7a601 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:50:25.129325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653920b9-2a2c-4b9b-b11b-1f83cfe7a601 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:50:25.141986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1285/2576] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:50:25 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:50:25.855627 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176aea3-9010-4fa7-bda7-33a95533216e service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:50:25.857138 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6176aea3-9010-4fa7-bda7-33a95533216e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:50:25.867772 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176aea3-9010-4fa7-bda7-33a95533216e service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:50:25.871451 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6394163-bc2d-461e-96a0-e40d00e39a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:50:25.872079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394163-bc2d-461e-96a0-e40d00e39a31 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:50:25.872364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394163-bc2d-461e-96a0-e40d00e39a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:50:25.872641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394163-bc2d-461e-96a0-e40d00e39a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:50:25.874405 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b6394163-bc2d-461e-96a0-e40d00e39a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:50:25.888101 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6394163-bc2d-461e-96a0-e40d00e39a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:50:25.889531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6394163-bc2d-461e-96a0-e40d00e39a31 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:50:25.900950 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1292/2577] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:50:25 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:50:59.252003 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653920b9-2a2c-4b9b-b11b-1f83cfe7a601 service nova] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:50:59.253456 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-653920b9-2a2c-4b9b-b11b-1f83cfe7a601 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:50:59.331638 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653920b9-2a2c-4b9b-b11b-1f83cfe7a601 service nova] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:50:59.336687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7cdd0-39bd-4546-ae47-ab85d64cb32e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:50:59.337335 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7cdd0-39bd-4546-ae47-ab85d64cb32e service placement] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:50:59.337625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7cdd0-39bd-4546-ae47-ab85d64cb32e service placement] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:50:59.337906 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7cdd0-39bd-4546-ae47-ab85d64cb32e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:50:59.339668 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a0c7cdd0-39bd-4546-ae47-ab85d64cb32e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:50:59.350792 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7cdd0-39bd-4546-ae47-ab85d64cb32e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:50:59.352412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7cdd0-39bd-4546-ae47-ab85d64cb32e service placement] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:50:59.364155 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1286/2578] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:50:59 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:52:13.864072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6394163-bc2d-461e-96a0-e40d00e39a31 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:52:13.865505 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b6394163-bc2d-461e-96a0-e40d00e39a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:52:13.880037 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6394163-bc2d-461e-96a0-e40d00e39a31 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:52:13.886018 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff67c2-51f2-4282-962e-cdcac77c12b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:52:13.886647 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff67c2-51f2-4282-962e-cdcac77c12b8 service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:52:13.886960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff67c2-51f2-4282-962e-cdcac77c12b8 service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:52:13.887241 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff67c2-51f2-4282-962e-cdcac77c12b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:52:13.888896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-36ff67c2-51f2-4282-962e-cdcac77c12b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:52:13.965602 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff67c2-51f2-4282-962e-cdcac77c12b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:52:13.967175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff67c2-51f2-4282-962e-cdcac77c12b8 service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:52:13.976652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1293/2579] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:52:13 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:52:14.800997 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7cdd0-39bd-4546-ae47-ab85d64cb32e service placement] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:52:14.813223 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7cdd0-39bd-4546-ae47-ab85d64cb32e service placement] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:52:14.818880 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdaaf2-c888-4e72-8a6a-1979fbb88736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:52:14.820023 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdaaf2-c888-4e72-8a6a-1979fbb88736 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:52:14.820306 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdaaf2-c888-4e72-8a6a-1979fbb88736 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:52:14.820583 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdaaf2-c888-4e72-8a6a-1979fbb88736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:52:14.822330 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f1cdaaf2-c888-4e72-8a6a-1979fbb88736 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:52:14.889499 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdaaf2-c888-4e72-8a6a-1979fbb88736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:52:14.891129 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdaaf2-c888-4e72-8a6a-1979fbb88736 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:52:14.900509 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1287/2580] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:52:14 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:52:59.097708 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549fe3-a912-447e-ab6f-25cd73d22dbe None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:52:59.098264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549fe3-a912-447e-ab6f-25cd73d22dbe None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:52:59.098264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62549fe3-a912-447e-ab6f-25cd73d22dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:52:59.124646 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-62549fe3-a912-447e-ab6f-25cd73d22dbe None None] MFA Rules not processed for user `a5d8ae82c9644a629b96d5edfa11682f`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:52:59.125849 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-62549fe3-a912-447e-ab6f-25cd73d22dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:52:59.132707 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1294/2581] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 00:52:59 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:52:59.416961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdaaf2-c888-4e72-8a6a-1979fbb88736 service nova] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:52:59.426996 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdaaf2-c888-4e72-8a6a-1979fbb88736 service nova] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:52:59.430722 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd7570-16ed-4754-9ef9-8aaa2471e811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:52:59.431387 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd7570-16ed-4754-9ef9-8aaa2471e811 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:52:59.431670 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd7570-16ed-4754-9ef9-8aaa2471e811 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:52:59.431946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd7570-16ed-4754-9ef9-8aaa2471e811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:52:59.434217 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e8dd7570-16ed-4754-9ef9-8aaa2471e811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:52:59.443910 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd7570-16ed-4754-9ef9-8aaa2471e811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:52:59.445352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd7570-16ed-4754-9ef9-8aaa2471e811 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:52:59.454112 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1288/2582] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:52:59 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:53:00.036797 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62549fe3-a912-447e-ab6f-25cd73d22dbe None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:53:00.049220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62549fe3-a912-447e-ab6f-25cd73d22dbe None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:53:00.054233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8be58-518f-4d98-a560-5f4d43a7595b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:53:00.054906 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8be58-518f-4d98-a560-5f4d43a7595b service placement] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:53:00.055199 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8be58-518f-4d98-a560-5f4d43a7595b service placement] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:53:00.055477 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8be58-518f-4d98-a560-5f4d43a7595b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:53:00.057230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-05f8be58-518f-4d98-a560-5f4d43a7595b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:53:00.069020 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8be58-518f-4d98-a560-5f4d43a7595b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:53:00.070600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8be58-518f-4d98-a560-5f4d43a7595b service placement] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:53:00.080632 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1295/2583] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:53:00 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:53:01.796335 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd7570-16ed-4754-9ef9-8aaa2471e811 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:53:01.798165 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e8dd7570-16ed-4754-9ef9-8aaa2471e811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:53:01.814223 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd7570-16ed-4754-9ef9-8aaa2471e811 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:53:01.819594 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12b3d0-cd98-48e0-a00a-1a525f9f7dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:53:01.820526 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12b3d0-cd98-48e0-a00a-1a525f9f7dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:53:01.820990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12b3d0-cd98-48e0-a00a-1a525f9f7dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:53:01.821460 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12b3d0-cd98-48e0-a00a-1a525f9f7dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:53:01.824245 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-af12b3d0-cd98-48e0-a00a-1a525f9f7dc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:53:01.836287 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12b3d0-cd98-48e0-a00a-1a525f9f7dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:53:01.838404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12b3d0-cd98-48e0-a00a-1a525f9f7dc3 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:53:01.850302 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1289/2584] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:53:01 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:53:07.880286 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8be58-518f-4d98-a560-5f4d43a7595b service placement] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:53:07.894948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8be58-518f-4d98-a560-5f4d43a7595b service placement] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:53:07.901067 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a033ddb-1359-49ff-89cc-a128b4f3563b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:53:07.901749 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a033ddb-1359-49ff-89cc-a128b4f3563b service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:53:07.902223 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a033ddb-1359-49ff-89cc-a128b4f3563b service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:53:07.903005 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a033ddb-1359-49ff-89cc-a128b4f3563b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:53:07.905079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9a033ddb-1359-49ff-89cc-a128b4f3563b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:53:07.917307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a033ddb-1359-49ff-89cc-a128b4f3563b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:53:07.919902 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a033ddb-1359-49ff-89cc-a128b4f3563b service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:53:07.931808 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1296/2585] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:53:07 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:53:11.521662 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12b3d0-cd98-48e0-a00a-1a525f9f7dc3 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:53:11.539103 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12b3d0-cd98-48e0-a00a-1a525f9f7dc3 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:53:11.545746 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10350e-318b-4b2e-a5da-8e2dcdba1fde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:53:11.546772 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10350e-318b-4b2e-a5da-8e2dcdba1fde service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:53:11.547315 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10350e-318b-4b2e-a5da-8e2dcdba1fde service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:53:11.547809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10350e-318b-4b2e-a5da-8e2dcdba1fde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:53:11.549832 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9a10350e-318b-4b2e-a5da-8e2dcdba1fde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:53:11.564878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10350e-318b-4b2e-a5da-8e2dcdba1fde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:53:11.566472 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10350e-318b-4b2e-a5da-8e2dcdba1fde service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:53:11.577119 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1290/2586] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:53:11 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:53:21.021428 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a033ddb-1359-49ff-89cc-a128b4f3563b service nova] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:53:21.022873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9a033ddb-1359-49ff-89cc-a128b4f3563b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:53:21.076787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a033ddb-1359-49ff-89cc-a128b4f3563b service nova] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:53:21.080406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29b3fb-34d9-49f1-a6f2-69448c073652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:53:21.081047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b3fb-34d9-49f1-a6f2-69448c073652 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:53:21.081335 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b3fb-34d9-49f1-a6f2-69448c073652 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:53:21.081613 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b3fb-34d9-49f1-a6f2-69448c073652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:53:21.083337 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ae29b3fb-34d9-49f1-a6f2-69448c073652 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:53:21.143137 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29b3fb-34d9-49f1-a6f2-69448c073652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:53:21.144595 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29b3fb-34d9-49f1-a6f2-69448c073652 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:53:21.154556 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1297/2587] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:53:21 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:54:15.306492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10350e-318b-4b2e-a5da-8e2dcdba1fde service nova] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:54:15.317971 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10350e-318b-4b2e-a5da-8e2dcdba1fde service nova] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:54:15.324144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86e1e7-0752-4104-ac1c-f24e9ed81b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:54:15.324793 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86e1e7-0752-4104-ac1c-f24e9ed81b34 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:54:15.325078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86e1e7-0752-4104-ac1c-f24e9ed81b34 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:54:15.325358 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86e1e7-0752-4104-ac1c-f24e9ed81b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:54:15.327137 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-5d86e1e7-0752-4104-ac1c-f24e9ed81b34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:54:15.387619 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86e1e7-0752-4104-ac1c-f24e9ed81b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:54:15.389727 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86e1e7-0752-4104-ac1c-f24e9ed81b34 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:54:15.398712 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1291/2588] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:54:15 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:54:27.524885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ac07e-80ac-4a1e-b22b-72c435238022 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:54:27.525358 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ac07e-80ac-4a1e-b22b-72c435238022 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:54:27.525479 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ac07e-80ac-4a1e-b22b-72c435238022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:54:27.584842 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-7a9ac07e-80ac-4a1e-b22b-72c435238022 None None] MFA Rules not processed for user `f6af4c462c6347ff8abbcc8770874b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 00:54:27.586029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7a9ac07e-80ac-4a1e-b22b-72c435238022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:54:27.648866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1298/2589] 10.222.0.50 () {58 vars in 967 bytes} [Tue Nov 16 00:54:27 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 00:54:27.701132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86e1e7-0752-4104-ac1c-f24e9ed81b34 service nova] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:54:27.702534 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-5d86e1e7-0752-4104-ac1c-f24e9ed81b34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:54:27.787276 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86e1e7-0752-4104-ac1c-f24e9ed81b34 service nova] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:54:27.792434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b90f-4a05-4398-9596-bd22cd692b8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac32c6730654a889472a3bad95374bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:54:27.793076 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b90f-4a05-4398-9596-bd22cd692b8a service swift] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:54:27.793361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b90f-4a05-4398-9596-bd22cd692b8a service swift] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:54:27.793776 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b90f-4a05-4398-9596-bd22cd692b8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:54:27.801776 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813b90f-4a05-4398-9596-bd22cd692b8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:54:27.803384 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813b90f-4a05-4398-9596-bd22cd692b8a service swift] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:54:27.811649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1292/2590] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Nov 16 00:54:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 00:54:28.274645 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ac07e-80ac-4a1e-b22b-72c435238022 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:54:28.284973 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ac07e-80ac-4a1e-b22b-72c435238022 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:54:28.288621 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27f53-43da-480b-a856-ed5bc7098be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:54:28.289270 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27f53-43da-480b-a856-ed5bc7098be5 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:54:28.289556 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27f53-43da-480b-a856-ed5bc7098be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:54:28.289833 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27f53-43da-480b-a856-ed5bc7098be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:54:28.291656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-afc27f53-43da-480b-a856-ed5bc7098be5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:54:28.351208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc27f53-43da-480b-a856-ed5bc7098be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:54:28.352644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc27f53-43da-480b-a856-ed5bc7098be5 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:54:28.362900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1299/2591] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:54:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:54:34.678401 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b90f-4a05-4398-9596-bd22cd692b8a service swift] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:54:34.679901 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-3813b90f-4a05-4398-9596-bd22cd692b8a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:54:34.693515 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b90f-4a05-4398-9596-bd22cd692b8a service swift] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:54:34.698589 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bccb77-d77e-487c-8346-4bac2538bb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:54:34.699492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bccb77-d77e-487c-8346-4bac2538bb5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:54:34.699776 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bccb77-d77e-487c-8346-4bac2538bb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:54:34.700050 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bccb77-d77e-487c-8346-4bac2538bb5e admin admin] PATH_INFO: `/v3/users/1cfb6806de1c4f79bf7dd4aaf8b71aa7` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:54:34.701244 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bccb77-d77e-487c-8346-4bac2538bb5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cfb6806de1c4f79bf7dd4aaf8b71aa7)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:54:34.703210 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bccb77-d77e-487c-8346-4bac2538bb5e admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:54:34.748374 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-43bccb77-d77e-487c-8346-4bac2538bb5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cfb6806de1c4f79bf7dd4aaf8b71aa7'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:34.755154 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-43bccb77-d77e-487c-8346-4bac2538bb5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cfb6806de1c4f79bf7dd4aaf8b71aa7'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:34.763072 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-43bccb77-d77e-487c-8346-4bac2538bb5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cfb6806de1c4f79bf7dd4aaf8b71aa7'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:34.774647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-43bccb77-d77e-487c-8346-4bac2538bb5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cfb6806de1c4f79bf7dd4aaf8b71aa7'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:34.775454 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-43bccb77-d77e-487c-8346-4bac2538bb5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cfb6806de1c4f79bf7dd4aaf8b71aa7'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:34.782674 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1293/2592] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:54:34 2021] DELETE /identity/v3/users/1cfb6806de1c4f79bf7dd4aaf8b71aa7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:54:34.952606 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27f53-43da-480b-a856-ed5bc7098be5 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:54:34.967401 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27f53-43da-480b-a856-ed5bc7098be5 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:54:35.025190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:54:35.026051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:54:35.026510 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:54:35.026901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] PATH_INFO: `/v3/projects/83520f3a79ea4f8c9593aac314d7db4d` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:54:35.037725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83520f3a79ea4f8c9593aac314d7db4d)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:54:35.039686 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:54:35.084394 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83520f3a79ea4f8c9593aac314d7db4d', 'request_id': 'req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.089600 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83520f3a79ea4f8c9593aac314d7db4d', 'request_id': 'req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.095946 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83520f3a79ea4f8c9593aac314d7db4d', 'request_id': 'req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.107499 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] The token cache is being invalidate because project 83520f3a79ea4f8c9593aac314d7db4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:54:35.107774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.108407 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.109940 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1300/2593] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:54:34 2021] DELETE /identity/v3/projects/83520f3a79ea4f8c9593aac314d7db4d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:54:35.114062 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bccb77-d77e-487c-8346-4bac2538bb5e admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:54:35.115494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-43bccb77-d77e-487c-8346-4bac2538bb5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:54:35.128894 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bccb77-d77e-487c-8346-4bac2538bb5e admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:54:35.182913 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870561c-a782-43ea-8bb4-0c7f64dc3f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:54:35.183923 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870561c-a782-43ea-8bb4-0c7f64dc3f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:54:35.184213 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870561c-a782-43ea-8bb4-0c7f64dc3f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:54:35.184492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870561c-a782-43ea-8bb4-0c7f64dc3f47 admin admin] PATH_INFO: `/v3/users/aa5ff63a82be470e988c40f6777efc97` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:54:35.197377 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870561c-a782-43ea-8bb4-0c7f64dc3f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5ff63a82be470e988c40f6777efc97)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:54:35.200018 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870561c-a782-43ea-8bb4-0c7f64dc3f47 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:54:35.244702 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1870561c-a782-43ea-8bb4-0c7f64dc3f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5ff63a82be470e988c40f6777efc97'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.252413 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1870561c-a782-43ea-8bb4-0c7f64dc3f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5ff63a82be470e988c40f6777efc97'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.263007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1870561c-a782-43ea-8bb4-0c7f64dc3f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5ff63a82be470e988c40f6777efc97'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.274322 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1870561c-a782-43ea-8bb4-0c7f64dc3f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5ff63a82be470e988c40f6777efc97'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.275049 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-1870561c-a782-43ea-8bb4-0c7f64dc3f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5ff63a82be470e988c40f6777efc97'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.281489 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1294/2594] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 00:54:35 2021] DELETE /identity/v3/users/aa5ff63a82be470e988c40f6777efc97 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:54:35.450979 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:54:35.452400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:54:35.465437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b764c59-083a-41a6-b4e6-d3aa7f80c9e9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:54:35.520715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:54:35.521576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:54:35.521862 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:54:35.522140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] PATH_INFO: `/v3/projects/83f5fe8db7ed4e6da56d13d046017238` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:54:35.532083 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f5fe8db7ed4e6da56d13d046017238)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:54:35.533989 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:54:35.577178 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f5fe8db7ed4e6da56d13d046017238', 'request_id': 'req-a02bf737-50be-4508-92ff-21ba1196637d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.582310 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f5fe8db7ed4e6da56d13d046017238', 'request_id': 'req-a02bf737-50be-4508-92ff-21ba1196637d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.588592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f5fe8db7ed4e6da56d13d046017238', 'request_id': 'req-a02bf737-50be-4508-92ff-21ba1196637d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.600121 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] The token cache is being invalidate because project 83f5fe8db7ed4e6da56d13d046017238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 00:54:35.600410 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.601024 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 00:54:35.602523 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1301/2595] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 00:54:35 2021] DELETE /identity/v3/projects/83f5fe8db7ed4e6da56d13d046017238 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 00:56:06.225126 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870561c-a782-43ea-8bb4-0c7f64dc3f47 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:56:06.226520 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1870561c-a782-43ea-8bb4-0c7f64dc3f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:56:06.339701 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870561c-a782-43ea-8bb4-0c7f64dc3f47 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:56:06.398589 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08052ccf-4dc9-4c09-b373-74a10408491f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:56:06.399269 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08052ccf-4dc9-4c09-b373-74a10408491f service placement] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:56:06.399557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08052ccf-4dc9-4c09-b373-74a10408491f service placement] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:56:06.399838 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08052ccf-4dc9-4c09-b373-74a10408491f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:56:06.401596 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-08052ccf-4dc9-4c09-b373-74a10408491f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:56:06.412478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08052ccf-4dc9-4c09-b373-74a10408491f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:56:06.414070 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08052ccf-4dc9-4c09-b373-74a10408491f service placement] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:56:06.424279 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1295/2596] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:56:06 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:57:13.230778 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:57:13.232711 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:57:13.288825 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bf737-50be-4508-92ff-21ba1196637d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:57:13.292456 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa797c2-7a3e-4eb1-983f-658befb26ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:57:13.293095 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa797c2-7a3e-4eb1-983f-658befb26ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:57:13.293382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa797c2-7a3e-4eb1-983f-658befb26ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:57:13.293660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa797c2-7a3e-4eb1-983f-658befb26ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:57:13.296068 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3aa797c2-7a3e-4eb1-983f-658befb26ca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:57:13.354195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa797c2-7a3e-4eb1-983f-658befb26ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:57:13.355916 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa797c2-7a3e-4eb1-983f-658befb26ca4 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:57:13.365332 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1302/2597] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:57:13 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:57:14.218623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08052ccf-4dc9-4c09-b373-74a10408491f service placement] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:57:14.228015 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08052ccf-4dc9-4c09-b373-74a10408491f service placement] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:57:14.232435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d94479-fd55-429b-a435-2f3608cb9498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:57:14.233063 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d94479-fd55-429b-a435-2f3608cb9498 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:57:14.233347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d94479-fd55-429b-a435-2f3608cb9498 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:57:14.233626 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d94479-fd55-429b-a435-2f3608cb9498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:57:14.235412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d6d94479-fd55-429b-a435-2f3608cb9498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:57:14.291712 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d94479-fd55-429b-a435-2f3608cb9498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:57:14.293140 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d94479-fd55-429b-a435-2f3608cb9498 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:57:14.301981 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1296/2598] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:57:14 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:58:11.632715 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa797c2-7a3e-4eb1-983f-658befb26ca4 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:58:11.634110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3aa797c2-7a3e-4eb1-983f-658befb26ca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:58:11.717226 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa797c2-7a3e-4eb1-983f-658befb26ca4 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:58:11.720800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d318d5c-d52c-427a-a634-3f626071f78b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:58:11.721438 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318d5c-d52c-427a-a634-3f626071f78b service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:58:11.721769 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318d5c-d52c-427a-a634-3f626071f78b service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:58:11.721995 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318d5c-d52c-427a-a634-3f626071f78b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:58:11.723723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9d318d5c-d52c-427a-a634-3f626071f78b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:58:11.733526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d318d5c-d52c-427a-a634-3f626071f78b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:58:11.734969 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d318d5c-d52c-427a-a634-3f626071f78b service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:58:11.742617 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1303/2599] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:58:11 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 00:58:21.731629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d94479-fd55-429b-a435-2f3608cb9498 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 00:58:21.750008 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d94479-fd55-429b-a435-2f3608cb9498 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 00:58:21.753694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1554fb-db05-4202-8bff-63c68f16c1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 00:58:21.754331 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1554fb-db05-4202-8bff-63c68f16c1ee service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 00:58:21.754615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1554fb-db05-4202-8bff-63c68f16c1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 00:58:21.754922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1554fb-db05-4202-8bff-63c68f16c1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 00:58:21.756641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-fe1554fb-db05-4202-8bff-63c68f16c1ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 00:58:21.812349 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1554fb-db05-4202-8bff-63c68f16c1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 00:58:21.813784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1554fb-db05-4202-8bff-63c68f16c1ee service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 00:58:21.822447 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1297/2600] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 00:58:21 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:00:27.927744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d318d5c-d52c-427a-a634-3f626071f78b service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:00:27.929254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9d318d5c-d52c-427a-a634-3f626071f78b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:00:27.939800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d318d5c-d52c-427a-a634-3f626071f78b service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:00:27.943396 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed910b2f-c13e-4418-bfd5-e8b437f6ce2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:00:27.944024 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910b2f-c13e-4418-bfd5-e8b437f6ce2c service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:00:27.944302 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910b2f-c13e-4418-bfd5-e8b437f6ce2c service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:00:27.944580 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910b2f-c13e-4418-bfd5-e8b437f6ce2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:00:27.946255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ed910b2f-c13e-4418-bfd5-e8b437f6ce2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:00:28.034464 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed910b2f-c13e-4418-bfd5-e8b437f6ce2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:00:28.035938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed910b2f-c13e-4418-bfd5-e8b437f6ce2c service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:00:28.055593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1304/2601] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:00:27 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:00:29.224226 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1554fb-db05-4202-8bff-63c68f16c1ee service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:00:29.234552 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1554fb-db05-4202-8bff-63c68f16c1ee service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:00:29.238216 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a481f9-6504-4d9f-83b8-919ca6416afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:00:29.238876 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a481f9-6504-4d9f-83b8-919ca6416afb service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:00:29.239168 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a481f9-6504-4d9f-83b8-919ca6416afb service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:00:29.239442 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a481f9-6504-4d9f-83b8-919ca6416afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:00:29.241192 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e9a481f9-6504-4d9f-83b8-919ca6416afb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:00:29.257082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a481f9-6504-4d9f-83b8-919ca6416afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:00:29.260272 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a481f9-6504-4d9f-83b8-919ca6416afb service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:00:29.271375 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1298/2602] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:00:29 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:00:29.554147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed910b2f-c13e-4418-bfd5-e8b437f6ce2c service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:00:29.556117 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-ed910b2f-c13e-4418-bfd5-e8b437f6ce2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:00:29.574826 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed910b2f-c13e-4418-bfd5-e8b437f6ce2c service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:00:29.584367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760a538-7903-4375-ba91-d5e1473fcb1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:00:29.585125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760a538-7903-4375-ba91-d5e1473fcb1a service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:00:29.585430 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760a538-7903-4375-ba91-d5e1473fcb1a service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:00:29.585702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760a538-7903-4375-ba91-d5e1473fcb1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:00:29.587526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d760a538-7903-4375-ba91-d5e1473fcb1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:00:29.601249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760a538-7903-4375-ba91-d5e1473fcb1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:00:29.602960 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760a538-7903-4375-ba91-d5e1473fcb1a service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:00:29.624711 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1305/2603] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:00:29 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 01:01:12.200307 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a481f9-6504-4d9f-83b8-919ca6416afb service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:01:12.201677 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e9a481f9-6504-4d9f-83b8-919ca6416afb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:01:12.228097 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a481f9-6504-4d9f-83b8-919ca6416afb service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:01:12.233424 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f95e9f-28a0-44bc-be20-a1b5ce5fe92a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:01:12.234068 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f95e9f-28a0-44bc-be20-a1b5ce5fe92a service placement] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:01:12.234360 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f95e9f-28a0-44bc-be20-a1b5ce5fe92a service placement] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:01:12.234645 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f95e9f-28a0-44bc-be20-a1b5ce5fe92a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:01:12.243885 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f95e9f-28a0-44bc-be20-a1b5ce5fe92a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:01:12.245469 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f95e9f-28a0-44bc-be20-a1b5ce5fe92a service placement] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:01:12.256175 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1299/2604] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:01:12 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:02:13.218220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760a538-7903-4375-ba91-d5e1473fcb1a service nova] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:02:13.220140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-d760a538-7903-4375-ba91-d5e1473fcb1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:02:13.242944 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760a538-7903-4375-ba91-d5e1473fcb1a service nova] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:02:13.246471 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a727665-6f11-4c99-a1ce-dd0a70189c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:02:13.247142 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a727665-6f11-4c99-a1ce-dd0a70189c33 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:02:13.247423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a727665-6f11-4c99-a1ce-dd0a70189c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:02:13.247697 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a727665-6f11-4c99-a1ce-dd0a70189c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:02:13.257032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a727665-6f11-4c99-a1ce-dd0a70189c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:02:13.258457 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a727665-6f11-4c99-a1ce-dd0a70189c33 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:02:13.278705 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1306/2605] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:02:13 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:02:14.224796 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f95e9f-28a0-44bc-be20-a1b5ce5fe92a service placement] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:02:14.226655 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-c7f95e9f-28a0-44bc-be20-a1b5ce5fe92a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:02:14.244834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f95e9f-28a0-44bc-be20-a1b5ce5fe92a service placement] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:02:14.250701 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b400e-d7ff-48db-8786-fbae365fb406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:02:14.251570 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b400e-d7ff-48db-8786-fbae365fb406 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:02:14.252090 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b400e-d7ff-48db-8786-fbae365fb406 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:02:14.252619 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b400e-d7ff-48db-8786-fbae365fb406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:02:14.262681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b400e-d7ff-48db-8786-fbae365fb406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:02:14.264382 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b400e-d7ff-48db-8786-fbae365fb406 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:02:14.292815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1300/2606] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:02:14 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:03:21.634281 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a727665-6f11-4c99-a1ce-dd0a70189c33 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:03:21.642674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a727665-6f11-4c99-a1ce-dd0a70189c33 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:03:21.646264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5403a-7c92-46b0-8d9e-b6851c877e42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:03:21.646952 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5403a-7c92-46b0-8d9e-b6851c877e42 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:03:21.647232 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5403a-7c92-46b0-8d9e-b6851c877e42 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:03:21.647528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5403a-7c92-46b0-8d9e-b6851c877e42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:03:21.655496 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5403a-7c92-46b0-8d9e-b6851c877e42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:03:21.657954 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5403a-7c92-46b0-8d9e-b6851c877e42 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:03:21.684099 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1307/2607] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:03:21 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:03:27.596459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89e8b6-22bb-4cf3-be80-314852ac2ad7 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:03:27.596977 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89e8b6-22bb-4cf3-be80-314852ac2ad7 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:03:27.597094 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89e8b6-22bb-4cf3-be80-314852ac2ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:03:27.634287 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-6a89e8b6-22bb-4cf3-be80-314852ac2ad7 None None] MFA Rules not processed for user `1d51fbb5c640469890668ef74f779e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:03:27.635545 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6a89e8b6-22bb-4cf3-be80-314852ac2ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:03:27.642731 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1301/2608] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:03:27 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:03:27.935625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5403a-7c92-46b0-8d9e-b6851c877e42 service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:03:27.944812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5403a-7c92-46b0-8d9e-b6851c877e42 service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:03:27.948549 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce6936-9e4d-422c-ab56-8d8df8a20433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:03:27.949264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6936-9e4d-422c-ab56-8d8df8a20433 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:03:27.949622 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6936-9e4d-422c-ab56-8d8df8a20433 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:03:27.949969 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6936-9e4d-422c-ab56-8d8df8a20433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:03:27.951834 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-30ce6936-9e4d-422c-ab56-8d8df8a20433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:03:27.962239 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce6936-9e4d-422c-ab56-8d8df8a20433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:03:27.963735 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce6936-9e4d-422c-ab56-8d8df8a20433 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:03:27.972140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1308/2609] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:03:27 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:03:28.283579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89e8b6-22bb-4cf3-be80-314852ac2ad7 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:03:28.300544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89e8b6-22bb-4cf3-be80-314852ac2ad7 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:03:28.305539 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ebc0a-6cbd-41b1-a9da-8381b01adc9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:03:28.306188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ebc0a-6cbd-41b1-a9da-8381b01adc9e service placement] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:03:28.306477 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ebc0a-6cbd-41b1-a9da-8381b01adc9e service placement] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:03:28.306748 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ebc0a-6cbd-41b1-a9da-8381b01adc9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:03:28.308542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-1a3ebc0a-6cbd-41b1-a9da-8381b01adc9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:03:28.320744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ebc0a-6cbd-41b1-a9da-8381b01adc9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:03:28.322256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ebc0a-6cbd-41b1-a9da-8381b01adc9e service placement] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:03:28.332954 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1302/2610] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:03:28 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:03:31.044948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce6936-9e4d-422c-ab56-8d8df8a20433 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:03:31.054504 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce6936-9e4d-422c-ab56-8d8df8a20433 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:03:31.057849 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7e19c-3eb4-499e-8d20-25e7c7b6cbe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:03:31.058497 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7e19c-3eb4-499e-8d20-25e7c7b6cbe0 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:03:31.058786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7e19c-3eb4-499e-8d20-25e7c7b6cbe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:03:31.059120 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7e19c-3eb4-499e-8d20-25e7c7b6cbe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:03:31.066858 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7e19c-3eb4-499e-8d20-25e7c7b6cbe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:03:31.068348 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7e19c-3eb4-499e-8d20-25e7c7b6cbe0 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:03:31.076876 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1309/2611] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:03:31 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:03:37.277859 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ebc0a-6cbd-41b1-a9da-8381b01adc9e service placement] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:03:37.290475 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ebc0a-6cbd-41b1-a9da-8381b01adc9e service placement] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:03:37.296051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad456fac-c830-4bb6-8f6a-49242c4047b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:03:37.296694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad456fac-c830-4bb6-8f6a-49242c4047b0 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:03:37.296980 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad456fac-c830-4bb6-8f6a-49242c4047b0 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:03:37.297259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad456fac-c830-4bb6-8f6a-49242c4047b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:03:37.299280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-ad456fac-c830-4bb6-8f6a-49242c4047b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:03:37.311411 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad456fac-c830-4bb6-8f6a-49242c4047b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:03:37.313599 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad456fac-c830-4bb6-8f6a-49242c4047b0 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:03:37.324139 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1303/2612] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:03:37 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:03:42.222624 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7e19c-3eb4-499e-8d20-25e7c7b6cbe0 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:03:42.242160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7e19c-3eb4-499e-8d20-25e7c7b6cbe0 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:03:42.248027 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456828b9-476c-414c-a25f-34a95abe76f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:03:42.248810 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456828b9-476c-414c-a25f-34a95abe76f4 service nova] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:03:42.249102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456828b9-476c-414c-a25f-34a95abe76f4 service nova] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:03:42.249384 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456828b9-476c-414c-a25f-34a95abe76f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:03:42.251340 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-456828b9-476c-414c-a25f-34a95abe76f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:03:42.264434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456828b9-476c-414c-a25f-34a95abe76f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:03:42.265636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456828b9-476c-414c-a25f-34a95abe76f4 service nova] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:03:42.276813 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1310/2613] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:03:42 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:06:18.180344 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad456fac-c830-4bb6-8f6a-49242c4047b0 service nova] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:06:18.285961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad456fac-c830-4bb6-8f6a-49242c4047b0 service nova] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:06:18.291036 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5d96d-4feb-4a61-a762-0b483c57d6fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:06:18.291679 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5d96d-4feb-4a61-a762-0b483c57d6fa service placement] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:06:18.291966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5d96d-4feb-4a61-a762-0b483c57d6fa service placement] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:06:18.292248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5d96d-4feb-4a61-a762-0b483c57d6fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:06:18.294096 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-41f5d96d-4feb-4a61-a762-0b483c57d6fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:06:18.305783 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5d96d-4feb-4a61-a762-0b483c57d6fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:06:18.307390 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5d96d-4feb-4a61-a762-0b483c57d6fa service placement] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:06:18.316998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1304/2614] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:06:18 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:07:13.296200 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456828b9-476c-414c-a25f-34a95abe76f4 service nova] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:07:13.365982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456828b9-476c-414c-a25f-34a95abe76f4 service nova] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:07:13.369621 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6fc4b-9fb8-4535-aaa8-328668a0dbeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:07:13.370266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6fc4b-9fb8-4535-aaa8-328668a0dbeb service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:07:13.370631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6fc4b-9fb8-4535-aaa8-328668a0dbeb service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:07:13.370818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6fc4b-9fb8-4535-aaa8-328668a0dbeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:07:13.372704 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a1e6fc4b-9fb8-4535-aaa8-328668a0dbeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:07:13.452460 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6fc4b-9fb8-4535-aaa8-328668a0dbeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:07:13.453927 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6fc4b-9fb8-4535-aaa8-328668a0dbeb service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:07:13.464105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1311/2615] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:07:13 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:07:14.508625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5d96d-4feb-4a61-a762-0b483c57d6fa service placement] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:07:14.521329 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5d96d-4feb-4a61-a762-0b483c57d6fa service placement] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:07:14.525142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5030895-ad86-424c-a590-4727903cb921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:07:14.525623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5030895-ad86-424c-a590-4727903cb921 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:07:14.525907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5030895-ad86-424c-a590-4727903cb921 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:07:14.526187 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5030895-ad86-424c-a590-4727903cb921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:07:14.528075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f5030895-ad86-424c-a590-4727903cb921 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:07:14.585177 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5030895-ad86-424c-a590-4727903cb921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:07:14.586618 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5030895-ad86-424c-a590-4727903cb921 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:07:14.595974 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1305/2616] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:07:14 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:08:21.945761 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6fc4b-9fb8-4535-aaa8-328668a0dbeb service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:08:21.965075 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6fc4b-9fb8-4535-aaa8-328668a0dbeb service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:08:21.968695 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518b581-f43a-4dd2-809b-40eb6ae01d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:08:21.969331 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b581-f43a-4dd2-809b-40eb6ae01d4e service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:08:21.969619 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b581-f43a-4dd2-809b-40eb6ae01d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:08:21.970392 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b581-f43a-4dd2-809b-40eb6ae01d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:08:21.972252 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3518b581-f43a-4dd2-809b-40eb6ae01d4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:08:22.047729 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518b581-f43a-4dd2-809b-40eb6ae01d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:08:22.049786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518b581-f43a-4dd2-809b-40eb6ae01d4e service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:08:22.058472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1312/2617] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:08:21 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:09:29.255651 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5030895-ad86-424c-a590-4727903cb921 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:09:29.257334 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f5030895-ad86-424c-a590-4727903cb921 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:09:29.342370 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5030895-ad86-424c-a590-4727903cb921 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:09:29.346243 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f242be-aa8c-4d91-a37a-6c9f0b618b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:09:29.346872 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f242be-aa8c-4d91-a37a-6c9f0b618b9c service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:09:29.347171 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f242be-aa8c-4d91-a37a-6c9f0b618b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:09:29.347455 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f242be-aa8c-4d91-a37a-6c9f0b618b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:09:29.349410 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d9f242be-aa8c-4d91-a37a-6c9f0b618b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:09:29.359072 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f242be-aa8c-4d91-a37a-6c9f0b618b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:09:29.360494 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f242be-aa8c-4d91-a37a-6c9f0b618b9c service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:09:29.368767 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1306/2618] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:09:29 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:09:32.432215 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518b581-f43a-4dd2-809b-40eb6ae01d4e service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:09:32.433879 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3518b581-f43a-4dd2-809b-40eb6ae01d4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:09:32.444649 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518b581-f43a-4dd2-809b-40eb6ae01d4e service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:09:32.448267 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdaf846-f8e2-4a51-9426-a59dab44a21f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:09:32.448901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaf846-f8e2-4a51-9426-a59dab44a21f service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:09:32.449180 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaf846-f8e2-4a51-9426-a59dab44a21f service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:09:32.449455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaf846-f8e2-4a51-9426-a59dab44a21f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:09:32.459961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdaf846-f8e2-4a51-9426-a59dab44a21f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:09:32.461387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdaf846-f8e2-4a51-9426-a59dab44a21f service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:09:32.473230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1313/2619] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:09:32 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:09:49.903345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f242be-aa8c-4d91-a37a-6c9f0b618b9c service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:09:49.912895 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f242be-aa8c-4d91-a37a-6c9f0b618b9c service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:09:49.916612 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9548822-cd6c-434c-9476-b5b28b4a6755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:09:49.917248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548822-cd6c-434c-9476-b5b28b4a6755 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:09:49.917532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548822-cd6c-434c-9476-b5b28b4a6755 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:09:49.917812 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548822-cd6c-434c-9476-b5b28b4a6755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:09:49.928851 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9548822-cd6c-434c-9476-b5b28b4a6755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:09:49.930283 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9548822-cd6c-434c-9476-b5b28b4a6755 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:09:49.941866 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1307/2620] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:09:49 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:09:58.440720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdaf846-f8e2-4a51-9426-a59dab44a21f service cinder] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:09:58.449937 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdaf846-f8e2-4a51-9426-a59dab44a21f service cinder] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:09:58.453549 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31d4aa-b90d-486c-a948-5a2512c116bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:09:58.454187 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31d4aa-b90d-486c-a948-5a2512c116bf service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:09:58.454473 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31d4aa-b90d-486c-a948-5a2512c116bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:09:58.454754 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31d4aa-b90d-486c-a948-5a2512c116bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:09:58.456579 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-9d31d4aa-b90d-486c-a948-5a2512c116bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:09:58.536426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31d4aa-b90d-486c-a948-5a2512c116bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:09:58.538657 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31d4aa-b90d-486c-a948-5a2512c116bf service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:09:58.557117 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1314/2621] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:09:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:09:59.053454 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9548822-cd6c-434c-9476-b5b28b4a6755 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:09:59.055030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a9548822-cd6c-434c-9476-b5b28b4a6755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:09:59.069555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9548822-cd6c-434c-9476-b5b28b4a6755 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:09:59.074861 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c07884-b6d7-4248-bbcd-359b85766c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:09:59.075847 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07884-b6d7-4248-bbcd-359b85766c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:09:59.076136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07884-b6d7-4248-bbcd-359b85766c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:09:59.076420 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c07884-b6d7-4248-bbcd-359b85766c00 admin admin] PATH_INFO: `/v3/users/d8197174f38346748b8225819b6d1e8c` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:09:59.078000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c07884-b6d7-4248-bbcd-359b85766c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8197174f38346748b8225819b6d1e8c)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:09:59.080403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c07884-b6d7-4248-bbcd-359b85766c00 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:09:59.131981 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-c1c07884-b6d7-4248-bbcd-359b85766c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8197174f38346748b8225819b6d1e8c'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:09:59.143178 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-c1c07884-b6d7-4248-bbcd-359b85766c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8197174f38346748b8225819b6d1e8c'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:09:59.158882 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-c1c07884-b6d7-4248-bbcd-359b85766c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8197174f38346748b8225819b6d1e8c'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:09:59.172677 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-c1c07884-b6d7-4248-bbcd-359b85766c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8197174f38346748b8225819b6d1e8c'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:09:59.173712 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-c1c07884-b6d7-4248-bbcd-359b85766c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8197174f38346748b8225819b6d1e8c'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:09:59.179955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1308/2622] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:09:59 2021] DELETE /identity/v3/users/d8197174f38346748b8225819b6d1e8c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:09:59.355892 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31d4aa-b90d-486c-a948-5a2512c116bf service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:09:59.366416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31d4aa-b90d-486c-a948-5a2512c116bf service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:09:59.423190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:09:59.424051 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:09:59.424342 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:09:59.424625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] PATH_INFO: `/v3/projects/678286f0a95542d4bff18dc16b593434` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:09:59.425857 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=678286f0a95542d4bff18dc16b593434)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:09:59.428298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:09:59.472292 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '678286f0a95542d4bff18dc16b593434', 'request_id': 'req-5ca4505c-b4db-4142-a56d-3ef938f4ede5'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:09:59.477809 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '678286f0a95542d4bff18dc16b593434', 'request_id': 'req-5ca4505c-b4db-4142-a56d-3ef938f4ede5'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:09:59.484050 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '678286f0a95542d4bff18dc16b593434', 'request_id': 'req-5ca4505c-b4db-4142-a56d-3ef938f4ede5'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:09:59.495917 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] The token cache is being invalidate because project 678286f0a95542d4bff18dc16b593434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:09:59.496204 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:09:59.496831 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:09:59.498336 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1315/2623] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:09:59 2021] DELETE /identity/v3/projects/678286f0a95542d4bff18dc16b593434 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:05.563378 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c07884-b6d7-4248-bbcd-359b85766c00 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:05.564843 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-c1c07884-b6d7-4248-bbcd-359b85766c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:05.650669 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c07884-b6d7-4248-bbcd-359b85766c00 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:05.722258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c85e74-eedd-44c1-a927-70f3236bdd72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:05.723149 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85e74-eedd-44c1-a927-70f3236bdd72 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:05.723501 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85e74-eedd-44c1-a927-70f3236bdd72 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:05.723784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85e74-eedd-44c1-a927-70f3236bdd72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:05.726317 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-10c85e74-eedd-44c1-a927-70f3236bdd72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:05.738516 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c85e74-eedd-44c1-a927-70f3236bdd72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:05.740709 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c85e74-eedd-44c1-a927-70f3236bdd72 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:05.751454 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1309/2624] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:05 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:10.790134 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:10.791566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:10.846006 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4505c-b4db-4142-a56d-3ef938f4ede5 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:10.850374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc76b9e-16e1-4249-801e-8fd66880e4c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:10.851059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc76b9e-16e1-4249-801e-8fd66880e4c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:10.851350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc76b9e-16e1-4249-801e-8fd66880e4c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:10.851628 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc76b9e-16e1-4249-801e-8fd66880e4c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:10.853363 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-2bc76b9e-16e1-4249-801e-8fd66880e4c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:10.918129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc76b9e-16e1-4249-801e-8fd66880e4c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:10.919613 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc76b9e-16e1-4249-801e-8fd66880e4c8 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:10.929914 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1316/2625] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:13.789082 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c85e74-eedd-44c1-a927-70f3236bdd72 service nova] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:13.790597 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-10c85e74-eedd-44c1-a927-70f3236bdd72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:13.808010 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c85e74-eedd-44c1-a927-70f3236bdd72 service nova] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:13.812558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7bc86-f823-483f-afff-abdedf324144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:13.813415 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7bc86-f823-483f-afff-abdedf324144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:13.813694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7bc86-f823-483f-afff-abdedf324144 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:13.813966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7bc86-f823-483f-afff-abdedf324144 admin admin] PATH_INFO: `/v3/users/1d51fbb5c640469890668ef74f779e2d` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:13.815204 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7bc86-f823-483f-afff-abdedf324144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d51fbb5c640469890668ef74f779e2d)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:13.817109 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7bc86-f823-483f-afff-abdedf324144 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:13.861786 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-74b7bc86-f823-483f-afff-abdedf324144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d51fbb5c640469890668ef74f779e2d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:13.869315 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-74b7bc86-f823-483f-afff-abdedf324144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d51fbb5c640469890668ef74f779e2d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:13.876601 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-74b7bc86-f823-483f-afff-abdedf324144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d51fbb5c640469890668ef74f779e2d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:13.889052 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-74b7bc86-f823-483f-afff-abdedf324144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d51fbb5c640469890668ef74f779e2d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:13.889864 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-74b7bc86-f823-483f-afff-abdedf324144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d51fbb5c640469890668ef74f779e2d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:13.895593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1310/2626] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:10:13 2021] DELETE /identity/v3/users/1d51fbb5c640469890668ef74f779e2d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:14.316947 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc76b9e-16e1-4249-801e-8fd66880e4c8 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:14.328724 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc76b9e-16e1-4249-801e-8fd66880e4c8 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:14.385826 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:14.386694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:14.387014 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:14.387296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b admin admin] PATH_INFO: `/v3/projects/d5af0d5138994a26903d6168c9ec362b` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:14.388480 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5af0d5138994a26903d6168c9ec362b)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:14.390404 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:14.435032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5af0d5138994a26903d6168c9ec362b', 'request_id': 'req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:14.440706 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5af0d5138994a26903d6168c9ec362b', 'request_id': 'req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:14.446897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5af0d5138994a26903d6168c9ec362b', 'request_id': 'req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:14.458150 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b admin admin] The token cache is being invalidate because project d5af0d5138994a26903d6168c9ec362b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:10:14.458438 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:14.460000 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-525115ee-7aa2-4801-b2ef-a3b4e1d3042b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:14.461528 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1317/2627] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:10:14 2021] DELETE /identity/v3/projects/d5af0d5138994a26903d6168c9ec362b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:14.467325 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7eb6f-3b3a-43d4-9756-40a7fa65c43d None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:14.467621 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7eb6f-3b3a-43d4-9756-40a7fa65c43d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:14.467907 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7eb6f-3b3a-43d4-9756-40a7fa65c43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:14.523638 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-8dd7eb6f-3b3a-43d4-9756-40a7fa65c43d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:14.524852 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8dd7eb6f-3b3a-43d4-9756-40a7fa65c43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:14.580204 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1311/2628] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:14.589304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa7341-a7f5-42b3-ad2e-77794da8a6d5 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:14.589593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa7341-a7f5-42b3-ad2e-77794da8a6d5 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:14.589875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa7341-a7f5-42b3-ad2e-77794da8a6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:14.608726 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c6aa7341-a7f5-42b3-ad2e-77794da8a6d5 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:14.609897 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c6aa7341-a7f5-42b3-ad2e-77794da8a6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:14.618231 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1318/2629] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:14.622222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7eb6f-3b3a-43d4-9756-40a7fa65c43d None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:14.632144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7eb6f-3b3a-43d4-9756-40a7fa65c43d None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:14.636759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907969ad-6113-4acd-a517-2f5b46eeae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:14.637413 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907969ad-6113-4acd-a517-2f5b46eeae4d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:14.637700 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907969ad-6113-4acd-a517-2f5b46eeae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:14.637982 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907969ad-6113-4acd-a517-2f5b46eeae4d admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:14.638705 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907969ad-6113-4acd-a517-2f5b46eeae4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 01:10:14.639053 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907969ad-6113-4acd-a517-2f5b46eeae4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:14.640660 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907969ad-6113-4acd-a517-2f5b46eeae4d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:14.652529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1312/2630] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 01:10:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 01:10:14.656838 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa7341-a7f5-42b3-ad2e-77794da8a6d5 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:14.666170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa7341-a7f5-42b3-ad2e-77794da8a6d5 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:14.670812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef044d3e-7c86-4a87-abbd-f0f01f91fa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:14.671487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef044d3e-7c86-4a87-abbd-f0f01f91fa4e admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:14.671800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef044d3e-7c86-4a87-abbd-f0f01f91fa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:14.672080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef044d3e-7c86-4a87-abbd-f0f01f91fa4e admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:14.672769 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef044d3e-7c86-4a87-abbd-f0f01f91fa4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:14.674656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef044d3e-7c86-4a87-abbd-f0f01f91fa4e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:14.708509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1319/2631] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:10:14 2021] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:10:14.713197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907969ad-6113-4acd-a517-2f5b46eeae4d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:14.722976 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907969ad-6113-4acd-a517-2f5b46eeae4d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:14.776430 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d061d5-e36c-4b3f-b7f1-3f38695a6624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:14.777025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d061d5-e36c-4b3f-b7f1-3f38695a6624 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:14.777309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d061d5-e36c-4b3f-b7f1-3f38695a6624 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:14.777588 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d061d5-e36c-4b3f-b7f1-3f38695a6624 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:14.778280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d061d5-e36c-4b3f-b7f1-3f38695a6624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:14.780241 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d061d5-e36c-4b3f-b7f1-3f38695a6624 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:14.798801 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1313/2632] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:10:14 2021] POST /identity/v3/users => generated 283 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 01:10:14.803086 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef044d3e-7c86-4a87-abbd-f0f01f91fa4e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:14.813233 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef044d3e-7c86-4a87-abbd-f0f01f91fa4e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:14.817905 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02131b5-4002-41d9-9a08-fe64facd67d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:14.819195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02131b5-4002-41d9-9a08-fe64facd67d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:14.819484 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02131b5-4002-41d9-9a08-fe64facd67d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:14.819762 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02131b5-4002-41d9-9a08-fe64facd67d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:14.820484 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02131b5-4002-41d9-9a08-fe64facd67d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:14.822085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02131b5-4002-41d9-9a08-fe64facd67d0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:14.831895 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1320/2633] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:14.836643 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d061d5-e36c-4b3f-b7f1-3f38695a6624 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:14.846364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d061d5-e36c-4b3f-b7f1-3f38695a6624 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:14.851211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2beaf7-1eb4-4496-95c4-3773bebdb990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:14.851865 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2beaf7-1eb4-4496-95c4-3773bebdb990 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:14.852151 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2beaf7-1eb4-4496-95c4-3773bebdb990 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:14.852427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2beaf7-1eb4-4496-95c4-3773bebdb990 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:14.853144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2beaf7-1eb4-4496-95c4-3773bebdb990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:14.855009 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2beaf7-1eb4-4496-95c4-3773bebdb990 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:14.864664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1314/2634] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:14 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:14.868658 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02131b5-4002-41d9-9a08-fe64facd67d0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:14.878236 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02131b5-4002-41d9-9a08-fe64facd67d0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:14.883566 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6ba83-232e-4fdd-bee8-a889c563dae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:14.884433 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6ba83-232e-4fdd-bee8-a889c563dae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:14.884711 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6ba83-232e-4fdd-bee8-a889c563dae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:14.884999 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6ba83-232e-4fdd-bee8-a889c563dae9 admin admin] PATH_INFO: `/v3/projects/30b0eb081d864aa88efd13c418430f21/users/7ee0e65de7c04dd79e4dd837c35c1211/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:14.900771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6ba83-232e-4fdd-bee8-a889c563dae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b0eb081d864aa88efd13c418430f21, user_id=7ee0e65de7c04dd79e4dd837c35c1211, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:14.903452 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6ba83-232e-4fdd-bee8-a889c563dae9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:14.916334 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1321/2635] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:10:14 2021] PUT /identity/v3/projects/30b0eb081d864aa88efd13c418430f21/users/7ee0e65de7c04dd79e4dd837c35c1211/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:14.926430 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeb187-a2b2-49a7-920d-968cb7287f6c None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:14.926739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeb187-a2b2-49a7-920d-968cb7287f6c None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:14.927064 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeb187-a2b2-49a7-920d-968cb7287f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:14.960079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-cedeb187-a2b2-49a7-920d-968cb7287f6c None None] MFA Rules not processed for user `7ee0e65de7c04dd79e4dd837c35c1211`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:14.961137 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-cedeb187-a2b2-49a7-920d-968cb7287f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:15.023446 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1315/2636] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:14 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:15.027886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6ba83-232e-4fdd-bee8-a889c563dae9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:15.092189 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6ba83-232e-4fdd-bee8-a889c563dae9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:15.096828 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bccc2-7e2e-420a-ad0e-c5bfa699db56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:15.097487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bccc2-7e2e-420a-ad0e-c5bfa699db56 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:15.097771 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bccc2-7e2e-420a-ad0e-c5bfa699db56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:15.098047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bccc2-7e2e-420a-ad0e-c5bfa699db56 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:15.098742 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bccc2-7e2e-420a-ad0e-c5bfa699db56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:15.100849 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bccc2-7e2e-420a-ad0e-c5bfa699db56 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:15.126309 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1322/2637] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:10:15 2021] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 01:10:15.130610 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedeb187-a2b2-49a7-920d-968cb7287f6c None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:15.141658 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedeb187-a2b2-49a7-920d-968cb7287f6c None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:15.196318 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b1c2a-d6ec-4a40-b46c-c570986877cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:15.196996 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b1c2a-d6ec-4a40-b46c-c570986877cc admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:15.197287 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b1c2a-d6ec-4a40-b46c-c570986877cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:15.197571 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b1c2a-d6ec-4a40-b46c-c570986877cc admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:15.198275 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b1c2a-d6ec-4a40-b46c-c570986877cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:15.200240 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b1c2a-d6ec-4a40-b46c-c570986877cc admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:15.219242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1316/2638] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:10:15 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:10:15.223149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bccc2-7e2e-420a-ad0e-c5bfa699db56 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:15.233843 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bccc2-7e2e-420a-ad0e-c5bfa699db56 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:15.238580 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8c918-cb4b-4b3b-bbf6-f1770279e8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:15.239284 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8c918-cb4b-4b3b-bbf6-f1770279e8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:15.239571 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8c918-cb4b-4b3b-bbf6-f1770279e8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:15.240384 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8c918-cb4b-4b3b-bbf6-f1770279e8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:15.241080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8c918-cb4b-4b3b-bbf6-f1770279e8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:15.242663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8c918-cb4b-4b3b-bbf6-f1770279e8b2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:15.254900 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1323/2639] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:15 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:15.260009 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b1c2a-d6ec-4a40-b46c-c570986877cc admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:15.269793 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b1c2a-d6ec-4a40-b46c-c570986877cc admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:15.274452 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd2519-3963-4c96-9d87-d490347e7daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:15.275352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd2519-3963-4c96-9d87-d490347e7daf admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:15.275637 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd2519-3963-4c96-9d87-d490347e7daf admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:15.275914 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd2519-3963-4c96-9d87-d490347e7daf admin admin] PATH_INFO: `/v3/projects/b44f8c18a7824f9baedd46b9200c9940/users/2cceeee2608b43c9b9b4ee06465e3c74/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:15.290001 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd2519-3963-4c96-9d87-d490347e7daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44f8c18a7824f9baedd46b9200c9940, user_id=2cceeee2608b43c9b9b4ee06465e3c74, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:15.292622 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd2519-3963-4c96-9d87-d490347e7daf admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:15.305633 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1317/2640] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:10:15 2021] PUT /identity/v3/projects/b44f8c18a7824f9baedd46b9200c9940/users/2cceeee2608b43c9b9b4ee06465e3c74/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 01:10:15.309472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8c918-cb4b-4b3b-bbf6-f1770279e8b2 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:15.319823 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8c918-cb4b-4b3b-bbf6-f1770279e8b2 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:15.375147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232919d-537d-40b9-b62e-7ef156636207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:15.375812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232919d-537d-40b9-b62e-7ef156636207 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:15.376104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232919d-537d-40b9-b62e-7ef156636207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:15.376382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232919d-537d-40b9-b62e-7ef156636207 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:15.377098 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232919d-537d-40b9-b62e-7ef156636207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:15.378683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232919d-537d-40b9-b62e-7ef156636207 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:15.388903 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1324/2641] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:15 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 01:10:15.392988 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd2519-3963-4c96-9d87-d490347e7daf admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:15.403464 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd2519-3963-4c96-9d87-d490347e7daf admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:15.408119 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30001022-b036-4364-9e21-8b14d3b42985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:15.408997 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30001022-b036-4364-9e21-8b14d3b42985 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:15.409284 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30001022-b036-4364-9e21-8b14d3b42985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:15.409567 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30001022-b036-4364-9e21-8b14d3b42985 admin admin] PATH_INFO: `/v3/projects/b44f8c18a7824f9baedd46b9200c9940/users/2cceeee2608b43c9b9b4ee06465e3c74/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:15.411582 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30001022-b036-4364-9e21-8b14d3b42985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44f8c18a7824f9baedd46b9200c9940, user_id=2cceeee2608b43c9b9b4ee06465e3c74, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:15.414942 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30001022-b036-4364-9e21-8b14d3b42985 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:15.425104 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1318/2642] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:10:15 2021] PUT /identity/v3/projects/b44f8c18a7824f9baedd46b9200c9940/users/2cceeee2608b43c9b9b4ee06465e3c74/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:15.436622 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f369d-d455-43bc-b636-1ceee9da11ab None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:15.436913 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f369d-d455-43bc-b636-1ceee9da11ab None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:15.437195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f369d-d455-43bc-b636-1ceee9da11ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:15.464203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-201f369d-d455-43bc-b636-1ceee9da11ab None None] MFA Rules not processed for user `2cceeee2608b43c9b9b4ee06465e3c74`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:15.465574 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-201f369d-d455-43bc-b636-1ceee9da11ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:15.531215 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1325/2643] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:15 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 01:10:15.542107 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30001022-b036-4364-9e21-8b14d3b42985 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:15.543808 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-30001022-b036-4364-9e21-8b14d3b42985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:15.598846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30001022-b036-4364-9e21-8b14d3b42985 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:15.603380 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a388026-dbf8-48cd-ac45-360da0bab7c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:15.604014 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a388026-dbf8-48cd-ac45-360da0bab7c5 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:15.604565 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a388026-dbf8-48cd-ac45-360da0bab7c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:15.604841 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a388026-dbf8-48cd-ac45-360da0bab7c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:15.613550 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a388026-dbf8-48cd-ac45-360da0bab7c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:15.616117 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a388026-dbf8-48cd-ac45-360da0bab7c5 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:15.625222 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1319/2644] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:15 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:15.783625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f369d-d455-43bc-b636-1ceee9da11ab None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:15.843246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f369d-d455-43bc-b636-1ceee9da11ab None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:15.847805 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25934827-657f-44d5-8ed4-8b3ab14f6a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:15.848672 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25934827-657f-44d5-8ed4-8b3ab14f6a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:15.848955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25934827-657f-44d5-8ed4-8b3ab14f6a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:15.849261 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25934827-657f-44d5-8ed4-8b3ab14f6a87 admin admin] PATH_INFO: `/v3/users/7ee0e65de7c04dd79e4dd837c35c1211` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:15.851046 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25934827-657f-44d5-8ed4-8b3ab14f6a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ee0e65de7c04dd79e4dd837c35c1211)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:15.853311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25934827-657f-44d5-8ed4-8b3ab14f6a87 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:15.898587 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-25934827-657f-44d5-8ed4-8b3ab14f6a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ee0e65de7c04dd79e4dd837c35c1211'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:15.905177 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-25934827-657f-44d5-8ed4-8b3ab14f6a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ee0e65de7c04dd79e4dd837c35c1211'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:15.905846 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-25934827-657f-44d5-8ed4-8b3ab14f6a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ee0e65de7c04dd79e4dd837c35c1211'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:15.917002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-25934827-657f-44d5-8ed4-8b3ab14f6a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ee0e65de7c04dd79e4dd837c35c1211'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:15.917632 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-25934827-657f-44d5-8ed4-8b3ab14f6a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ee0e65de7c04dd79e4dd837c35c1211'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:15.931185 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1326/2645] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:10:15 2021] DELETE /identity/v3/users/7ee0e65de7c04dd79e4dd837c35c1211 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:15.935383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137ccc8-0223-491b-964b-6546dcb3457d None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:15.935809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137ccc8-0223-491b-964b-6546dcb3457d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:15.935947 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137ccc8-0223-491b-964b-6546dcb3457d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:15.954046 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-6137ccc8-0223-491b-964b-6546dcb3457d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:15.955294 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6137ccc8-0223-491b-964b-6546dcb3457d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:16.015023 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1320/2646] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:16.024573 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25934827-657f-44d5-8ed4-8b3ab14f6a87 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:16.026012 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-25934827-657f-44d5-8ed4-8b3ab14f6a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:16.081703 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25934827-657f-44d5-8ed4-8b3ab14f6a87 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:16.085890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c077c-73d8-4a1d-a260-cfb0d3f79a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:16.086533 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c077c-73d8-4a1d-a260-cfb0d3f79a61 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:16.086816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c077c-73d8-4a1d-a260-cfb0d3f79a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:16.087126 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c077c-73d8-4a1d-a260-cfb0d3f79a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:16.095845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c077c-73d8-4a1d-a260-cfb0d3f79a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:16.097204 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c077c-73d8-4a1d-a260-cfb0d3f79a61 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:16.106982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1327/2647] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:16.363291 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137ccc8-0223-491b-964b-6546dcb3457d None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:16.364730 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6137ccc8-0223-491b-964b-6546dcb3457d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:16.377263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137ccc8-0223-491b-964b-6546dcb3457d None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:16.382060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:16.383027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:16.383379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:16.383739 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] PATH_INFO: `/v3/projects/30b0eb081d864aa88efd13c418430f21` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:16.384990 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b0eb081d864aa88efd13c418430f21)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:16.387184 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:16.432713 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b0eb081d864aa88efd13c418430f21', 'request_id': 'req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:16.438599 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b0eb081d864aa88efd13c418430f21', 'request_id': 'req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:16.445333 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b0eb081d864aa88efd13c418430f21', 'request_id': 'req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:16.455238 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] The token cache is being invalidate because project 30b0eb081d864aa88efd13c418430f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:10:16.455530 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:16.456163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:16.457667 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1321/2648] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:10:16 2021] DELETE /identity/v3/projects/30b0eb081d864aa88efd13c418430f21 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:16.461859 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c077c-73d8-4a1d-a260-cfb0d3f79a61 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:16.471238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c077c-73d8-4a1d-a260-cfb0d3f79a61 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:16.526254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbeb3df-7d4f-41c9-a0d7-7e1592e7e889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:16.527139 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbeb3df-7d4f-41c9-a0d7-7e1592e7e889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:16.527420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbeb3df-7d4f-41c9-a0d7-7e1592e7e889 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:16.527690 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbeb3df-7d4f-41c9-a0d7-7e1592e7e889 admin admin] PATH_INFO: `/v3/users/2cceeee2608b43c9b9b4ee06465e3c74` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:16.528860 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbeb3df-7d4f-41c9-a0d7-7e1592e7e889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cceeee2608b43c9b9b4ee06465e3c74)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:16.530767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbeb3df-7d4f-41c9-a0d7-7e1592e7e889 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:16.575227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3dbeb3df-7d4f-41c9-a0d7-7e1592e7e889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cceeee2608b43c9b9b4ee06465e3c74'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:16.581714 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3dbeb3df-7d4f-41c9-a0d7-7e1592e7e889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cceeee2608b43c9b9b4ee06465e3c74'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:16.582361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3dbeb3df-7d4f-41c9-a0d7-7e1592e7e889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cceeee2608b43c9b9b4ee06465e3c74'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:16.594240 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3dbeb3df-7d4f-41c9-a0d7-7e1592e7e889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cceeee2608b43c9b9b4ee06465e3c74'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:16.594893 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-3dbeb3df-7d4f-41c9-a0d7-7e1592e7e889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cceeee2608b43c9b9b4ee06465e3c74'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:16.608337 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1328/2649] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:10:16 2021] DELETE /identity/v3/users/2cceeee2608b43c9b9b4ee06465e3c74 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:16.864946 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:16.866784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:16.880018 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e740a9c-e6ac-412b-afc3-dadd3e9930b4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:16.935761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e48552-1a3b-4873-8c5b-214114a0ff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:16.936624 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e48552-1a3b-4873-8c5b-214114a0ff4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:16.936912 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e48552-1a3b-4873-8c5b-214114a0ff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:16.937191 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e48552-1a3b-4873-8c5b-214114a0ff4b admin admin] PATH_INFO: `/v3/projects/b44f8c18a7824f9baedd46b9200c9940` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:16.938356 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e48552-1a3b-4873-8c5b-214114a0ff4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44f8c18a7824f9baedd46b9200c9940)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:16.940377 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e48552-1a3b-4873-8c5b-214114a0ff4b admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:16.986060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-35e48552-1a3b-4873-8c5b-214114a0ff4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44f8c18a7824f9baedd46b9200c9940', 'request_id': 'req-35e48552-1a3b-4873-8c5b-214114a0ff4b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:16.992154 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-35e48552-1a3b-4873-8c5b-214114a0ff4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44f8c18a7824f9baedd46b9200c9940', 'request_id': 'req-35e48552-1a3b-4873-8c5b-214114a0ff4b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:16.999165 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-35e48552-1a3b-4873-8c5b-214114a0ff4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44f8c18a7824f9baedd46b9200c9940', 'request_id': 'req-35e48552-1a3b-4873-8c5b-214114a0ff4b'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:17.009834 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-35e48552-1a3b-4873-8c5b-214114a0ff4b admin admin] The token cache is being invalidate because project b44f8c18a7824f9baedd46b9200c9940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:10:17.010129 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-35e48552-1a3b-4873-8c5b-214114a0ff4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:17.010753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-35e48552-1a3b-4873-8c5b-214114a0ff4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:17.012303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1322/2650] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:10:16 2021] DELETE /identity/v3/projects/b44f8c18a7824f9baedd46b9200c9940 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:17.018011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182d47f-6e54-4505-979b-49f7f57bb6f0 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.018305 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182d47f-6e54-4505-979b-49f7f57bb6f0 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.018593 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182d47f-6e54-4505-979b-49f7f57bb6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.037579 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-5182d47f-6e54-4505-979b-49f7f57bb6f0 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:17.038772 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-5182d47f-6e54-4505-979b-49f7f57bb6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:17.096298 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1329/2651] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:17.105989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8cbd2-3957-4be8-865b-b3f7f9604b8a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.106286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8cbd2-3957-4be8-865b-b3f7f9604b8a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.106593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8cbd2-3957-4be8-865b-b3f7f9604b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.124699 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-68f8cbd2-3957-4be8-865b-b3f7f9604b8a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:17.125829 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-68f8cbd2-3957-4be8-865b-b3f7f9604b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:17.134204 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1323/2652] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:17.138302 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182d47f-6e54-4505-979b-49f7f57bb6f0 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:17.148202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182d47f-6e54-4505-979b-49f7f57bb6f0 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:17.152794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe341f0-6175-44bc-877b-2b3ec56d25d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:17.153436 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe341f0-6175-44bc-877b-2b3ec56d25d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.153718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe341f0-6175-44bc-877b-2b3ec56d25d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.153996 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe341f0-6175-44bc-877b-2b3ec56d25d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.154710 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe341f0-6175-44bc-877b-2b3ec56d25d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 01:10:17.155047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe341f0-6175-44bc-877b-2b3ec56d25d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:17.156634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe341f0-6175-44bc-877b-2b3ec56d25d0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:17.167950 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1330/2653] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 01:10:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 01:10:17.171878 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8cbd2-3957-4be8-865b-b3f7f9604b8a None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:17.181194 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8cbd2-3957-4be8-865b-b3f7f9604b8a None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:17.186396 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bc8c4-54f2-4cf6-bd15-144eab7b550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:17.187134 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bc8c4-54f2-4cf6-bd15-144eab7b550c admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.187452 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bc8c4-54f2-4cf6-bd15-144eab7b550c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.187734 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bc8c4-54f2-4cf6-bd15-144eab7b550c admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.188528 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bc8c4-54f2-4cf6-bd15-144eab7b550c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:17.190561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bc8c4-54f2-4cf6-bd15-144eab7b550c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:17.216696 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1324/2654] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:10:17 2021] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:10:17.220754 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe341f0-6175-44bc-877b-2b3ec56d25d0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:17.231125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe341f0-6175-44bc-877b-2b3ec56d25d0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:17.284580 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee7e07-d0f6-44fc-b421-306fc5867a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:17.285237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee7e07-d0f6-44fc-b421-306fc5867a31 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.285520 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee7e07-d0f6-44fc-b421-306fc5867a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.285798 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee7e07-d0f6-44fc-b421-306fc5867a31 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.286483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee7e07-d0f6-44fc-b421-306fc5867a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:17.288854 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee7e07-d0f6-44fc-b421-306fc5867a31 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:17.308146 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1331/2655] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:10:17 2021] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:10:17.312153 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bc8c4-54f2-4cf6-bd15-144eab7b550c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:17.323116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bc8c4-54f2-4cf6-bd15-144eab7b550c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:17.327773 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed0713-8a10-4fc0-a254-113b5096bfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:17.328433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed0713-8a10-4fc0-a254-113b5096bfcf admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.328720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed0713-8a10-4fc0-a254-113b5096bfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.328999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed0713-8a10-4fc0-a254-113b5096bfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.329719 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed0713-8a10-4fc0-a254-113b5096bfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:17.331338 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed0713-8a10-4fc0-a254-113b5096bfcf admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:17.341920 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1325/2656] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:17.345756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee7e07-d0f6-44fc-b421-306fc5867a31 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:17.359030 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee7e07-d0f6-44fc-b421-306fc5867a31 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:17.367287 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf887e64-4b93-4bd7-ba88-bc5e6151d605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:17.368142 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf887e64-4b93-4bd7-ba88-bc5e6151d605 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.368432 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf887e64-4b93-4bd7-ba88-bc5e6151d605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.368714 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf887e64-4b93-4bd7-ba88-bc5e6151d605 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.382019 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf887e64-4b93-4bd7-ba88-bc5e6151d605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:17.383625 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf887e64-4b93-4bd7-ba88-bc5e6151d605 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:17.394071 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1332/2657] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:17 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:17.399094 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed0713-8a10-4fc0-a254-113b5096bfcf admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:17.408790 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed0713-8a10-4fc0-a254-113b5096bfcf admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:17.414451 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05c841-e8bf-4d35-ad06-5717ca47c9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:17.415359 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05c841-e8bf-4d35-ad06-5717ca47c9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.415640 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05c841-e8bf-4d35-ad06-5717ca47c9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.415915 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05c841-e8bf-4d35-ad06-5717ca47c9c6 admin admin] PATH_INFO: `/v3/projects/00cbad470b63497da9e957e35593f6cd/users/48695d37e7e242c9a18392d154f7f0b8/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.430565 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05c841-e8bf-4d35-ad06-5717ca47c9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cbad470b63497da9e957e35593f6cd, user_id=48695d37e7e242c9a18392d154f7f0b8, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:17.433252 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05c841-e8bf-4d35-ad06-5717ca47c9c6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:17.446110 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1326/2658] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:10:17 2021] PUT /identity/v3/projects/00cbad470b63497da9e957e35593f6cd/users/48695d37e7e242c9a18392d154f7f0b8/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:17.458011 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a2d0-4eac-4f2e-abf7-cbd18f37ecba None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.458301 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a2d0-4eac-4f2e-abf7-cbd18f37ecba None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.459124 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a2d0-4eac-4f2e-abf7-cbd18f37ecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.485272 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-6810a2d0-4eac-4f2e-abf7-cbd18f37ecba None None] MFA Rules not processed for user `48695d37e7e242c9a18392d154f7f0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:17.486455 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6810a2d0-4eac-4f2e-abf7-cbd18f37ecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:17.547195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1333/2659] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:17 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:17.551642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05c841-e8bf-4d35-ad06-5717ca47c9c6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:17.610688 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05c841-e8bf-4d35-ad06-5717ca47c9c6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:17.615625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e92d7-dacc-4ec0-a1ba-927d952cc26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:17.616269 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e92d7-dacc-4ec0-a1ba-927d952cc26a admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.616555 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e92d7-dacc-4ec0-a1ba-927d952cc26a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.616832 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e92d7-dacc-4ec0-a1ba-927d952cc26a admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.617516 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e92d7-dacc-4ec0-a1ba-927d952cc26a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:17.619453 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e92d7-dacc-4ec0-a1ba-927d952cc26a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:17.643902 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1327/2660] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:10:17 2021] POST /identity/v3/projects => generated 389 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 01:10:17.648634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810a2d0-4eac-4f2e-abf7-cbd18f37ecba None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:17.659739 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810a2d0-4eac-4f2e-abf7-cbd18f37ecba None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:17.715247 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597a599-2ed1-41dc-b865-0ffe664df254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:17.715927 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597a599-2ed1-41dc-b865-0ffe664df254 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.716215 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597a599-2ed1-41dc-b865-0ffe664df254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.716493 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597a599-2ed1-41dc-b865-0ffe664df254 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.717206 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597a599-2ed1-41dc-b865-0ffe664df254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:17.719170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597a599-2ed1-41dc-b865-0ffe664df254 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:17.740106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1334/2661] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:10:17 2021] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 01:10:17.748664 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e92d7-dacc-4ec0-a1ba-927d952cc26a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:17.760155 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e92d7-dacc-4ec0-a1ba-927d952cc26a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:17.768343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c2666-d4c5-40ca-ac5d-7d82321ebdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:17.769054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c2666-d4c5-40ca-ac5d-7d82321ebdfe admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.769346 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c2666-d4c5-40ca-ac5d-7d82321ebdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.769632 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c2666-d4c5-40ca-ac5d-7d82321ebdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.771771 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c2666-d4c5-40ca-ac5d-7d82321ebdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:17.773743 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c2666-d4c5-40ca-ac5d-7d82321ebdfe admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:17.784338 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1328/2662] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:17 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:17.788927 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597a599-2ed1-41dc-b865-0ffe664df254 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:17.798682 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597a599-2ed1-41dc-b865-0ffe664df254 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:17.803495 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7405e-574a-433e-a9ec-4f0bcbbfa31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:17.804362 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7405e-574a-433e-a9ec-4f0bcbbfa31a admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.804645 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7405e-574a-433e-a9ec-4f0bcbbfa31a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.804925 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7405e-574a-433e-a9ec-4f0bcbbfa31a admin admin] PATH_INFO: `/v3/projects/ce48a7cbb43c4045925df2df684e492d/users/8a50d6a5c6474064b98684f4d4749192/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.819544 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7405e-574a-433e-a9ec-4f0bcbbfa31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce48a7cbb43c4045925df2df684e492d, user_id=8a50d6a5c6474064b98684f4d4749192, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:17.822186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7405e-574a-433e-a9ec-4f0bcbbfa31a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:17.836572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1335/2663] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:10:17 2021] PUT /identity/v3/projects/ce48a7cbb43c4045925df2df684e492d/users/8a50d6a5c6474064b98684f4d4749192/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:17.840407 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c2666-d4c5-40ca-ac5d-7d82321ebdfe admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:17.851511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c2666-d4c5-40ca-ac5d-7d82321ebdfe admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:17.906482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de7998-dcf4-43a9-a629-4303ee25144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:17.907097 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de7998-dcf4-43a9-a629-4303ee25144f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.907383 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de7998-dcf4-43a9-a629-4303ee25144f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.907661 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de7998-dcf4-43a9-a629-4303ee25144f admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.908374 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de7998-dcf4-43a9-a629-4303ee25144f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:17.909973 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de7998-dcf4-43a9-a629-4303ee25144f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:17.919814 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1329/2664] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:17 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:17.924087 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7405e-574a-433e-a9ec-4f0bcbbfa31a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:17.934633 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7405e-574a-433e-a9ec-4f0bcbbfa31a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:17.939337 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6930818-6b85-45de-b1af-bf5263139df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:17.940218 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6930818-6b85-45de-b1af-bf5263139df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.940507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6930818-6b85-45de-b1af-bf5263139df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.940787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6930818-6b85-45de-b1af-bf5263139df0 admin admin] PATH_INFO: `/v3/projects/ce48a7cbb43c4045925df2df684e492d/users/8a50d6a5c6474064b98684f4d4749192/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.942778 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6930818-6b85-45de-b1af-bf5263139df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce48a7cbb43c4045925df2df684e492d, user_id=8a50d6a5c6474064b98684f4d4749192, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:17.946175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6930818-6b85-45de-b1af-bf5263139df0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:17.956440 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1336/2665] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:10:17 2021] PUT /identity/v3/projects/ce48a7cbb43c4045925df2df684e492d/users/8a50d6a5c6474064b98684f4d4749192/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:17.967144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e21425-44c5-4ac4-b698-b057e0572d7d None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:17.967609 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e21425-44c5-4ac4-b698-b057e0572d7d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:17.967720 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e21425-44c5-4ac4-b698-b057e0572d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:17.993162 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-45e21425-44c5-4ac4-b698-b057e0572d7d None None] MFA Rules not processed for user `8a50d6a5c6474064b98684f4d4749192`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:17.994368 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-45e21425-44c5-4ac4-b698-b057e0572d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:18.062682 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1330/2666] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:17 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:18.073982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6930818-6b85-45de-b1af-bf5263139df0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:18.075451 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e6930818-6b85-45de-b1af-bf5263139df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:18.137581 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6930818-6b85-45de-b1af-bf5263139df0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:18.141307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8191c-c581-4fad-b64a-f6fd5afde30c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:18.141953 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8191c-c581-4fad-b64a-f6fd5afde30c service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:18.142238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8191c-c581-4fad-b64a-f6fd5afde30c service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:18.142516 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8191c-c581-4fad-b64a-f6fd5afde30c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:18.151416 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8191c-c581-4fad-b64a-f6fd5afde30c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:18.152848 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8191c-c581-4fad-b64a-f6fd5afde30c service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:18.162147 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1337/2667] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:18 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:18.278567 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e21425-44c5-4ac4-b698-b057e0572d7d None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:18.338477 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e21425-44c5-4ac4-b698-b057e0572d7d None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:18.343072 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23670d53-8b8f-47d9-950c-b4a1e0408b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:18.343936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23670d53-8b8f-47d9-950c-b4a1e0408b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:18.344223 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23670d53-8b8f-47d9-950c-b4a1e0408b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:18.344505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23670d53-8b8f-47d9-950c-b4a1e0408b89 admin admin] PATH_INFO: `/v3/users/48695d37e7e242c9a18392d154f7f0b8` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:18.345689 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23670d53-8b8f-47d9-950c-b4a1e0408b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48695d37e7e242c9a18392d154f7f0b8)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:18.347646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23670d53-8b8f-47d9-950c-b4a1e0408b89 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:18.393645 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-23670d53-8b8f-47d9-950c-b4a1e0408b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48695d37e7e242c9a18392d154f7f0b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:18.401004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-23670d53-8b8f-47d9-950c-b4a1e0408b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48695d37e7e242c9a18392d154f7f0b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:18.408468 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-23670d53-8b8f-47d9-950c-b4a1e0408b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48695d37e7e242c9a18392d154f7f0b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:18.421749 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-23670d53-8b8f-47d9-950c-b4a1e0408b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48695d37e7e242c9a18392d154f7f0b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:18.422352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-23670d53-8b8f-47d9-950c-b4a1e0408b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48695d37e7e242c9a18392d154f7f0b8'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:18.429329 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1331/2668] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:10:18 2021] DELETE /identity/v3/users/48695d37e7e242c9a18392d154f7f0b8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:18.434737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969b37b-4b7f-4065-b431-e6eafe6e6afa None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:18.435080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969b37b-4b7f-4065-b431-e6eafe6e6afa None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:18.435358 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969b37b-4b7f-4065-b431-e6eafe6e6afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:18.455029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-b969b37b-4b7f-4065-b431-e6eafe6e6afa None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:18.456248 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b969b37b-4b7f-4065-b431-e6eafe6e6afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:18.513089 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1338/2669] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:18.523490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23670d53-8b8f-47d9-950c-b4a1e0408b89 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:18.524884 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-23670d53-8b8f-47d9-950c-b4a1e0408b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:18.581433 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23670d53-8b8f-47d9-950c-b4a1e0408b89 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:18.585665 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4ede9-4b5e-44f6-9895-d260fb6af819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:18.586310 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4ede9-4b5e-44f6-9895-d260fb6af819 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:18.586595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4ede9-4b5e-44f6-9895-d260fb6af819 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:18.586898 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4ede9-4b5e-44f6-9895-d260fb6af819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:18.595764 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4ede9-4b5e-44f6-9895-d260fb6af819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:18.597187 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4ede9-4b5e-44f6-9895-d260fb6af819 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:18.607584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1332/2670] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 01:10:18.872158 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969b37b-4b7f-4065-b431-e6eafe6e6afa None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:18.873706 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b969b37b-4b7f-4065-b431-e6eafe6e6afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:18.886038 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969b37b-4b7f-4065-b431-e6eafe6e6afa None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:18.890789 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:18.891695 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:18.891979 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:18.892255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] PATH_INFO: `/v3/projects/00cbad470b63497da9e957e35593f6cd` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:18.893447 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00cbad470b63497da9e957e35593f6cd)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:18.895403 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:18.944192 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00cbad470b63497da9e957e35593f6cd', 'request_id': 'req-c9438c9a-7141-489a-b516-59bb784b20d3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:18.949392 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00cbad470b63497da9e957e35593f6cd', 'request_id': 'req-c9438c9a-7141-489a-b516-59bb784b20d3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:18.955487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00cbad470b63497da9e957e35593f6cd', 'request_id': 'req-c9438c9a-7141-489a-b516-59bb784b20d3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:18.968229 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] The token cache is being invalidate because project 00cbad470b63497da9e957e35593f6cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:10:18.968522 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:18.969145 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:18.970675 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1339/2671] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:10:18 2021] DELETE /identity/v3/projects/00cbad470b63497da9e957e35593f6cd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 01:10:18.975562 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4ede9-4b5e-44f6-9895-d260fb6af819 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:18.985280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4ede9-4b5e-44f6-9895-d260fb6af819 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:19.040542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed159890-7149-4e8f-b902-2b5c05e56024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:19.041417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed159890-7149-4e8f-b902-2b5c05e56024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:19.041706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed159890-7149-4e8f-b902-2b5c05e56024 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:19.041986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed159890-7149-4e8f-b902-2b5c05e56024 admin admin] PATH_INFO: `/v3/users/8a50d6a5c6474064b98684f4d4749192` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:19.043225 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed159890-7149-4e8f-b902-2b5c05e56024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a50d6a5c6474064b98684f4d4749192)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:19.045181 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed159890-7149-4e8f-b902-2b5c05e56024 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:19.088919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ed159890-7149-4e8f-b902-2b5c05e56024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a50d6a5c6474064b98684f4d4749192'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:19.095457 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ed159890-7149-4e8f-b902-2b5c05e56024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a50d6a5c6474064b98684f4d4749192'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:19.103309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ed159890-7149-4e8f-b902-2b5c05e56024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a50d6a5c6474064b98684f4d4749192'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:19.114863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ed159890-7149-4e8f-b902-2b5c05e56024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a50d6a5c6474064b98684f4d4749192'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:19.115572 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ed159890-7149-4e8f-b902-2b5c05e56024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a50d6a5c6474064b98684f4d4749192'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:19.122238 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1333/2672] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:10:18 2021] DELETE /identity/v3/users/8a50d6a5c6474064b98684f4d4749192 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:19.379538 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:19.382533 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:19.397379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9438c9a-7141-489a-b516-59bb784b20d3 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:19.451884 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193baa9-a2cf-4608-9948-321fa62a5f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:19.452737 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193baa9-a2cf-4608-9948-321fa62a5f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:19.453021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193baa9-a2cf-4608-9948-321fa62a5f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:19.453295 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193baa9-a2cf-4608-9948-321fa62a5f3f admin admin] PATH_INFO: `/v3/projects/ce48a7cbb43c4045925df2df684e492d` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:19.454469 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193baa9-a2cf-4608-9948-321fa62a5f3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce48a7cbb43c4045925df2df684e492d)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:19.456437 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193baa9-a2cf-4608-9948-321fa62a5f3f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:19.501831 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4193baa9-a2cf-4608-9948-321fa62a5f3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce48a7cbb43c4045925df2df684e492d', 'request_id': 'req-4193baa9-a2cf-4608-9948-321fa62a5f3f'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:19.507341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4193baa9-a2cf-4608-9948-321fa62a5f3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce48a7cbb43c4045925df2df684e492d', 'request_id': 'req-4193baa9-a2cf-4608-9948-321fa62a5f3f'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:19.513065 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4193baa9-a2cf-4608-9948-321fa62a5f3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce48a7cbb43c4045925df2df684e492d', 'request_id': 'req-4193baa9-a2cf-4608-9948-321fa62a5f3f'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:19.525127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4193baa9-a2cf-4608-9948-321fa62a5f3f admin admin] The token cache is being invalidate because project ce48a7cbb43c4045925df2df684e492d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:10:19.525719 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4193baa9-a2cf-4608-9948-321fa62a5f3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:19.526061 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-4193baa9-a2cf-4608-9948-321fa62a5f3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:19.527584 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1340/2673] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:10:19 2021] DELETE /identity/v3/projects/ce48a7cbb43c4045925df2df684e492d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:19.533164 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886dd86-a668-459f-bb11-1a456e9a46e1 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:19.533455 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886dd86-a668-459f-bb11-1a456e9a46e1 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:19.533736 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886dd86-a668-459f-bb11-1a456e9a46e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:19.551021 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-b886dd86-a668-459f-bb11-1a456e9a46e1 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:19.552700 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-b886dd86-a668-459f-bb11-1a456e9a46e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:19.608011 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1334/2674] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:19.616506 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f4f24-7959-4d3d-a22b-85024b276220 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:19.616794 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f4f24-7959-4d3d-a22b-85024b276220 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:19.617072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f4f24-7959-4d3d-a22b-85024b276220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:19.635767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-498f4f24-7959-4d3d-a22b-85024b276220 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:19.636979 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-498f4f24-7959-4d3d-a22b-85024b276220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:19.645693 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1341/2675] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:19.649633 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886dd86-a668-459f-bb11-1a456e9a46e1 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:19.659539 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886dd86-a668-459f-bb11-1a456e9a46e1 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:19.665644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b802e-d775-4b57-b63d-a0eec237ccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:19.666316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b802e-d775-4b57-b63d-a0eec237ccd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:19.666634 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b802e-d775-4b57-b63d-a0eec237ccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:19.667318 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b802e-d775-4b57-b63d-a0eec237ccd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:19.668095 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b802e-d775-4b57-b63d-a0eec237ccd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 01:10:19.668095 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b802e-d775-4b57-b63d-a0eec237ccd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:19.669781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b802e-d775-4b57-b63d-a0eec237ccd4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:19.683346 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1335/2676] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 01:10:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 01:10:19.687651 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f4f24-7959-4d3d-a22b-85024b276220 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:19.697432 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f4f24-7959-4d3d-a22b-85024b276220 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:19.702109 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa76588-0af3-49e5-8a54-da127061c7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:19.702761 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa76588-0af3-49e5-8a54-da127061c7cd admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:19.703080 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa76588-0af3-49e5-8a54-da127061c7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:19.703360 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa76588-0af3-49e5-8a54-da127061c7cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:19.704045 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa76588-0af3-49e5-8a54-da127061c7cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:19.705938 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa76588-0af3-49e5-8a54-da127061c7cd admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:19.731954 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1342/2677] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:10:19 2021] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:10:19.735877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b802e-d775-4b57-b63d-a0eec237ccd4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:19.746366 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b802e-d775-4b57-b63d-a0eec237ccd4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:19.800262 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dd2c1-8020-48a6-b1c7-d9f87248d3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:19.800927 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dd2c1-8020-48a6-b1c7-d9f87248d3fe admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:19.801210 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dd2c1-8020-48a6-b1c7-d9f87248d3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:19.801488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dd2c1-8020-48a6-b1c7-d9f87248d3fe admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:19.802682 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80dd2c1-8020-48a6-b1c7-d9f87248d3fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:19.805096 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80dd2c1-8020-48a6-b1c7-d9f87248d3fe admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:19.824379 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1336/2678] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:10:19 2021] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:10:19.828324 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa76588-0af3-49e5-8a54-da127061c7cd admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:19.838203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa76588-0af3-49e5-8a54-da127061c7cd admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:19.842763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406392a-0c55-4088-b458-93a9a5104a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:19.843446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406392a-0c55-4088-b458-93a9a5104a2e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:19.843728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406392a-0c55-4088-b458-93a9a5104a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:19.844002 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406392a-0c55-4088-b458-93a9a5104a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:19.844718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406392a-0c55-4088-b458-93a9a5104a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:19.846287 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406392a-0c55-4088-b458-93a9a5104a2e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:19.857079 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1343/2679] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:19.860838 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dd2c1-8020-48a6-b1c7-d9f87248d3fe admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:19.871343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dd2c1-8020-48a6-b1c7-d9f87248d3fe admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:19.876006 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18853b-8b2a-458e-aa44-883a26da6039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:19.876691 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18853b-8b2a-458e-aa44-883a26da6039 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:19.876976 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18853b-8b2a-458e-aa44-883a26da6039 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:19.877252 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18853b-8b2a-458e-aa44-883a26da6039 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:19.877971 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18853b-8b2a-458e-aa44-883a26da6039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:19.879592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18853b-8b2a-458e-aa44-883a26da6039 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:19.890280 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1337/2680] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:19.894361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406392a-0c55-4088-b458-93a9a5104a2e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:19.904213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406392a-0c55-4088-b458-93a9a5104a2e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:19.908790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992a5c1-9847-4000-9e99-46847678044c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:19.909652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992a5c1-9847-4000-9e99-46847678044c admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:19.909933 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992a5c1-9847-4000-9e99-46847678044c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:19.910208 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992a5c1-9847-4000-9e99-46847678044c admin admin] PATH_INFO: `/v3/projects/d4389b27ba2242989f8e03ed9ae8f687/users/d114a16a3b664e979c758243a6d304d0/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:19.924558 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992a5c1-9847-4000-9e99-46847678044c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4389b27ba2242989f8e03ed9ae8f687, user_id=d114a16a3b664e979c758243a6d304d0, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:19.927266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992a5c1-9847-4000-9e99-46847678044c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:19.940616 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1344/2681] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:10:19 2021] PUT /identity/v3/projects/d4389b27ba2242989f8e03ed9ae8f687/users/d114a16a3b664e979c758243a6d304d0/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:19.952079 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0be85f-4bf9-4e78-b84f-a190e9f982af None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:19.952382 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0be85f-4bf9-4e78-b84f-a190e9f982af None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:19.952666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0be85f-4bf9-4e78-b84f-a190e9f982af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:19.978763 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7d0be85f-4bf9-4e78-b84f-a190e9f982af None None] MFA Rules not processed for user `d114a16a3b664e979c758243a6d304d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:19.980249 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7d0be85f-4bf9-4e78-b84f-a190e9f982af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:20.041512 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1338/2682] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:19 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:20.046001 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992a5c1-9847-4000-9e99-46847678044c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:20.108178 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992a5c1-9847-4000-9e99-46847678044c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:20.112767 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfbf29-6107-4b2f-bd30-780d51032d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:20.113424 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfbf29-6107-4b2f-bd30-780d51032d2b admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:20.113709 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfbf29-6107-4b2f-bd30-780d51032d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:20.113991 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfbf29-6107-4b2f-bd30-780d51032d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:20.114784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfbf29-6107-4b2f-bd30-780d51032d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:20.117224 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfbf29-6107-4b2f-bd30-780d51032d2b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:20.141110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1345/2683] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:10:20 2021] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:10:20.145315 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0be85f-4bf9-4e78-b84f-a190e9f982af None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:20.156260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0be85f-4bf9-4e78-b84f-a190e9f982af None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:20.213564 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d5952-63b5-4dcb-8d61-1d590c91f781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:20.214240 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5952-63b5-4dcb-8d61-1d590c91f781 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:20.214529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5952-63b5-4dcb-8d61-1d590c91f781 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:20.214812 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5952-63b5-4dcb-8d61-1d590c91f781 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:20.215543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d5952-63b5-4dcb-8d61-1d590c91f781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:20.217490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d5952-63b5-4dcb-8d61-1d590c91f781 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:20.237581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1339/2684] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:10:20 2021] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:10:20.242167 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfbf29-6107-4b2f-bd30-780d51032d2b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:20.252451 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfbf29-6107-4b2f-bd30-780d51032d2b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:20.257252 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f31174-f9f8-470c-a6d4-e093f424f296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:20.257919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f31174-f9f8-470c-a6d4-e093f424f296 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:20.258201 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f31174-f9f8-470c-a6d4-e093f424f296 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:20.258482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f31174-f9f8-470c-a6d4-e093f424f296 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:20.259237 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f31174-f9f8-470c-a6d4-e093f424f296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:20.260833 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f31174-f9f8-470c-a6d4-e093f424f296 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:20.272839 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1346/2685] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:20.276743 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d5952-63b5-4dcb-8d61-1d590c91f781 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:20.286394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d5952-63b5-4dcb-8d61-1d590c91f781 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:20.291593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580f765-56d8-4e8f-91be-103ee8b537bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:20.292472 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f765-56d8-4e8f-91be-103ee8b537bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:20.292758 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f765-56d8-4e8f-91be-103ee8b537bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:20.293038 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f765-56d8-4e8f-91be-103ee8b537bb admin admin] PATH_INFO: `/v3/projects/06ad88886e2540e6a116c49f9a7b2fa7/users/accf204ba81c4fe5b4689587115532be/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:20.307393 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580f765-56d8-4e8f-91be-103ee8b537bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ad88886e2540e6a116c49f9a7b2fa7, user_id=accf204ba81c4fe5b4689587115532be, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:20.310052 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580f765-56d8-4e8f-91be-103ee8b537bb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:20.323008 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1340/2686] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:10:20 2021] PUT /identity/v3/projects/06ad88886e2540e6a116c49f9a7b2fa7/users/accf204ba81c4fe5b4689587115532be/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 01:10:20.326774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f31174-f9f8-470c-a6d4-e093f424f296 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:20.337102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f31174-f9f8-470c-a6d4-e093f424f296 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:20.390999 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191edf6-735e-4280-8a07-7fb574b216be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:20.391590 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191edf6-735e-4280-8a07-7fb574b216be admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:20.391877 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191edf6-735e-4280-8a07-7fb574b216be admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:20.392157 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191edf6-735e-4280-8a07-7fb574b216be admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:20.392871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191edf6-735e-4280-8a07-7fb574b216be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:20.394457 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191edf6-735e-4280-8a07-7fb574b216be admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:20.404727 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1347/2687] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:20 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:20.408754 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580f765-56d8-4e8f-91be-103ee8b537bb admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:20.419538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580f765-56d8-4e8f-91be-103ee8b537bb admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:20.424189 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d3452-0e9a-4cbb-ac2a-fc8bc1aa2ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:20.425060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d3452-0e9a-4cbb-ac2a-fc8bc1aa2ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:20.425345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d3452-0e9a-4cbb-ac2a-fc8bc1aa2ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:20.425623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d3452-0e9a-4cbb-ac2a-fc8bc1aa2ac6 admin admin] PATH_INFO: `/v3/projects/06ad88886e2540e6a116c49f9a7b2fa7/users/accf204ba81c4fe5b4689587115532be/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:20.427658 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d3452-0e9a-4cbb-ac2a-fc8bc1aa2ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ad88886e2540e6a116c49f9a7b2fa7, user_id=accf204ba81c4fe5b4689587115532be, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:20.430272 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d3452-0e9a-4cbb-ac2a-fc8bc1aa2ac6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:20.440157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1341/2688] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:10:20 2021] PUT /identity/v3/projects/06ad88886e2540e6a116c49f9a7b2fa7/users/accf204ba81c4fe5b4689587115532be/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:20.449969 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e36850-3413-4af4-9ace-5e9da11abd04 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:20.450258 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e36850-3413-4af4-9ace-5e9da11abd04 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:20.450572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e36850-3413-4af4-9ace-5e9da11abd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:20.477946 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-10e36850-3413-4af4-9ace-5e9da11abd04 None None] MFA Rules not processed for user `accf204ba81c4fe5b4689587115532be`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:20.479425 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-10e36850-3413-4af4-9ace-5e9da11abd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:20.543829 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1348/2689] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:20 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:20.553640 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d3452-0e9a-4cbb-ac2a-fc8bc1aa2ac6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:20.555375 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9e9d3452-0e9a-4cbb-ac2a-fc8bc1aa2ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:20.611479 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d3452-0e9a-4cbb-ac2a-fc8bc1aa2ac6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:20.615333 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d157f5f-6326-4626-9e9b-0c212e3aff25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:20.615965 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d157f5f-6326-4626-9e9b-0c212e3aff25 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:20.616252 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d157f5f-6326-4626-9e9b-0c212e3aff25 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:20.616529 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d157f5f-6326-4626-9e9b-0c212e3aff25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:20.625202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d157f5f-6326-4626-9e9b-0c212e3aff25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:20.626629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d157f5f-6326-4626-9e9b-0c212e3aff25 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:20.636623 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1342/2690] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:20 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:21.125707 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e36850-3413-4af4-9ace-5e9da11abd04 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:21.186631 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e36850-3413-4af4-9ace-5e9da11abd04 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:21.192127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef9c1-9294-4530-b789-80836bf31779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:21.193626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef9c1-9294-4530-b789-80836bf31779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:21.193913 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef9c1-9294-4530-b789-80836bf31779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:21.194189 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef9c1-9294-4530-b789-80836bf31779 admin admin] PATH_INFO: `/v3/users/d114a16a3b664e979c758243a6d304d0` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:21.195458 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aef9c1-9294-4530-b789-80836bf31779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d114a16a3b664e979c758243a6d304d0)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:21.197564 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aef9c1-9294-4530-b789-80836bf31779 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:21.244746 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-83aef9c1-9294-4530-b789-80836bf31779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd114a16a3b664e979c758243a6d304d0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.251589 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-83aef9c1-9294-4530-b789-80836bf31779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd114a16a3b664e979c758243a6d304d0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.252413 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-83aef9c1-9294-4530-b789-80836bf31779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd114a16a3b664e979c758243a6d304d0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.264636 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-83aef9c1-9294-4530-b789-80836bf31779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd114a16a3b664e979c758243a6d304d0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.265313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-83aef9c1-9294-4530-b789-80836bf31779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd114a16a3b664e979c758243a6d304d0'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.280963 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1349/2691] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:10:21 2021] DELETE /identity/v3/users/d114a16a3b664e979c758243a6d304d0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:21.282991 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dee36a-b6a0-4f93-8992-0fe0cd01c7b5 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:21.283460 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dee36a-b6a0-4f93-8992-0fe0cd01c7b5 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:21.283558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dee36a-b6a0-4f93-8992-0fe0cd01c7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:21.300833 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-a5dee36a-b6a0-4f93-8992-0fe0cd01c7b5 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:21.302028 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a5dee36a-b6a0-4f93-8992-0fe0cd01c7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:21.358908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1343/2692] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:21.369705 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef9c1-9294-4530-b789-80836bf31779 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:21.371135 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-83aef9c1-9294-4530-b789-80836bf31779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:21.426456 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef9c1-9294-4530-b789-80836bf31779 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:21.431219 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008c5b5-c0c7-4ff4-b06c-0252a07b8020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:21.431859 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008c5b5-c0c7-4ff4-b06c-0252a07b8020 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:21.432140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008c5b5-c0c7-4ff4-b06c-0252a07b8020 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:21.432414 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008c5b5-c0c7-4ff4-b06c-0252a07b8020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:21.441134 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008c5b5-c0c7-4ff4-b06c-0252a07b8020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:21.442497 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008c5b5-c0c7-4ff4-b06c-0252a07b8020 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:21.452006 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1350/2693] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:21.705975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dee36a-b6a0-4f93-8992-0fe0cd01c7b5 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:21.707543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-a5dee36a-b6a0-4f93-8992-0fe0cd01c7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:21.720352 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dee36a-b6a0-4f93-8992-0fe0cd01c7b5 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:21.725391 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:21.726326 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:21.726694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:21.727131 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] PATH_INFO: `/v3/projects/d4389b27ba2242989f8e03ed9ae8f687` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:21.728595 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4389b27ba2242989f8e03ed9ae8f687)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:21.731230 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:21.777141 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4389b27ba2242989f8e03ed9ae8f687', 'request_id': 'req-7448b5cd-b2db-430a-8e20-e8a376ba82d4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.782998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4389b27ba2242989f8e03ed9ae8f687', 'request_id': 'req-7448b5cd-b2db-430a-8e20-e8a376ba82d4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.790782 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4389b27ba2242989f8e03ed9ae8f687', 'request_id': 'req-7448b5cd-b2db-430a-8e20-e8a376ba82d4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.800829 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] The token cache is being invalidate because project d4389b27ba2242989f8e03ed9ae8f687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:10:21.801120 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.801745 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.803413 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1344/2694] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:10:21 2021] DELETE /identity/v3/projects/d4389b27ba2242989f8e03ed9ae8f687 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:21.807325 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008c5b5-c0c7-4ff4-b06c-0252a07b8020 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:21.816629 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008c5b5-c0c7-4ff4-b06c-0252a07b8020 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:21.871227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf15a8b-8d4a-4a56-a830-275bfa88e7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:21.872087 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf15a8b-8d4a-4a56-a830-275bfa88e7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:21.872374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf15a8b-8d4a-4a56-a830-275bfa88e7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:21.872650 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf15a8b-8d4a-4a56-a830-275bfa88e7e7 admin admin] PATH_INFO: `/v3/users/accf204ba81c4fe5b4689587115532be` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:21.873826 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf15a8b-8d4a-4a56-a830-275bfa88e7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=accf204ba81c4fe5b4689587115532be)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:21.875781 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf15a8b-8d4a-4a56-a830-275bfa88e7e7 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:21.919413 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ebf15a8b-8d4a-4a56-a830-275bfa88e7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'accf204ba81c4fe5b4689587115532be'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.925861 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ebf15a8b-8d4a-4a56-a830-275bfa88e7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'accf204ba81c4fe5b4689587115532be'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.926520 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ebf15a8b-8d4a-4a56-a830-275bfa88e7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'accf204ba81c4fe5b4689587115532be'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.938372 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ebf15a8b-8d4a-4a56-a830-275bfa88e7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'accf204ba81c4fe5b4689587115532be'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.939030 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-ebf15a8b-8d4a-4a56-a830-275bfa88e7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'accf204ba81c4fe5b4689587115532be'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:21.952117 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1351/2695] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:10:21 2021] DELETE /identity/v3/users/accf204ba81c4fe5b4689587115532be => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:22.205489 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:22.206856 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:22.220063 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448b5cd-b2db-430a-8e20-e8a376ba82d4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:22.276072 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed487152-14ee-47b8-bc1f-04498c39d57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:22.276957 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed487152-14ee-47b8-bc1f-04498c39d57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:22.277248 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed487152-14ee-47b8-bc1f-04498c39d57d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:22.277525 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed487152-14ee-47b8-bc1f-04498c39d57d admin admin] PATH_INFO: `/v3/projects/06ad88886e2540e6a116c49f9a7b2fa7` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:22.278703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed487152-14ee-47b8-bc1f-04498c39d57d admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ad88886e2540e6a116c49f9a7b2fa7)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:22.280649 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed487152-14ee-47b8-bc1f-04498c39d57d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:22.327768 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ed487152-14ee-47b8-bc1f-04498c39d57d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ad88886e2540e6a116c49f9a7b2fa7', 'request_id': 'req-ed487152-14ee-47b8-bc1f-04498c39d57d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:22.333955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ed487152-14ee-47b8-bc1f-04498c39d57d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ad88886e2540e6a116c49f9a7b2fa7', 'request_id': 'req-ed487152-14ee-47b8-bc1f-04498c39d57d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:22.341260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ed487152-14ee-47b8-bc1f-04498c39d57d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ad88886e2540e6a116c49f9a7b2fa7', 'request_id': 'req-ed487152-14ee-47b8-bc1f-04498c39d57d'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:22.351910 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ed487152-14ee-47b8-bc1f-04498c39d57d admin admin] The token cache is being invalidate because project 06ad88886e2540e6a116c49f9a7b2fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:10:22.352204 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ed487152-14ee-47b8-bc1f-04498c39d57d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:22.352839 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ed487152-14ee-47b8-bc1f-04498c39d57d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:22.354611 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1345/2696] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:10:22 2021] DELETE /identity/v3/projects/06ad88886e2540e6a116c49f9a7b2fa7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 01:10:22.360694 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e3277-5dde-4747-8b7c-ec7ac2ac6ae9 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:22.361016 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e3277-5dde-4747-8b7c-ec7ac2ac6ae9 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:22.361296 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e3277-5dde-4747-8b7c-ec7ac2ac6ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:22.378756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c27e3277-5dde-4747-8b7c-ec7ac2ac6ae9 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:22.380225 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c27e3277-5dde-4747-8b7c-ec7ac2ac6ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:22.436638 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1352/2697] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 01:10:22.444414 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b24bb-e149-4eca-a2ea-376a29ee59f1 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:22.444699 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b24bb-e149-4eca-a2ea-376a29ee59f1 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:22.444977 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b24bb-e149-4eca-a2ea-376a29ee59f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:22.462939 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-fa3b24bb-e149-4eca-a2ea-376a29ee59f1 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:22.464061 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-fa3b24bb-e149-4eca-a2ea-376a29ee59f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:22.471764 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1346/2698] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:22.476442 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e3277-5dde-4747-8b7c-ec7ac2ac6ae9 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:22.486221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e3277-5dde-4747-8b7c-ec7ac2ac6ae9 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:22.491583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e79db-e933-4614-900a-39df4e7f52b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:22.492235 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e79db-e933-4614-900a-39df4e7f52b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:22.492524 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e79db-e933-4614-900a-39df4e7f52b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:22.492808 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e79db-e933-4614-900a-39df4e7f52b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:22.493529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e79db-e933-4614-900a-39df4e7f52b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 01:10:22.493841 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e79db-e933-4614-900a-39df4e7f52b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:22.495498 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e79db-e933-4614-900a-39df4e7f52b0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:22.506553 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1353/2699] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 01:10:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 01:10:22.510586 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b24bb-e149-4eca-a2ea-376a29ee59f1 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:22.519604 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b24bb-e149-4eca-a2ea-376a29ee59f1 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:22.525108 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847d5e3-da28-4948-82fe-3b509928808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:22.525750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847d5e3-da28-4948-82fe-3b509928808c admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:22.526033 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847d5e3-da28-4948-82fe-3b509928808c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:22.526308 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847d5e3-da28-4948-82fe-3b509928808c admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:22.527030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847d5e3-da28-4948-82fe-3b509928808c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:22.528915 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847d5e3-da28-4948-82fe-3b509928808c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:22.555260 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1347/2700] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:10:22 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 01:10:22.559328 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e79db-e933-4614-900a-39df4e7f52b0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:22.569391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e79db-e933-4614-900a-39df4e7f52b0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:22.623031 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa87e2-3200-4d1d-b5ea-a028c8fd16a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:22.623695 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa87e2-3200-4d1d-b5ea-a028c8fd16a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:22.623982 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa87e2-3200-4d1d-b5ea-a028c8fd16a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:22.624260 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa87e2-3200-4d1d-b5ea-a028c8fd16a0 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:22.624949 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa87e2-3200-4d1d-b5ea-a028c8fd16a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:22.626874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa87e2-3200-4d1d-b5ea-a028c8fd16a0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:22.646307 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1354/2701] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:10:22 2021] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:10:22.650629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847d5e3-da28-4948-82fe-3b509928808c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:22.660832 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847d5e3-da28-4948-82fe-3b509928808c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:22.666247 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375031fc-e531-4e09-919b-0916c841a496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:22.666936 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375031fc-e531-4e09-919b-0916c841a496 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:22.667223 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375031fc-e531-4e09-919b-0916c841a496 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:22.667503 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375031fc-e531-4e09-919b-0916c841a496 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:22.668232 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375031fc-e531-4e09-919b-0916c841a496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:22.669821 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375031fc-e531-4e09-919b-0916c841a496 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:22.680281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1348/2702] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:22 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:22.684029 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa87e2-3200-4d1d-b5ea-a028c8fd16a0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:22.694010 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa87e2-3200-4d1d-b5ea-a028c8fd16a0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:22.698668 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b64249-ce07-46fc-b504-57a363c22c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:22.699361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b64249-ce07-46fc-b504-57a363c22c62 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:22.699644 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b64249-ce07-46fc-b504-57a363c22c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:22.699919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b64249-ce07-46fc-b504-57a363c22c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:22.700634 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b64249-ce07-46fc-b504-57a363c22c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:22.702215 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b64249-ce07-46fc-b504-57a363c22c62 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:22.715272 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1355/2703] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:22 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:22.716926 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375031fc-e531-4e09-919b-0916c841a496 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:22.727328 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375031fc-e531-4e09-919b-0916c841a496 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:22.732217 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f168020-6041-4b08-b698-fa249935b4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:22.733070 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f168020-6041-4b08-b698-fa249935b4df admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:22.733354 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f168020-6041-4b08-b698-fa249935b4df admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:22.733636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f168020-6041-4b08-b698-fa249935b4df admin admin] PATH_INFO: `/v3/projects/0141c0730a9042c09f09c6801ee38040/users/91bb187b248c448395f9386e016edba2/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:22.747757 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f168020-6041-4b08-b698-fa249935b4df admin admin] RBAC: Authorizing `identity:create_grant(project_id=0141c0730a9042c09f09c6801ee38040, user_id=91bb187b248c448395f9386e016edba2, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:22.750421 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f168020-6041-4b08-b698-fa249935b4df admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:22.765116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1349/2704] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:10:22 2021] PUT /identity/v3/projects/0141c0730a9042c09f09c6801ee38040/users/91bb187b248c448395f9386e016edba2/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:22.818768 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069c76-501d-4a14-961d-69761c59dd7c None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:22.819377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069c76-501d-4a14-961d-69761c59dd7c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:22.819377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069c76-501d-4a14-961d-69761c59dd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:22.845379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-66069c76-501d-4a14-961d-69761c59dd7c None None] MFA Rules not processed for user `91bb187b248c448395f9386e016edba2`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:22.846563 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-66069c76-501d-4a14-961d-69761c59dd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:22.910198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1356/2705] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:22 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:22.922191 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f168020-6041-4b08-b698-fa249935b4df admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:22.924075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4f168020-6041-4b08-b698-fa249935b4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:22.979566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f168020-6041-4b08-b698-fa249935b4df admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:22.983202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8c33d-dd28-4b05-8b2d-7a45f5ec1533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:22.983847 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8c33d-dd28-4b05-8b2d-7a45f5ec1533 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:22.984132 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8c33d-dd28-4b05-8b2d-7a45f5ec1533 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:22.984412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8c33d-dd28-4b05-8b2d-7a45f5ec1533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:22.992606 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8c33d-dd28-4b05-8b2d-7a45f5ec1533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:22.994043 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8c33d-dd28-4b05-8b2d-7a45f5ec1533 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:23.002573 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1350/2706] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:22 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:23.022911 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66069c76-501d-4a14-961d-69761c59dd7c None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:23.080684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66069c76-501d-4a14-961d-69761c59dd7c None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:23.086006 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae8542-80ac-400b-8b1d-ea8c2c828570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:23.086885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae8542-80ac-400b-8b1d-ea8c2c828570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:23.087172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae8542-80ac-400b-8b1d-ea8c2c828570 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:23.087447 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae8542-80ac-400b-8b1d-ea8c2c828570 admin admin] PATH_INFO: `/v3/users/91bb187b248c448395f9386e016edba2` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:23.088655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae8542-80ac-400b-8b1d-ea8c2c828570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91bb187b248c448395f9386e016edba2)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:23.090554 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae8542-80ac-400b-8b1d-ea8c2c828570 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:23.132934 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-0eae8542-80ac-400b-8b1d-ea8c2c828570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91bb187b248c448395f9386e016edba2'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:23.139421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-0eae8542-80ac-400b-8b1d-ea8c2c828570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91bb187b248c448395f9386e016edba2'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:23.140085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-0eae8542-80ac-400b-8b1d-ea8c2c828570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91bb187b248c448395f9386e016edba2'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:23.151935 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-0eae8542-80ac-400b-8b1d-ea8c2c828570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91bb187b248c448395f9386e016edba2'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:23.152572 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-0eae8542-80ac-400b-8b1d-ea8c2c828570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91bb187b248c448395f9386e016edba2'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:23.164801 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1357/2707] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:10:23 2021] DELETE /identity/v3/users/91bb187b248c448395f9386e016edba2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:23.169323 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320575ca-dbd4-449c-bdfc-96271f0ed552 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:23.169619 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320575ca-dbd4-449c-bdfc-96271f0ed552 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:23.169900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320575ca-dbd4-449c-bdfc-96271f0ed552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:23.187741 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-320575ca-dbd4-449c-bdfc-96271f0ed552 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:23.189184 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-320575ca-dbd4-449c-bdfc-96271f0ed552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:23.249197 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1351/2708] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:23.260124 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae8542-80ac-400b-8b1d-ea8c2c828570 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:23.261546 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-0eae8542-80ac-400b-8b1d-ea8c2c828570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:23.316543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae8542-80ac-400b-8b1d-ea8c2c828570 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:23.320860 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a54d0b-9157-4a4f-9cda-a45c74eea451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:23.321500 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a54d0b-9157-4a4f-9cda-a45c74eea451 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:23.321787 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a54d0b-9157-4a4f-9cda-a45c74eea451 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:23.322065 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a54d0b-9157-4a4f-9cda-a45c74eea451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:23.330815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a54d0b-9157-4a4f-9cda-a45c74eea451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:23.332268 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a54d0b-9157-4a4f-9cda-a45c74eea451 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:23.341828 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1358/2709] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:23.594193 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320575ca-dbd4-449c-bdfc-96271f0ed552 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:23.595747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-320575ca-dbd4-449c-bdfc-96271f0ed552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:23.609145 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320575ca-dbd4-449c-bdfc-96271f0ed552 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:23.613817 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e9c11-1573-4d0b-926a-8db3cd7a7855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:23.615259 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e9c11-1573-4d0b-926a-8db3cd7a7855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:23.615682 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e9c11-1573-4d0b-926a-8db3cd7a7855 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:23.615820 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e9c11-1573-4d0b-926a-8db3cd7a7855 admin admin] PATH_INFO: `/v3/projects/0141c0730a9042c09f09c6801ee38040` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:23.617034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e9c11-1573-4d0b-926a-8db3cd7a7855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0141c0730a9042c09f09c6801ee38040)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:23.618992 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e9c11-1573-4d0b-926a-8db3cd7a7855 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:23.664931 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-350e9c11-1573-4d0b-926a-8db3cd7a7855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0141c0730a9042c09f09c6801ee38040', 'request_id': 'req-350e9c11-1573-4d0b-926a-8db3cd7a7855'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:23.670813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-350e9c11-1573-4d0b-926a-8db3cd7a7855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0141c0730a9042c09f09c6801ee38040', 'request_id': 'req-350e9c11-1573-4d0b-926a-8db3cd7a7855'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:23.678620 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-350e9c11-1573-4d0b-926a-8db3cd7a7855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0141c0730a9042c09f09c6801ee38040', 'request_id': 'req-350e9c11-1573-4d0b-926a-8db3cd7a7855'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:23.688290 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-350e9c11-1573-4d0b-926a-8db3cd7a7855 admin admin] The token cache is being invalidate because project 0141c0730a9042c09f09c6801ee38040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:10:23.688592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-350e9c11-1573-4d0b-926a-8db3cd7a7855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:23.689194 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-350e9c11-1573-4d0b-926a-8db3cd7a7855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:23.690677 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1352/2710] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:10:23 2021] DELETE /identity/v3/projects/0141c0730a9042c09f09c6801ee38040 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:23.696696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63647248-1470-4bb3-98be-7de3cd89f36d None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:23.696987 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63647248-1470-4bb3-98be-7de3cd89f36d None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:23.697265 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63647248-1470-4bb3-98be-7de3cd89f36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:23.714207 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-63647248-1470-4bb3-98be-7de3cd89f36d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:23.715446 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-63647248-1470-4bb3-98be-7de3cd89f36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:23.771880 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1359/2711] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:23.779989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769ced0-1e42-431d-9860-05bd599b3aa6 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:23.780224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769ced0-1e42-431d-9860-05bd599b3aa6 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:23.780508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769ced0-1e42-431d-9860-05bd599b3aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:23.799147 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-d769ced0-1e42-431d-9860-05bd599b3aa6 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:23.800348 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-d769ced0-1e42-431d-9860-05bd599b3aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:23.808798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1353/2712] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:23.812875 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63647248-1470-4bb3-98be-7de3cd89f36d None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:23.822496 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63647248-1470-4bb3-98be-7de3cd89f36d None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:23.827191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c677ad-abd3-4690-ac8a-e3cb85c7a1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:23.827846 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c677ad-abd3-4690-ac8a-e3cb85c7a1fa admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:23.828134 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c677ad-abd3-4690-ac8a-e3cb85c7a1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:23.828412 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c677ad-abd3-4690-ac8a-e3cb85c7a1fa admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:23.829133 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c677ad-abd3-4690-ac8a-e3cb85c7a1fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 01:10:23.829444 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c677ad-abd3-4690-ac8a-e3cb85c7a1fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:23.831072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c677ad-abd3-4690-ac8a-e3cb85c7a1fa admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:23.842175 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1360/2713] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 01:10:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 01:10:23.846224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769ced0-1e42-431d-9860-05bd599b3aa6 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:23.856037 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769ced0-1e42-431d-9860-05bd599b3aa6 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:23.860740 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045b6d2-8a0f-4f9e-8b63-fe88e00ad768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:23.861397 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045b6d2-8a0f-4f9e-8b63-fe88e00ad768 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:23.861689 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045b6d2-8a0f-4f9e-8b63-fe88e00ad768 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:23.861975 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045b6d2-8a0f-4f9e-8b63-fe88e00ad768 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:23.862678 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045b6d2-8a0f-4f9e-8b63-fe88e00ad768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:23.865218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045b6d2-8a0f-4f9e-8b63-fe88e00ad768 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:23.891345 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1354/2714] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:10:23 2021] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:10:23.895238 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c677ad-abd3-4690-ac8a-e3cb85c7a1fa admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:23.905796 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c677ad-abd3-4690-ac8a-e3cb85c7a1fa admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:23.961127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb1bef-f8f9-4bba-95d3-55ff580e2712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:23.961871 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb1bef-f8f9-4bba-95d3-55ff580e2712 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:23.962161 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb1bef-f8f9-4bba-95d3-55ff580e2712 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:23.962465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb1bef-f8f9-4bba-95d3-55ff580e2712 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:23.963203 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb1bef-f8f9-4bba-95d3-55ff580e2712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:23.965127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb1bef-f8f9-4bba-95d3-55ff580e2712 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:23.984603 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1361/2715] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:10:23 2021] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:10:23.988703 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045b6d2-8a0f-4f9e-8b63-fe88e00ad768 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:23.998678 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045b6d2-8a0f-4f9e-8b63-fe88e00ad768 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:24.003276 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d560be-29a9-4cae-98e5-042be004fe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:24.003925 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d560be-29a9-4cae-98e5-042be004fe42 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:24.004208 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d560be-29a9-4cae-98e5-042be004fe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:24.004483 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d560be-29a9-4cae-98e5-042be004fe42 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:24.005710 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d560be-29a9-4cae-98e5-042be004fe42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:24.007657 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d560be-29a9-4cae-98e5-042be004fe42 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:24.018606 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1355/2716] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:24.023027 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb1bef-f8f9-4bba-95d3-55ff580e2712 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:24.032684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb1bef-f8f9-4bba-95d3-55ff580e2712 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:24.037422 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fb434-a22f-475e-9927-11fe5ce1ee0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:24.038076 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fb434-a22f-475e-9927-11fe5ce1ee0c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:24.038369 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fb434-a22f-475e-9927-11fe5ce1ee0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:24.038652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fb434-a22f-475e-9927-11fe5ce1ee0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:24.039417 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fb434-a22f-475e-9927-11fe5ce1ee0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:24.041012 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fb434-a22f-475e-9927-11fe5ce1ee0c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:24.050632 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1362/2717] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:24 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:24.054997 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d560be-29a9-4cae-98e5-042be004fe42 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:24.064557 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d560be-29a9-4cae-98e5-042be004fe42 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:24.069968 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46e214-0ca4-4ec4-9511-a7241295be99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:24.070860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46e214-0ca4-4ec4-9511-a7241295be99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:24.071144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46e214-0ca4-4ec4-9511-a7241295be99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:24.071678 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46e214-0ca4-4ec4-9511-a7241295be99 admin admin] PATH_INFO: `/v3/projects/dee87670c27545d18c5c51e07ae97b6f/users/11568fdcb43945fc864cbf2a5a4ab239/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:24.085642 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46e214-0ca4-4ec4-9511-a7241295be99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee87670c27545d18c5c51e07ae97b6f, user_id=11568fdcb43945fc864cbf2a5a4ab239, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:24.088303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46e214-0ca4-4ec4-9511-a7241295be99 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:24.100600 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1356/2718] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:10:24 2021] PUT /identity/v3/projects/dee87670c27545d18c5c51e07ae97b6f/users/11568fdcb43945fc864cbf2a5a4ab239/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:24.111059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b4289-e409-4d36-b45f-0af0982575e7 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:24.111380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b4289-e409-4d36-b45f-0af0982575e7 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:24.111661 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b4289-e409-4d36-b45f-0af0982575e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:24.139849 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-de8b4289-e409-4d36-b45f-0af0982575e7 None None] MFA Rules not processed for user `11568fdcb43945fc864cbf2a5a4ab239`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:24.141104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-de8b4289-e409-4d36-b45f-0af0982575e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:24.204713 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1363/2719] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:24 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:24.215686 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46e214-0ca4-4ec4-9511-a7241295be99 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:24.217598 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8c46e214-0ca4-4ec4-9511-a7241295be99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:24.274536 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46e214-0ca4-4ec4-9511-a7241295be99 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:24.278688 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b16881-97e2-4ab0-b4ee-2396168ccfb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:24.279422 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b16881-97e2-4ab0-b4ee-2396168ccfb1 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:24.279707 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b16881-97e2-4ab0-b4ee-2396168ccfb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:24.279986 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b16881-97e2-4ab0-b4ee-2396168ccfb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:24.288388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b16881-97e2-4ab0-b4ee-2396168ccfb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:24.289798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b16881-97e2-4ab0-b4ee-2396168ccfb1 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:24.298440 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1357/2720] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:24 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:27.256256 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b4289-e409-4d36-b45f-0af0982575e7 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:27.316132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b4289-e409-4d36-b45f-0af0982575e7 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:27.320889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b039f91-a1e0-4d47-8831-1884dca25ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:27.321741 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b039f91-a1e0-4d47-8831-1884dca25ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:27.322021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b039f91-a1e0-4d47-8831-1884dca25ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:27.322290 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b039f91-a1e0-4d47-8831-1884dca25ffb admin admin] PATH_INFO: `/v3/users/11568fdcb43945fc864cbf2a5a4ab239` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:27.323487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b039f91-a1e0-4d47-8831-1884dca25ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=11568fdcb43945fc864cbf2a5a4ab239)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:27.325379 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b039f91-a1e0-4d47-8831-1884dca25ffb admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:27.369764 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8b039f91-a1e0-4d47-8831-1884dca25ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11568fdcb43945fc864cbf2a5a4ab239'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:27.376426 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8b039f91-a1e0-4d47-8831-1884dca25ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11568fdcb43945fc864cbf2a5a4ab239'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:27.377118 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8b039f91-a1e0-4d47-8831-1884dca25ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11568fdcb43945fc864cbf2a5a4ab239'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:27.389461 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8b039f91-a1e0-4d47-8831-1884dca25ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11568fdcb43945fc864cbf2a5a4ab239'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:27.390096 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-8b039f91-a1e0-4d47-8831-1884dca25ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11568fdcb43945fc864cbf2a5a4ab239'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:27.403132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1364/2721] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:10:27 2021] DELETE /identity/v3/users/11568fdcb43945fc864cbf2a5a4ab239 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:27.407684 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707954ba-80f4-4ccb-9e69-031341ceda21 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:27.408145 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707954ba-80f4-4ccb-9e69-031341ceda21 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:27.408301 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707954ba-80f4-4ccb-9e69-031341ceda21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:27.425236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-707954ba-80f4-4ccb-9e69-031341ceda21 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:27.426456 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-707954ba-80f4-4ccb-9e69-031341ceda21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:27.485532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1358/2722] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:27.495880 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b039f91-a1e0-4d47-8831-1884dca25ffb admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:27.497205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-8b039f91-a1e0-4d47-8831-1884dca25ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:27.552588 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b039f91-a1e0-4d47-8831-1884dca25ffb admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:27.556442 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55da424-1cfa-4292-b65e-aed72c14f2cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:27.557091 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55da424-1cfa-4292-b65e-aed72c14f2cc service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:27.557377 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55da424-1cfa-4292-b65e-aed72c14f2cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:27.557655 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55da424-1cfa-4292-b65e-aed72c14f2cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:27.566856 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55da424-1cfa-4292-b65e-aed72c14f2cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:27.569005 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55da424-1cfa-4292-b65e-aed72c14f2cc service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:27.578956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1365/2723] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:27.831469 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707954ba-80f4-4ccb-9e69-031341ceda21 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:27.832952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-707954ba-80f4-4ccb-9e69-031341ceda21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:27.846613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707954ba-80f4-4ccb-9e69-031341ceda21 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:27.852419 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9baca3-5344-498f-a772-ef086b0a5ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:27.853369 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9baca3-5344-498f-a772-ef086b0a5ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:27.853556 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9baca3-5344-498f-a772-ef086b0a5ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:27.853833 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9baca3-5344-498f-a772-ef086b0a5ed4 admin admin] PATH_INFO: `/v3/projects/dee87670c27545d18c5c51e07ae97b6f` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:27.855300 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9baca3-5344-498f-a772-ef086b0a5ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee87670c27545d18c5c51e07ae97b6f)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:27.857218 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9baca3-5344-498f-a772-ef086b0a5ed4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:27.903459 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ca9baca3-5344-498f-a772-ef086b0a5ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee87670c27545d18c5c51e07ae97b6f', 'request_id': 'req-ca9baca3-5344-498f-a772-ef086b0a5ed4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:27.909292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ca9baca3-5344-498f-a772-ef086b0a5ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee87670c27545d18c5c51e07ae97b6f', 'request_id': 'req-ca9baca3-5344-498f-a772-ef086b0a5ed4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:27.916428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ca9baca3-5344-498f-a772-ef086b0a5ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee87670c27545d18c5c51e07ae97b6f', 'request_id': 'req-ca9baca3-5344-498f-a772-ef086b0a5ed4'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:27.926498 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ca9baca3-5344-498f-a772-ef086b0a5ed4 admin admin] The token cache is being invalidate because project dee87670c27545d18c5c51e07ae97b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:10:27.926817 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ca9baca3-5344-498f-a772-ef086b0a5ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:27.928012 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-ca9baca3-5344-498f-a772-ef086b0a5ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:10:27.929530 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1359/2724] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:10:27 2021] DELETE /identity/v3/projects/dee87670c27545d18c5c51e07ae97b6f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 01:10:27.935189 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae4f00-622b-44ba-bc12-ff3ff352ec51 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:27.935482 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae4f00-622b-44ba-bc12-ff3ff352ec51 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:27.935763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae4f00-622b-44ba-bc12-ff3ff352ec51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:27.953607 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-3dae4f00-622b-44ba-bc12-ff3ff352ec51 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:27.954815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-3dae4f00-622b-44ba-bc12-ff3ff352ec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:28.011421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1366/2725] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:28.019094 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f946c-58f1-4e30-ab9e-b60418a671a8 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:28.019389 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f946c-58f1-4e30-ab9e-b60418a671a8 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:28.019673 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f946c-58f1-4e30-ab9e-b60418a671a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:28.038068 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-c91f946c-58f1-4e30-ab9e-b60418a671a8 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:28.039313 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-c91f946c-58f1-4e30-ab9e-b60418a671a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:28.047211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1360/2726] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:28.051191 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae4f00-622b-44ba-bc12-ff3ff352ec51 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:28.061353 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae4f00-622b-44ba-bc12-ff3ff352ec51 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:28.065894 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c4da2-08fb-4ae7-8400-82dafb965407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:28.066540 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c4da2-08fb-4ae7-8400-82dafb965407 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:28.066822 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c4da2-08fb-4ae7-8400-82dafb965407 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:28.067131 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c4da2-08fb-4ae7-8400-82dafb965407 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:28.067841 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c4da2-08fb-4ae7-8400-82dafb965407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 01:10:28.068178 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c4da2-08fb-4ae7-8400-82dafb965407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:28.070829 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c4da2-08fb-4ae7-8400-82dafb965407 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:28.081736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1367/2727] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 01:10:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 01:10:28.085984 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f946c-58f1-4e30-ab9e-b60418a671a8 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:28.094922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f946c-58f1-4e30-ab9e-b60418a671a8 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:28.099591 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c172e1-0310-4055-bbc8-474d076764f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:28.100857 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c172e1-0310-4055-bbc8-474d076764f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:28.101145 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c172e1-0310-4055-bbc8-474d076764f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:28.101425 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c172e1-0310-4055-bbc8-474d076764f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:28.102116 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c172e1-0310-4055-bbc8-474d076764f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:28.104045 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c172e1-0310-4055-bbc8-474d076764f3 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:28.128806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1361/2728] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:10:28 2021] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:10:28.133268 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c4da2-08fb-4ae7-8400-82dafb965407 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:28.142744 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c4da2-08fb-4ae7-8400-82dafb965407 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:28.199361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a43cbb-ad44-4a93-abfa-4428b4c4cc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:28.200031 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a43cbb-ad44-4a93-abfa-4428b4c4cc5a admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:28.200346 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a43cbb-ad44-4a93-abfa-4428b4c4cc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:28.200649 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a43cbb-ad44-4a93-abfa-4428b4c4cc5a admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:28.201347 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a43cbb-ad44-4a93-abfa-4428b4c4cc5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:28.203283 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a43cbb-ad44-4a93-abfa-4428b4c4cc5a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:28.223063 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1368/2729] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:10:28 2021] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:10:28.227732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c172e1-0310-4055-bbc8-474d076764f3 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:28.237858 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c172e1-0310-4055-bbc8-474d076764f3 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:28.243567 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a891c-655e-41db-822a-c31ac3da9507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:28.244219 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a891c-655e-41db-822a-c31ac3da9507 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:28.244502 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a891c-655e-41db-822a-c31ac3da9507 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:28.244779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a891c-655e-41db-822a-c31ac3da9507 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:28.245496 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a891c-655e-41db-822a-c31ac3da9507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:28.247097 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a891c-655e-41db-822a-c31ac3da9507 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:28.257619 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1362/2730] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:28.261632 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a43cbb-ad44-4a93-abfa-4428b4c4cc5a admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:28.271478 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a43cbb-ad44-4a93-abfa-4428b4c4cc5a admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:28.276422 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ad1c6-e01b-49f5-bae8-fdaa218c7f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:28.277078 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ad1c6-e01b-49f5-bae8-fdaa218c7f43 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:28.277361 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ad1c6-e01b-49f5-bae8-fdaa218c7f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:28.277647 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ad1c6-e01b-49f5-bae8-fdaa218c7f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:28.278364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ad1c6-e01b-49f5-bae8-fdaa218c7f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:28.280105 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ad1c6-e01b-49f5-bae8-fdaa218c7f43 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:28.290569 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1369/2731] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:10:28 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:10:28.294655 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a891c-655e-41db-822a-c31ac3da9507 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:28.305402 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a891c-655e-41db-822a-c31ac3da9507 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:28.310122 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944c6dc-478d-4ed9-9bd9-35bf7c99a194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:28.311029 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944c6dc-478d-4ed9-9bd9-35bf7c99a194 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:28.311320 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944c6dc-478d-4ed9-9bd9-35bf7c99a194 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:28.311605 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944c6dc-478d-4ed9-9bd9-35bf7c99a194 admin admin] PATH_INFO: `/v3/projects/a3f74558d866432eb6bab59968c6f176/users/09b19781198e4a5084cb10dfceac70b9/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:28.326713 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944c6dc-478d-4ed9-9bd9-35bf7c99a194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f74558d866432eb6bab59968c6f176, user_id=09b19781198e4a5084cb10dfceac70b9, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:28.329402 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944c6dc-478d-4ed9-9bd9-35bf7c99a194 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:28.342196 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1363/2732] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:10:28 2021] PUT /identity/v3/projects/a3f74558d866432eb6bab59968c6f176/users/09b19781198e4a5084cb10dfceac70b9/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:10:28.347304 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948e573-f74d-42d9-a9cf-35b098c928a7 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:28.347590 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948e573-f74d-42d9-a9cf-35b098c928a7 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:28.347895 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948e573-f74d-42d9-a9cf-35b098c928a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:28.366661 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-7948e573-f74d-42d9-a9cf-35b098c928a7 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:28.367884 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-7948e573-f74d-42d9-a9cf-35b098c928a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:28.423525 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1370/2733] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:28.434212 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944c6dc-478d-4ed9-9bd9-35bf7c99a194 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:28.435930 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2944c6dc-478d-4ed9-9bd9-35bf7c99a194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:28.502952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944c6dc-478d-4ed9-9bd9-35bf7c99a194 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:28.515985 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd0a7b-ac6a-4d86-bcdc-459400d7d1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:28.516589 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd0a7b-ac6a-4d86-bcdc-459400d7d1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:28.516863 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd0a7b-ac6a-4d86-bcdc-459400d7d1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:28.517143 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd0a7b-ac6a-4d86-bcdc-459400d7d1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:28.527244 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd0a7b-ac6a-4d86-bcdc-459400d7d1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:28.528702 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd0a7b-ac6a-4d86-bcdc-459400d7d1a8 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:28.539013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1364/2734] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:29.140817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a83df6-b2fb-4105-8a1a-d72366519128 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:29.141106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a83df6-b2fb-4105-8a1a-d72366519128 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:29.141384 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a83df6-b2fb-4105-8a1a-d72366519128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:29.176555 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-76a83df6-b2fb-4105-8a1a-d72366519128 None None] MFA Rules not processed for user `09b19781198e4a5084cb10dfceac70b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:29.177784 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-76a83df6-b2fb-4105-8a1a-d72366519128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:29.247951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1371/2735] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:29 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:29.259327 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd0a7b-ac6a-4d86-bcdc-459400d7d1a8 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:29.260825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-bddd0a7b-ac6a-4d86-bcdc-459400d7d1a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:29.316760 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd0a7b-ac6a-4d86-bcdc-459400d7d1a8 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:29.321506 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564574fc-c083-47a2-9f6e-f72e1000cc99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:29.322148 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564574fc-c083-47a2-9f6e-f72e1000cc99 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:29.322432 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564574fc-c083-47a2-9f6e-f72e1000cc99 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:29.322706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564574fc-c083-47a2-9f6e-f72e1000cc99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:29.331092 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564574fc-c083-47a2-9f6e-f72e1000cc99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:29.332468 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564574fc-c083-47a2-9f6e-f72e1000cc99 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:29.341911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1365/2736] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:29 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:30.691202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf4f1d-6fde-49d6-9282-5f6a711065c5 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:30.691686 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf4f1d-6fde-49d6-9282-5f6a711065c5 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:30.691821 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf4f1d-6fde-49d6-9282-5f6a711065c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:30.709106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-55cf4f1d-6fde-49d6-9282-5f6a711065c5 None None] MFA Rules not processed for user `09b19781198e4a5084cb10dfceac70b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:30.710415 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-55cf4f1d-6fde-49d6-9282-5f6a711065c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:30.717258 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1372/2737] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:30 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:30.952223 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564574fc-c083-47a2-9f6e-f72e1000cc99 service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:30.962209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564574fc-c083-47a2-9f6e-f72e1000cc99 service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:30.965798 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024b123-3742-408d-9383-aa2c02df90d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:30.966434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024b123-3742-408d-9383-aa2c02df90d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:30.966723 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024b123-3742-408d-9383-aa2c02df90d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:30.967087 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024b123-3742-408d-9383-aa2c02df90d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:30.968873 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7024b123-3742-408d-9383-aa2c02df90d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:30.979427 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024b123-3742-408d-9383-aa2c02df90d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:30.980860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024b123-3742-408d-9383-aa2c02df90d9 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:30.988715 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1366/2738] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:30 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:31.290274 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf4f1d-6fde-49d6-9282-5f6a711065c5 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:31.291919 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-55cf4f1d-6fde-49d6-9282-5f6a711065c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:31.359370 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf4f1d-6fde-49d6-9282-5f6a711065c5 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:31.364451 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc18c8-a30d-4575-a79d-a48efe4f4e53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:31.365110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc18c8-a30d-4575-a79d-a48efe4f4e53 service placement] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:31.365436 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc18c8-a30d-4575-a79d-a48efe4f4e53 service placement] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:31.365718 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc18c8-a30d-4575-a79d-a48efe4f4e53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:31.367489 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c3dc18c8-a30d-4575-a79d-a48efe4f4e53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:31.378535 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc18c8-a30d-4575-a79d-a48efe4f4e53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:31.380160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc18c8-a30d-4575-a79d-a48efe4f4e53 service placement] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:31.390417 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1373/2739] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:31 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:39.480013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024b123-3742-408d-9383-aa2c02df90d9 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:39.481470 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7024b123-3742-408d-9383-aa2c02df90d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:39.585123 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024b123-3742-408d-9383-aa2c02df90d9 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:39.590661 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902a08a-ee48-40f7-b390-0b1b03c1d856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442cc0e13dcb49f0a4a870c06e0edf1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:39.591339 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902a08a-ee48-40f7-b390-0b1b03c1d856 service nova] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:39.591630 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902a08a-ee48-40f7-b390-0b1b03c1d856 service nova] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:39.591913 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902a08a-ee48-40f7-b390-0b1b03c1d856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:39.593658 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-3902a08a-ee48-40f7-b390-0b1b03c1d856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:39.605964 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902a08a-ee48-40f7-b390-0b1b03c1d856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:39.607581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902a08a-ee48-40f7-b390-0b1b03c1d856 service nova] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:39.617969 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1367/2740] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:10:45.710420 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84748bb2-f3e3-42a0-89d0-6183415cd34c None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:45.710955 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84748bb2-f3e3-42a0-89d0-6183415cd34c None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:45.711086 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84748bb2-f3e3-42a0-89d0-6183415cd34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:45.728324 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-84748bb2-f3e3-42a0-89d0-6183415cd34c None None] MFA Rules not processed for user `09b19781198e4a5084cb10dfceac70b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:10:45.729696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-84748bb2-f3e3-42a0-89d0-6183415cd34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:45.736392 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1374/2741] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:10:45 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:10:45.962773 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902a08a-ee48-40f7-b390-0b1b03c1d856 service nova] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:10:45.972286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902a08a-ee48-40f7-b390-0b1b03c1d856 service nova] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:10:45.976193 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e4f99-ede9-4b4a-ae4c-e8d5ec16a337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:10:45.976831 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4f99-ede9-4b4a-ae4c-e8d5ec16a337 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:10:45.977138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4f99-ede9-4b4a-ae4c-e8d5ec16a337 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:10:45.977414 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4f99-ede9-4b4a-ae4c-e8d5ec16a337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:10:45.979543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-354e4f99-ede9-4b4a-ae4c-e8d5ec16a337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:10:45.988766 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e4f99-ede9-4b4a-ae4c-e8d5ec16a337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:10:45.990806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e4f99-ede9-4b4a-ae4c-e8d5ec16a337 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:10:45.998927 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1368/2742] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:10:45 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:11:09.022793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d7e9f-f92f-4fad-8672-c9cc6b080ea0 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:11:09.023290 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d7e9f-f92f-4fad-8672-c9cc6b080ea0 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:11:09.023397 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d7e9f-f92f-4fad-8672-c9cc6b080ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:11:09.081264 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-c26d7e9f-f92f-4fad-8672-c9cc6b080ea0 None None] MFA Rules not processed for user `f6af4c462c6347ff8abbcc8770874b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:11:09.082454 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-c26d7e9f-f92f-4fad-8672-c9cc6b080ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:11:09.145190 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1375/2743] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Nov 16 01:11:09 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:11:09.194202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e4f99-ede9-4b4a-ae4c-e8d5ec16a337 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:11:09.195713 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-354e4f99-ede9-4b4a-ae4c-e8d5ec16a337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:11:09.283656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e4f99-ede9-4b4a-ae4c-e8d5ec16a337 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:11:09.289083 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf272c08-7fbc-4ab1-82db-429c3cee063e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac32c6730654a889472a3bad95374bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:11:09.289735 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272c08-7fbc-4ab1-82db-429c3cee063e service swift] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:11:09.290025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272c08-7fbc-4ab1-82db-429c3cee063e service swift] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:11:09.291484 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272c08-7fbc-4ab1-82db-429c3cee063e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:11:09.306776 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf272c08-7fbc-4ab1-82db-429c3cee063e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:11:09.309031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf272c08-7fbc-4ab1-82db-429c3cee063e service swift] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:11:09.318402 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1369/2744] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Nov 16 01:11:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 01:11:24.213770 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7c0b7-0a0b-488e-8dad-78ed3e897637 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:11:24.214249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7c0b7-0a0b-488e-8dad-78ed3e897637 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:11:24.214344 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7c0b7-0a0b-488e-8dad-78ed3e897637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:11:24.232666 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-abf7c0b7-0a0b-488e-8dad-78ed3e897637 None None] MFA Rules not processed for user `f6af4c462c6347ff8abbcc8770874b44`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:11:24.233847 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-abf7c0b7-0a0b-488e-8dad-78ed3e897637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:11:24.241142 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1376/2745] 10.222.0.50 () {58 vars in 967 bytes} [Tue Nov 16 01:11:24 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:11:24.253444 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf272c08-7fbc-4ab1-82db-429c3cee063e service swift] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:11:24.263819 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf272c08-7fbc-4ab1-82db-429c3cee063e service swift] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:11:24.268851 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d7e29-ab5e-4349-b08f-0f21fba12cab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac32c6730654a889472a3bad95374bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:11:24.269479 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7e29-ab5e-4349-b08f-0f21fba12cab service swift] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:11:24.270258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7e29-ab5e-4349-b08f-0f21fba12cab service swift] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:11:24.270569 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7e29-ab5e-4349-b08f-0f21fba12cab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:11:24.278403 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d7e29-ab5e-4349-b08f-0f21fba12cab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:11:24.280004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d7e29-ab5e-4349-b08f-0f21fba12cab service swift] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:11:24.288754 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1370/2746] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Nov 16 01:11:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 01:11:26.113400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7c0b7-0a0b-488e-8dad-78ed3e897637 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:11:26.127251 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7c0b7-0a0b-488e-8dad-78ed3e897637 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:11:26.134047 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867114ae-e88a-4b5c-b84b-1720c8057eb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:11:26.134742 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867114ae-e88a-4b5c-b84b-1720c8057eb9 service placement] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:11:26.135054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867114ae-e88a-4b5c-b84b-1720c8057eb9 service placement] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:11:26.135334 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867114ae-e88a-4b5c-b84b-1720c8057eb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:11:26.137198 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-867114ae-e88a-4b5c-b84b-1720c8057eb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:11:26.153478 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d7e29-ab5e-4349-b08f-0f21fba12cab service swift] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:11:26.165620 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d7e29-ab5e-4349-b08f-0f21fba12cab service swift] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:11:26.166868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867114ae-e88a-4b5c-b84b-1720c8057eb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:11:26.168471 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867114ae-e88a-4b5c-b84b-1720c8057eb9 service placement] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:11:26.170543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1c91a-fc9f-4655-8950-304c5762f097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:11:26.171456 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c91a-fc9f-4655-8950-304c5762f097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:11:26.171742 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c91a-fc9f-4655-8950-304c5762f097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:11:26.172020 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c91a-fc9f-4655-8950-304c5762f097 admin admin] PATH_INFO: `/v3/users/09b19781198e4a5084cb10dfceac70b9` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:11:26.173258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1c91a-fc9f-4655-8950-304c5762f097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b19781198e4a5084cb10dfceac70b9)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:11:26.175224 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1c91a-fc9f-4655-8950-304c5762f097 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:11:26.179130 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1377/2747] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:11:26 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:11:26.223434 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bec1c91a-fc9f-4655-8950-304c5762f097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b19781198e4a5084cb10dfceac70b9'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:11:26.234674 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bec1c91a-fc9f-4655-8950-304c5762f097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b19781198e4a5084cb10dfceac70b9'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:11:26.242919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bec1c91a-fc9f-4655-8950-304c5762f097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b19781198e4a5084cb10dfceac70b9'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:11:26.255233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bec1c91a-fc9f-4655-8950-304c5762f097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b19781198e4a5084cb10dfceac70b9'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:11:26.256543 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-bec1c91a-fc9f-4655-8950-304c5762f097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b19781198e4a5084cb10dfceac70b9'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:11:26.262937 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1371/2748] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:11:26 2021] DELETE /identity/v3/users/09b19781198e4a5084cb10dfceac70b9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:11:26.433127 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867114ae-e88a-4b5c-b84b-1720c8057eb9 service placement] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:11:26.445452 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867114ae-e88a-4b5c-b84b-1720c8057eb9 service placement] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:11:26.500701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:11:26.501557 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:11:26.501840 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:11:26.502114 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] PATH_INFO: `/v3/projects/a3f74558d866432eb6bab59968c6f176` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:11:26.503316 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f74558d866432eb6bab59968c6f176)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:11:26.505205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:11:26.549888 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f74558d866432eb6bab59968c6f176', 'request_id': 'req-6a9323ff-557f-4e73-9baa-6d0e01c328d9'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:11:26.555967 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f74558d866432eb6bab59968c6f176', 'request_id': 'req-6a9323ff-557f-4e73-9baa-6d0e01c328d9'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:11:26.561701 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f74558d866432eb6bab59968c6f176', 'request_id': 'req-6a9323ff-557f-4e73-9baa-6d0e01c328d9'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:11:26.574308 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] The token cache is being invalidate because project a3f74558d866432eb6bab59968c6f176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:11:26.574592 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:11:26.575223 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:11:26.576725 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1378/2749] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:11:26 2021] DELETE /identity/v3/projects/a3f74558d866432eb6bab59968c6f176 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 01:12:13.870554 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1c91a-fc9f-4655-8950-304c5762f097 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:13.872131 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-bec1c91a-fc9f-4655-8950-304c5762f097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:13.938998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1c91a-fc9f-4655-8950-304c5762f097 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:13.985921 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea570f-a85e-44b8-b82a-f53578610abc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:13.986567 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea570f-a85e-44b8-b82a-f53578610abc service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:13.986873 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea570f-a85e-44b8-b82a-f53578610abc service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:13.987161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea570f-a85e-44b8-b82a-f53578610abc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:13.988889 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6fea570f-a85e-44b8-b82a-f53578610abc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:14.046024 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea570f-a85e-44b8-b82a-f53578610abc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:14.047513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea570f-a85e-44b8-b82a-f53578610abc service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:14.070276 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1372/2750] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:12:13 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:12:32.052803 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:32.054230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:32.108795 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9323ff-557f-4e73-9baa-6d0e01c328d9 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:32.112337 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65fb10-9564-4aa5-84a2-4a2004e933ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:32.112974 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65fb10-9564-4aa5-84a2-4a2004e933ca service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:32.113253 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65fb10-9564-4aa5-84a2-4a2004e933ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:32.113531 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65fb10-9564-4aa5-84a2-4a2004e933ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:32.115248 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-2c65fb10-9564-4aa5-84a2-4a2004e933ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:32.174254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65fb10-9564-4aa5-84a2-4a2004e933ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:32.175702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65fb10-9564-4aa5-84a2-4a2004e933ca service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:32.185711 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1379/2751] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:12:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:12:35.265909 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea570f-a85e-44b8-b82a-f53578610abc service cinder] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:35.267388 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-6fea570f-a85e-44b8-b82a-f53578610abc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:35.282233 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea570f-a85e-44b8-b82a-f53578610abc service cinder] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:35.286754 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3eb11-deb9-4f9e-9aa0-1eaef06b58cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:35.287646 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3eb11-deb9-4f9e-9aa0-1eaef06b58cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:35.287934 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3eb11-deb9-4f9e-9aa0-1eaef06b58cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:35.288288 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3eb11-deb9-4f9e-9aa0-1eaef06b58cb admin admin] PATH_INFO: `/v3/users/a5d8ae82c9644a629b96d5edfa11682f` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:35.289511 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3eb11-deb9-4f9e-9aa0-1eaef06b58cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d8ae82c9644a629b96d5edfa11682f)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:35.291484 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3eb11-deb9-4f9e-9aa0-1eaef06b58cb admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:35.336199 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2ca3eb11-deb9-4f9e-9aa0-1eaef06b58cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d8ae82c9644a629b96d5edfa11682f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:35.342761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2ca3eb11-deb9-4f9e-9aa0-1eaef06b58cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d8ae82c9644a629b96d5edfa11682f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:35.349935 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2ca3eb11-deb9-4f9e-9aa0-1eaef06b58cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d8ae82c9644a629b96d5edfa11682f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:35.362413 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2ca3eb11-deb9-4f9e-9aa0-1eaef06b58cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d8ae82c9644a629b96d5edfa11682f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:35.363083 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2ca3eb11-deb9-4f9e-9aa0-1eaef06b58cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d8ae82c9644a629b96d5edfa11682f'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:35.369558 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1373/2752] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:12:35 2021] DELETE /identity/v3/users/a5d8ae82c9644a629b96d5edfa11682f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:35.535174 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65fb10-9564-4aa5-84a2-4a2004e933ca service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:35.545508 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65fb10-9564-4aa5-84a2-4a2004e933ca service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:35.599775 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:35.601214 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:35.601687 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:35.601790 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813 admin admin] PATH_INFO: `/v3/projects/b3e21d8c24af4cef9a4289395a5af8e2` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:35.602993 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e21d8c24af4cef9a4289395a5af8e2)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:35.605159 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:35.657134 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e21d8c24af4cef9a4289395a5af8e2', 'request_id': 'req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:35.672186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e21d8c24af4cef9a4289395a5af8e2', 'request_id': 'req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:35.678415 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e21d8c24af4cef9a4289395a5af8e2', 'request_id': 'req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:35.691422 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813 admin admin] The token cache is being invalidate because project b3e21d8c24af4cef9a4289395a5af8e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:12:35.691711 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:35.692350 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-cb93b61c-bdf9-4e00-ac0b-ec3fc220d813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:35.693888 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1380/2753] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:12:35 2021] DELETE /identity/v3/projects/b3e21d8c24af4cef9a4289395a5af8e2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:35.701163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc516c8-440e-4157-a6b0-43e51db23aec None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:35.701454 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc516c8-440e-4157-a6b0-43e51db23aec None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:35.701736 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc516c8-440e-4157-a6b0-43e51db23aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:35.720641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-0cc516c8-440e-4157-a6b0-43e51db23aec None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:35.721938 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0cc516c8-440e-4157-a6b0-43e51db23aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:35.779050 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1374/2754] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 01:12:35.787135 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7b9a-b7e5-4b62-8d4e-50a6d52bb51f None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:35.787434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7b9a-b7e5-4b62-8d4e-50a6d52bb51f None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:35.787720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c7b9a-b7e5-4b62-8d4e-50a6d52bb51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:35.807165 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-df3c7b9a-b7e5-4b62-8d4e-50a6d52bb51f None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:35.808360 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-df3c7b9a-b7e5-4b62-8d4e-50a6d52bb51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:35.816293 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1381/2755] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:35.820482 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc516c8-440e-4157-a6b0-43e51db23aec None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:35.830072 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc516c8-440e-4157-a6b0-43e51db23aec None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:35.834860 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01430f-c0d4-4eb5-a6f5-e84d4967942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:35.835705 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01430f-c0d4-4eb5-a6f5-e84d4967942c admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:35.835998 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01430f-c0d4-4eb5-a6f5-e84d4967942c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:35.836281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01430f-c0d4-4eb5-a6f5-e84d4967942c admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:35.837004 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01430f-c0d4-4eb5-a6f5-e84d4967942c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 01:12:35.837320 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01430f-c0d4-4eb5-a6f5-e84d4967942c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:35.838965 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01430f-c0d4-4eb5-a6f5-e84d4967942c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:35.850200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1375/2756] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 01:12:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 01:12:35.854820 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c7b9a-b7e5-4b62-8d4e-50a6d52bb51f None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:35.863704 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c7b9a-b7e5-4b62-8d4e-50a6d52bb51f None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:35.869025 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac13eb4-d3f5-49cc-9124-f0be8f2cc52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:35.869662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac13eb4-d3f5-49cc-9124-f0be8f2cc52e admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:35.869948 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac13eb4-d3f5-49cc-9124-f0be8f2cc52e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:35.870226 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac13eb4-d3f5-49cc-9124-f0be8f2cc52e admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:35.870951 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac13eb4-d3f5-49cc-9124-f0be8f2cc52e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:35.872842 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac13eb4-d3f5-49cc-9124-f0be8f2cc52e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:35.899215 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1382/2757] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:12:35 2021] POST /identity/v3/projects => generated 403 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:12:35.903937 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01430f-c0d4-4eb5-a6f5-e84d4967942c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:35.914762 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01430f-c0d4-4eb5-a6f5-e84d4967942c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:35.969455 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26d0e3-742d-4ba0-b2be-ba46fe426833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:35.970124 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26d0e3-742d-4ba0-b2be-ba46fe426833 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:35.970410 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26d0e3-742d-4ba0-b2be-ba46fe426833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:35.970686 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26d0e3-742d-4ba0-b2be-ba46fe426833 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:35.971412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26d0e3-742d-4ba0-b2be-ba46fe426833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:35.973323 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26d0e3-742d-4ba0-b2be-ba46fe426833 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:35.998075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1376/2758] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:12:35 2021] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:12:35.999901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac13eb4-d3f5-49cc-9124-f0be8f2cc52e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:36.011275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac13eb4-d3f5-49cc-9124-f0be8f2cc52e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:36.016240 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a463aa4-f027-4fe5-a3b7-e280697bb2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:36.016937 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a463aa4-f027-4fe5-a3b7-e280697bb2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:36.017249 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a463aa4-f027-4fe5-a3b7-e280697bb2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:36.017552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a463aa4-f027-4fe5-a3b7-e280697bb2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:36.018305 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a463aa4-f027-4fe5-a3b7-e280697bb2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:36.019958 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a463aa4-f027-4fe5-a3b7-e280697bb2f0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:36.030983 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1383/2759] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:12:35 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:12:36.034764 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26d0e3-742d-4ba0-b2be-ba46fe426833 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:36.045505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26d0e3-742d-4ba0-b2be-ba46fe426833 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:36.050075 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29875b54-28f4-4b1a-8cfe-5f191d8b2511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:36.050719 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29875b54-28f4-4b1a-8cfe-5f191d8b2511 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:36.051040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29875b54-28f4-4b1a-8cfe-5f191d8b2511 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:36.051318 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29875b54-28f4-4b1a-8cfe-5f191d8b2511 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:36.052034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29875b54-28f4-4b1a-8cfe-5f191d8b2511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:36.053619 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29875b54-28f4-4b1a-8cfe-5f191d8b2511 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:36.063694 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1377/2760] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:12:36 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:12:36.067697 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a463aa4-f027-4fe5-a3b7-e280697bb2f0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:36.077873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a463aa4-f027-4fe5-a3b7-e280697bb2f0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:36.082521 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a7a9-bbed-4dd7-9a17-d76bb9d80291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:36.083421 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a7a9-bbed-4dd7-9a17-d76bb9d80291 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:36.083707 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a7a9-bbed-4dd7-9a17-d76bb9d80291 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:36.083988 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a7a9-bbed-4dd7-9a17-d76bb9d80291 admin admin] PATH_INFO: `/v3/projects/cc13239cd3c54957bca1e995e51b41a6/users/44fd166704634133b3dc350c01f6b32c/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:36.098393 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788a7a9-bbed-4dd7-9a17-d76bb9d80291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc13239cd3c54957bca1e995e51b41a6, user_id=44fd166704634133b3dc350c01f6b32c, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:36.101741 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788a7a9-bbed-4dd7-9a17-d76bb9d80291 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:36.114494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1384/2761] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:12:36 2021] PUT /identity/v3/projects/cc13239cd3c54957bca1e995e51b41a6/users/44fd166704634133b3dc350c01f6b32c/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 01:12:36.124815 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6302e7-7b77-474b-ba36-fb9b490d7539 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:36.125107 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6302e7-7b77-474b-ba36-fb9b490d7539 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:36.125404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6302e7-7b77-474b-ba36-fb9b490d7539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:36.151290 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-cf6302e7-7b77-474b-ba36-fb9b490d7539 None None] MFA Rules not processed for user `44fd166704634133b3dc350c01f6b32c`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:36.152505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-cf6302e7-7b77-474b-ba36-fb9b490d7539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:36.216051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1378/2762] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:36 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:36.221053 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a7a9-bbed-4dd7-9a17-d76bb9d80291 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:36.280129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a7a9-bbed-4dd7-9a17-d76bb9d80291 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:36.284898 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca59cc-291d-41b8-b525-f69a36416d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:36.285499 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca59cc-291d-41b8-b525-f69a36416d4b admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:36.285782 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca59cc-291d-41b8-b525-f69a36416d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:36.286062 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca59cc-291d-41b8-b525-f69a36416d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:36.286757 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca59cc-291d-41b8-b525-f69a36416d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:36.289411 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca59cc-291d-41b8-b525-f69a36416d4b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:36.313483 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1385/2763] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:12:36 2021] POST /identity/v3/projects => generated 403 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 01:12:36.317398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6302e7-7b77-474b-ba36-fb9b490d7539 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:36.329163 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6302e7-7b77-474b-ba36-fb9b490d7539 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:36.393242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc3440-4287-4f2b-b8b0-9416f9ab2df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:36.394026 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc3440-4287-4f2b-b8b0-9416f9ab2df6 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:36.394382 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc3440-4287-4f2b-b8b0-9416f9ab2df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:36.394731 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc3440-4287-4f2b-b8b0-9416f9ab2df6 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:36.395528 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc3440-4287-4f2b-b8b0-9416f9ab2df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:36.397615 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc3440-4287-4f2b-b8b0-9416f9ab2df6 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:36.420819 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1379/2764] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:12:36 2021] POST /identity/v3/users => generated 308 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:12:36.424707 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca59cc-291d-41b8-b525-f69a36416d4b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:36.434816 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca59cc-291d-41b8-b525-f69a36416d4b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:36.439576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01a47e-b2b1-40e3-9d0a-5fba80603c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:36.440241 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01a47e-b2b1-40e3-9d0a-5fba80603c23 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:36.440532 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01a47e-b2b1-40e3-9d0a-5fba80603c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:36.440818 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01a47e-b2b1-40e3-9d0a-5fba80603c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:36.441574 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01a47e-b2b1-40e3-9d0a-5fba80603c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:36.443230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01a47e-b2b1-40e3-9d0a-5fba80603c23 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:36.457229 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1386/2765] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:12:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:12:36.458381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc3440-4287-4f2b-b8b0-9416f9ab2df6 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:36.469504 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc3440-4287-4f2b-b8b0-9416f9ab2df6 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:36.474381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c986f-e2d5-4205-adf1-453b129187ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:36.475414 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c986f-e2d5-4205-adf1-453b129187ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:36.475825 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c986f-e2d5-4205-adf1-453b129187ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:36.476473 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c986f-e2d5-4205-adf1-453b129187ac admin admin] PATH_INFO: `/v3/projects/76f95ed165704f329edc63c2546dcef8/users/0874d9c924eb4129be61b2940b231d5d/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:36.492333 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c986f-e2d5-4205-adf1-453b129187ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f95ed165704f329edc63c2546dcef8, user_id=0874d9c924eb4129be61b2940b231d5d, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:36.495009 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c986f-e2d5-4205-adf1-453b129187ac admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:36.507544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1380/2766] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:12:36 2021] PUT /identity/v3/projects/76f95ed165704f329edc63c2546dcef8/users/0874d9c924eb4129be61b2940b231d5d/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:36.511469 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01a47e-b2b1-40e3-9d0a-5fba80603c23 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:36.521232 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01a47e-b2b1-40e3-9d0a-5fba80603c23 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:36.577263 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78157314-c8b2-463b-ae84-72d2359e12f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:36.577874 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78157314-c8b2-463b-ae84-72d2359e12f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:36.578134 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78157314-c8b2-463b-ae84-72d2359e12f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:36.578415 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78157314-c8b2-463b-ae84-72d2359e12f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:36.579166 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78157314-c8b2-463b-ae84-72d2359e12f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:36.580755 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78157314-c8b2-463b-ae84-72d2359e12f5 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:36.590986 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1387/2767] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:12:36 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 01:12:36.595169 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c986f-e2d5-4205-adf1-453b129187ac admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:36.605937 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c986f-e2d5-4205-adf1-453b129187ac admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:36.610492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b931f-5ff9-49db-98d8-e612864325cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:36.611402 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b931f-5ff9-49db-98d8-e612864325cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:36.611686 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b931f-5ff9-49db-98d8-e612864325cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:36.611961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b931f-5ff9-49db-98d8-e612864325cd admin admin] PATH_INFO: `/v3/projects/76f95ed165704f329edc63c2546dcef8/users/0874d9c924eb4129be61b2940b231d5d/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:36.613901 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b931f-5ff9-49db-98d8-e612864325cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f95ed165704f329edc63c2546dcef8, user_id=0874d9c924eb4129be61b2940b231d5d, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:36.617049 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b931f-5ff9-49db-98d8-e612864325cd admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:36.626911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1381/2768] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:12:36 2021] PUT /identity/v3/projects/76f95ed165704f329edc63c2546dcef8/users/0874d9c924eb4129be61b2940b231d5d/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:36.637796 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d589c0-6fd6-44cb-9cfa-a740e9b284a2 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:36.638085 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d589c0-6fd6-44cb-9cfa-a740e9b284a2 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:36.638388 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d589c0-6fd6-44cb-9cfa-a740e9b284a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:36.666511 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-00d589c0-6fd6-44cb-9cfa-a740e9b284a2 None None] MFA Rules not processed for user `0874d9c924eb4129be61b2940b231d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:36.667800 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-00d589c0-6fd6-44cb-9cfa-a740e9b284a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:36.732526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1388/2769] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:36 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:36.743267 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b931f-5ff9-49db-98d8-e612864325cd admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:36.744964 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2f7b931f-5ff9-49db-98d8-e612864325cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:36.799314 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b931f-5ff9-49db-98d8-e612864325cd admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:36.802911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b61522-4233-44e7-9aeb-6cefec89a088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:36.803542 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b61522-4233-44e7-9aeb-6cefec89a088 service cinder] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:36.805989 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b61522-4233-44e7-9aeb-6cefec89a088 service cinder] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:36.806271 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b61522-4233-44e7-9aeb-6cefec89a088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:36.815240 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b61522-4233-44e7-9aeb-6cefec89a088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:36.816663 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b61522-4233-44e7-9aeb-6cefec89a088 service cinder] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:36.826621 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1382/2770] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:12:36 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:12:36.966325 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d589c0-6fd6-44cb-9cfa-a740e9b284a2 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:37.027480 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d589c0-6fd6-44cb-9cfa-a740e9b284a2 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:37.031913 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba40ed-856b-4faa-b19f-871ed7dd321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:37.032756 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba40ed-856b-4faa-b19f-871ed7dd321c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:37.033039 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba40ed-856b-4faa-b19f-871ed7dd321c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:37.033313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba40ed-856b-4faa-b19f-871ed7dd321c admin admin] PATH_INFO: `/v3/users/44fd166704634133b3dc350c01f6b32c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:37.034488 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba40ed-856b-4faa-b19f-871ed7dd321c admin admin] RBAC: Authorizing `identity:delete_user(user_id=44fd166704634133b3dc350c01f6b32c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:37.036417 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba40ed-856b-4faa-b19f-871ed7dd321c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:37.081778 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-10ba40ed-856b-4faa-b19f-871ed7dd321c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44fd166704634133b3dc350c01f6b32c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.088422 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-10ba40ed-856b-4faa-b19f-871ed7dd321c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44fd166704634133b3dc350c01f6b32c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.089012 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-10ba40ed-856b-4faa-b19f-871ed7dd321c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44fd166704634133b3dc350c01f6b32c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.100434 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-10ba40ed-856b-4faa-b19f-871ed7dd321c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44fd166704634133b3dc350c01f6b32c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.101685 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-10ba40ed-856b-4faa-b19f-871ed7dd321c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44fd166704634133b3dc350c01f6b32c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.114443 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1389/2771] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:12:36 2021] DELETE /identity/v3/users/44fd166704634133b3dc350c01f6b32c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 01:12:37.119759 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706b455-0aea-4fef-943c-d02da0a8adbd None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:37.120056 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706b455-0aea-4fef-943c-d02da0a8adbd None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:37.120340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706b455-0aea-4fef-943c-d02da0a8adbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:37.137902 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-8706b455-0aea-4fef-943c-d02da0a8adbd None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:37.139157 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8706b455-0aea-4fef-943c-d02da0a8adbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:37.196048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1383/2772] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:37.206687 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba40ed-856b-4faa-b19f-871ed7dd321c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:37.208140 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-10ba40ed-856b-4faa-b19f-871ed7dd321c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:37.262648 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba40ed-856b-4faa-b19f-871ed7dd321c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:37.266673 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39028d2a-559f-4d59-919c-1a492cfedee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:37.267366 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028d2a-559f-4d59-919c-1a492cfedee3 service neutron] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:37.267652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028d2a-559f-4d59-919c-1a492cfedee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:37.267931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028d2a-559f-4d59-919c-1a492cfedee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:37.277885 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39028d2a-559f-4d59-919c-1a492cfedee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:37.279365 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39028d2a-559f-4d59-919c-1a492cfedee3 service neutron] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:37.289124 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1390/2773] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:12:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:12:37.543417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706b455-0aea-4fef-943c-d02da0a8adbd None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:37.544891 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8706b455-0aea-4fef-943c-d02da0a8adbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:37.557206 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706b455-0aea-4fef-943c-d02da0a8adbd None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:37.562683 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:37.563581 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:37.563858 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:37.564236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] PATH_INFO: `/v3/projects/cc13239cd3c54957bca1e995e51b41a6` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:37.565365 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc13239cd3c54957bca1e995e51b41a6)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:37.567324 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:37.613882 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc13239cd3c54957bca1e995e51b41a6', 'request_id': 'req-41dde320-e9b0-4c39-8334-ea2bc4cd5583'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.620363 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc13239cd3c54957bca1e995e51b41a6', 'request_id': 'req-41dde320-e9b0-4c39-8334-ea2bc4cd5583'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.627405 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc13239cd3c54957bca1e995e51b41a6', 'request_id': 'req-41dde320-e9b0-4c39-8334-ea2bc4cd5583'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.638021 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] The token cache is being invalidate because project cc13239cd3c54957bca1e995e51b41a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:12:37.638339 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.638999 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.640508 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1384/2774] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:12:37 2021] DELETE /identity/v3/projects/cc13239cd3c54957bca1e995e51b41a6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:37.644373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39028d2a-559f-4d59-919c-1a492cfedee3 service neutron] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:37.653962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39028d2a-559f-4d59-919c-1a492cfedee3 service neutron] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:37.707388 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c658fa-b423-4495-9fc4-b3a23c6f819e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:37.708257 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c658fa-b423-4495-9fc4-b3a23c6f819e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:37.708548 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c658fa-b423-4495-9fc4-b3a23c6f819e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:37.708829 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c658fa-b423-4495-9fc4-b3a23c6f819e admin admin] PATH_INFO: `/v3/users/0874d9c924eb4129be61b2940b231d5d` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:37.710052 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c658fa-b423-4495-9fc4-b3a23c6f819e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0874d9c924eb4129be61b2940b231d5d)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:37.712106 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c658fa-b423-4495-9fc4-b3a23c6f819e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:37.754999 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a8c658fa-b423-4495-9fc4-b3a23c6f819e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0874d9c924eb4129be61b2940b231d5d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.762160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a8c658fa-b423-4495-9fc4-b3a23c6f819e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0874d9c924eb4129be61b2940b231d5d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.762812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a8c658fa-b423-4495-9fc4-b3a23c6f819e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0874d9c924eb4129be61b2940b231d5d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.774110 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a8c658fa-b423-4495-9fc4-b3a23c6f819e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0874d9c924eb4129be61b2940b231d5d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.774728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a8c658fa-b423-4495-9fc4-b3a23c6f819e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0874d9c924eb4129be61b2940b231d5d'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:37.786487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1391/2775] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:12:37 2021] DELETE /identity/v3/users/0874d9c924eb4129be61b2940b231d5d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:38.044404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:38.045852 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:38.059243 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dde320-e9b0-4c39-8334-ea2bc4cd5583 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:38.113676 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8fdb4-f393-43dd-b5a1-19246718eea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:38.114535 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8fdb4-f393-43dd-b5a1-19246718eea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:38.114822 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8fdb4-f393-43dd-b5a1-19246718eea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:38.115131 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8fdb4-f393-43dd-b5a1-19246718eea5 admin admin] PATH_INFO: `/v3/projects/76f95ed165704f329edc63c2546dcef8` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:38.117078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8fdb4-f393-43dd-b5a1-19246718eea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f95ed165704f329edc63c2546dcef8)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:38.119032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8fdb4-f393-43dd-b5a1-19246718eea5 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:38.161935 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-41a8fdb4-f393-43dd-b5a1-19246718eea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f95ed165704f329edc63c2546dcef8', 'request_id': 'req-41a8fdb4-f393-43dd-b5a1-19246718eea5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:38.168221 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-41a8fdb4-f393-43dd-b5a1-19246718eea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f95ed165704f329edc63c2546dcef8', 'request_id': 'req-41a8fdb4-f393-43dd-b5a1-19246718eea5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:38.175013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-41a8fdb4-f393-43dd-b5a1-19246718eea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f95ed165704f329edc63c2546dcef8', 'request_id': 'req-41a8fdb4-f393-43dd-b5a1-19246718eea5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:38.185350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-41a8fdb4-f393-43dd-b5a1-19246718eea5 admin admin] The token cache is being invalidate because project 76f95ed165704f329edc63c2546dcef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:12:38.185641 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-41a8fdb4-f393-43dd-b5a1-19246718eea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:38.186263 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-41a8fdb4-f393-43dd-b5a1-19246718eea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:38.187778 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1385/2776] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:12:38 2021] DELETE /identity/v3/projects/76f95ed165704f329edc63c2546dcef8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:38.193766 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ebac1-18ab-4c43-b54c-976f620c3f00 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:38.194054 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ebac1-18ab-4c43-b54c-976f620c3f00 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:38.194341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ebac1-18ab-4c43-b54c-976f620c3f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:38.212018 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-b51ebac1-18ab-4c43-b54c-976f620c3f00 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:38.213299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-b51ebac1-18ab-4c43-b54c-976f620c3f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:38.269880 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1392/2777] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 01:12:38.279297 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aa533-4b1b-4ed5-b316-75e84463cb9b None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:38.279590 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aa533-4b1b-4ed5-b316-75e84463cb9b None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:38.279877 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aa533-4b1b-4ed5-b316-75e84463cb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:38.298417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-755aa533-4b1b-4ed5-b316-75e84463cb9b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:38.299648 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-755aa533-4b1b-4ed5-b316-75e84463cb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:38.307747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1386/2778] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:38.311863 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ebac1-18ab-4c43-b54c-976f620c3f00 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:38.321374 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ebac1-18ab-4c43-b54c-976f620c3f00 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:38.326024 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864222bd-a64b-4421-bcc4-7f17139770a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:38.326684 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864222bd-a64b-4421-bcc4-7f17139770a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:38.327013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864222bd-a64b-4421-bcc4-7f17139770a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:38.327299 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864222bd-a64b-4421-bcc4-7f17139770a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:38.328059 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864222bd-a64b-4421-bcc4-7f17139770a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 01:12:38.328368 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864222bd-a64b-4421-bcc4-7f17139770a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:38.329962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864222bd-a64b-4421-bcc4-7f17139770a2 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:38.341759 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1393/2779] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 01:12:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 01:12:38.345875 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aa533-4b1b-4ed5-b316-75e84463cb9b None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:38.355885 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aa533-4b1b-4ed5-b316-75e84463cb9b None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:38.360594 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc67851-1e32-4041-974c-5e5032caf134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:38.361234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc67851-1e32-4041-974c-5e5032caf134 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:38.361518 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc67851-1e32-4041-974c-5e5032caf134 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:38.361794 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc67851-1e32-4041-974c-5e5032caf134 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:38.362480 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc67851-1e32-4041-974c-5e5032caf134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:38.364419 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc67851-1e32-4041-974c-5e5032caf134 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:38.388681 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1387/2780] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:12:38 2021] POST /identity/v3/projects => generated 403 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 01:12:38.392673 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864222bd-a64b-4421-bcc4-7f17139770a2 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:38.403213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864222bd-a64b-4421-bcc4-7f17139770a2 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:38.456626 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9551e-6682-4bed-8eef-de3f7581f468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:38.457220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9551e-6682-4bed-8eef-de3f7581f468 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:38.457507 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9551e-6682-4bed-8eef-de3f7581f468 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:38.457786 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9551e-6682-4bed-8eef-de3f7581f468 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:38.458473 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9551e-6682-4bed-8eef-de3f7581f468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:38.461093 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9551e-6682-4bed-8eef-de3f7581f468 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:38.481732 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1394/2781] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:12:38 2021] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:12:38.485881 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc67851-1e32-4041-974c-5e5032caf134 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:38.496532 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc67851-1e32-4041-974c-5e5032caf134 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:38.501136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94e706-cb3a-42c7-ad9a-c0ddca0f1864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:38.501784 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94e706-cb3a-42c7-ad9a-c0ddca0f1864 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:38.502069 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94e706-cb3a-42c7-ad9a-c0ddca0f1864 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:38.502347 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94e706-cb3a-42c7-ad9a-c0ddca0f1864 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:38.503100 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94e706-cb3a-42c7-ad9a-c0ddca0f1864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:38.504682 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94e706-cb3a-42c7-ad9a-c0ddca0f1864 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:38.514955 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1388/2782] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:12:38 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:12:38.518799 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9551e-6682-4bed-8eef-de3f7581f468 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:38.529132 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9551e-6682-4bed-8eef-de3f7581f468 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:38.533708 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65458d86-e5db-4157-92a8-777d0bb2df97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:38.534353 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65458d86-e5db-4157-92a8-777d0bb2df97 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:38.534639 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65458d86-e5db-4157-92a8-777d0bb2df97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:38.534956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65458d86-e5db-4157-92a8-777d0bb2df97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:38.535696 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65458d86-e5db-4157-92a8-777d0bb2df97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:38.537266 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65458d86-e5db-4157-92a8-777d0bb2df97 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:38.547602 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1395/2783] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:12:38 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:12:38.551473 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94e706-cb3a-42c7-ad9a-c0ddca0f1864 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:38.561389 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94e706-cb3a-42c7-ad9a-c0ddca0f1864 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:38.566087 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27371a-5bd4-4ae1-843e-b0a94d0064c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:38.566974 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27371a-5bd4-4ae1-843e-b0a94d0064c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:38.567266 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27371a-5bd4-4ae1-843e-b0a94d0064c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:38.567550 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27371a-5bd4-4ae1-843e-b0a94d0064c4 admin admin] PATH_INFO: `/v3/projects/63f98cabb22346499bfb130259600835/users/25371cfae229461cbed7bd79c55912e8/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:38.582049 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27371a-5bd4-4ae1-843e-b0a94d0064c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f98cabb22346499bfb130259600835, user_id=25371cfae229461cbed7bd79c55912e8, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:38.584737 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27371a-5bd4-4ae1-843e-b0a94d0064c4 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:38.598343 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1389/2784] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:12:38 2021] PUT /identity/v3/projects/63f98cabb22346499bfb130259600835/users/25371cfae229461cbed7bd79c55912e8/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:38.604035 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f85f5-c062-4ade-9f10-5753e6b60bf2 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:38.604330 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f85f5-c062-4ade-9f10-5753e6b60bf2 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:38.604611 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f85f5-c062-4ade-9f10-5753e6b60bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:38.622210 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-137f85f5-c062-4ade-9f10-5753e6b60bf2 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:38.623417 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-137f85f5-c062-4ade-9f10-5753e6b60bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:38.678812 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1396/2785] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:38.688592 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27371a-5bd4-4ae1-843e-b0a94d0064c4 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:38.690281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-2d27371a-5bd4-4ae1-843e-b0a94d0064c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:38.745506 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27371a-5bd4-4ae1-843e-b0a94d0064c4 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:38.749049 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765b52a-ebbd-4c1d-8104-31380e3b7cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:38.749687 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765b52a-ebbd-4c1d-8104-31380e3b7cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:38.749970 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765b52a-ebbd-4c1d-8104-31380e3b7cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:38.750245 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765b52a-ebbd-4c1d-8104-31380e3b7cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:38.759404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765b52a-ebbd-4c1d-8104-31380e3b7cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:38.760828 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765b52a-ebbd-4c1d-8104-31380e3b7cb9 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:38.769850 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1390/2786] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:12:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:12:39.362901 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295629b8-1cff-4432-a6c7-e3fa02d14de0 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:39.363202 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295629b8-1cff-4432-a6c7-e3fa02d14de0 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:39.363487 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295629b8-1cff-4432-a6c7-e3fa02d14de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:39.391510 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-295629b8-1cff-4432-a6c7-e3fa02d14de0 None None] MFA Rules not processed for user `25371cfae229461cbed7bd79c55912e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:39.392732 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-295629b8-1cff-4432-a6c7-e3fa02d14de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:39.456498 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1397/2787] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:39 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:39.461016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765b52a-ebbd-4c1d-8104-31380e3b7cb9 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:39.470705 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765b52a-ebbd-4c1d-8104-31380e3b7cb9 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:39.475332 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cb321-8736-48c5-816e-f0ecd0db97e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:39.476539 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cb321-8736-48c5-816e-f0ecd0db97e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:39.476820 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cb321-8736-48c5-816e-f0ecd0db97e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:39.477097 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cb321-8736-48c5-816e-f0ecd0db97e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:39.477792 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cb321-8736-48c5-816e-f0ecd0db97e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:39.479982 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cb321-8736-48c5-816e-f0ecd0db97e0 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:39.508921 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1391/2788] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:12:39 2021] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:12:39.510081 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295629b8-1cff-4432-a6c7-e3fa02d14de0 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:39.520837 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295629b8-1cff-4432-a6c7-e3fa02d14de0 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:39.576094 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913e211-42aa-456e-a500-6221f1c2266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:39.576685 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913e211-42aa-456e-a500-6221f1c2266b admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:39.576975 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913e211-42aa-456e-a500-6221f1c2266b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:39.577255 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913e211-42aa-456e-a500-6221f1c2266b admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:39.577950 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913e211-42aa-456e-a500-6221f1c2266b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:39.579924 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913e211-42aa-456e-a500-6221f1c2266b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:39.599939 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1398/2789] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:12:39 2021] POST /identity/v3/users => generated 309 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 01:12:39.605320 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cb321-8736-48c5-816e-f0ecd0db97e0 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:39.615441 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cb321-8736-48c5-816e-f0ecd0db97e0 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:39.620809 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8717a-ce6d-410c-b091-034c66fa40b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:39.621467 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8717a-ce6d-410c-b091-034c66fa40b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:39.621753 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8717a-ce6d-410c-b091-034c66fa40b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:39.622034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8717a-ce6d-410c-b091-034c66fa40b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:39.622756 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8717a-ce6d-410c-b091-034c66fa40b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:39.624381 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8717a-ce6d-410c-b091-034c66fa40b8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:39.635060 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1392/2790] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:12:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:12:39.639141 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913e211-42aa-456e-a500-6221f1c2266b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:39.648770 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913e211-42aa-456e-a500-6221f1c2266b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:39.653301 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1755f1-5729-416b-a439-222695821fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:39.654159 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1755f1-5729-416b-a439-222695821fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:39.654438 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1755f1-5729-416b-a439-222695821fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:39.654709 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1755f1-5729-416b-a439-222695821fb0 admin admin] PATH_INFO: `/v3/projects/52060cecb49e4a8ba8028d171a5b57a7/users/8c1cf996dc344daa988cd2fd4223ec7c/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:39.669310 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1755f1-5729-416b-a439-222695821fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52060cecb49e4a8ba8028d171a5b57a7, user_id=8c1cf996dc344daa988cd2fd4223ec7c, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:39.671973 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1755f1-5729-416b-a439-222695821fb0 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:39.686084 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1399/2791] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:12:39 2021] PUT /identity/v3/projects/52060cecb49e4a8ba8028d171a5b57a7/users/8c1cf996dc344daa988cd2fd4223ec7c/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:39.690013 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8717a-ce6d-410c-b091-034c66fa40b8 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:39.700113 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8717a-ce6d-410c-b091-034c66fa40b8 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:39.753571 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5551e-1e53-4665-992b-9e9012911ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:39.754242 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5551e-1e53-4665-992b-9e9012911ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:39.754526 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5551e-1e53-4665-992b-9e9012911ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:39.754806 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5551e-1e53-4665-992b-9e9012911ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:39.755573 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5551e-1e53-4665-992b-9e9012911ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:39.757236 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5551e-1e53-4665-992b-9e9012911ea8 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:39.766577 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1393/2792] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:12:39 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:12:39.770859 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1755f1-5729-416b-a439-222695821fb0 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:39.781649 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1755f1-5729-416b-a439-222695821fb0 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:39.786170 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e0f81-d929-41ec-8613-9d2f2c3d06b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:39.787094 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e0f81-d929-41ec-8613-9d2f2c3d06b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:39.787378 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e0f81-d929-41ec-8613-9d2f2c3d06b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:39.787656 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e0f81-d929-41ec-8613-9d2f2c3d06b1 admin admin] PATH_INFO: `/v3/projects/52060cecb49e4a8ba8028d171a5b57a7/users/8c1cf996dc344daa988cd2fd4223ec7c/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:39.790583 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e0f81-d929-41ec-8613-9d2f2c3d06b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52060cecb49e4a8ba8028d171a5b57a7, user_id=8c1cf996dc344daa988cd2fd4223ec7c, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:39.793230 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e0f81-d929-41ec-8613-9d2f2c3d06b1 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:39.803289 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1400/2793] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:12:39 2021] PUT /identity/v3/projects/52060cecb49e4a8ba8028d171a5b57a7/users/8c1cf996dc344daa988cd2fd4223ec7c/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:40.390235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca844c-f031-46f8-8f8a-3c0bb5831aaf None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:40.390531 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca844c-f031-46f8-8f8a-3c0bb5831aaf None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:40.390811 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca844c-f031-46f8-8f8a-3c0bb5831aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:40.417699 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-e1ca844c-f031-46f8-8f8a-3c0bb5831aaf None None] MFA Rules not processed for user `8c1cf996dc344daa988cd2fd4223ec7c`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:40.418949 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-e1ca844c-f031-46f8-8f8a-3c0bb5831aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:40.487915 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1394/2794] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:40 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:41.445836 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e0f81-d929-41ec-8613-9d2f2c3d06b1 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:41.508729 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e0f81-d929-41ec-8613-9d2f2c3d06b1 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:41.513567 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d01499-f1b2-4872-978d-adb55b8bdc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:41.514432 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d01499-f1b2-4872-978d-adb55b8bdc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:41.514720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d01499-f1b2-4872-978d-adb55b8bdc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:41.515032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d01499-f1b2-4872-978d-adb55b8bdc63 admin admin] PATH_INFO: `/v3/users/25371cfae229461cbed7bd79c55912e8` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:41.516234 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d01499-f1b2-4872-978d-adb55b8bdc63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25371cfae229461cbed7bd79c55912e8)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:41.518146 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d01499-f1b2-4872-978d-adb55b8bdc63 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:41.562435 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a4d01499-f1b2-4872-978d-adb55b8bdc63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25371cfae229461cbed7bd79c55912e8'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:41.568886 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a4d01499-f1b2-4872-978d-adb55b8bdc63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25371cfae229461cbed7bd79c55912e8'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:41.570373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a4d01499-f1b2-4872-978d-adb55b8bdc63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25371cfae229461cbed7bd79c55912e8'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:41.581342 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a4d01499-f1b2-4872-978d-adb55b8bdc63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25371cfae229461cbed7bd79c55912e8'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:41.581962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-a4d01499-f1b2-4872-978d-adb55b8bdc63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25371cfae229461cbed7bd79c55912e8'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:41.593391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1401/2795] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:12:41 2021] DELETE /identity/v3/users/25371cfae229461cbed7bd79c55912e8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 01:12:41.756112 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca844c-f031-46f8-8f8a-3c0bb5831aaf None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:41.766847 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca844c-f031-46f8-8f8a-3c0bb5831aaf None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:41.825736 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:41.826629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:41.826944 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:41.827227 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] PATH_INFO: `/v3/projects/63f98cabb22346499bfb130259600835` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:41.828500 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f98cabb22346499bfb130259600835)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:41.830469 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:41.880048 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f98cabb22346499bfb130259600835', 'request_id': 'req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:41.887908 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f98cabb22346499bfb130259600835', 'request_id': 'req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:41.896276 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f98cabb22346499bfb130259600835', 'request_id': 'req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:41.908367 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] The token cache is being invalidate because project 63f98cabb22346499bfb130259600835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:12:41.908677 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:41.909353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:41.911256 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1395/2796] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:12:41 2021] DELETE /identity/v3/projects/63f98cabb22346499bfb130259600835 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:41.915552 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d01499-f1b2-4872-978d-adb55b8bdc63 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:41.916945 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a4d01499-f1b2-4872-978d-adb55b8bdc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:41.930485 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d01499-f1b2-4872-978d-adb55b8bdc63 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:41.985525 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f80c5-7e72-4324-afc1-288ff3b6e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:41.986322 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f80c5-7e72-4324-afc1-288ff3b6e777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:41.986657 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f80c5-7e72-4324-afc1-288ff3b6e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:41.986984 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f80c5-7e72-4324-afc1-288ff3b6e777 admin admin] PATH_INFO: `/v3/users/8c1cf996dc344daa988cd2fd4223ec7c` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:41.988178 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f80c5-7e72-4324-afc1-288ff3b6e777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1cf996dc344daa988cd2fd4223ec7c)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:41.990136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f80c5-7e72-4324-afc1-288ff3b6e777 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:42.032720 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d89f80c5-7e72-4324-afc1-288ff3b6e777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1cf996dc344daa988cd2fd4223ec7c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:42.039341 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d89f80c5-7e72-4324-afc1-288ff3b6e777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1cf996dc344daa988cd2fd4223ec7c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:42.039994 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d89f80c5-7e72-4324-afc1-288ff3b6e777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1cf996dc344daa988cd2fd4223ec7c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:42.051215 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d89f80c5-7e72-4324-afc1-288ff3b6e777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1cf996dc344daa988cd2fd4223ec7c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:42.051845 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-d89f80c5-7e72-4324-afc1-288ff3b6e777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1cf996dc344daa988cd2fd4223ec7c'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:42.064501 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1402/2797] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:12:41 2021] DELETE /identity/v3/users/8c1cf996dc344daa988cd2fd4223ec7c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:42.230340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:42.231805 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:42.246512 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba2675-a4e7-4ab0-b7c7-8da31e0d24ec admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:42.302943 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b016028-48f2-487c-a6de-80415f49db35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:42.304394 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b016028-48f2-487c-a6de-80415f49db35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:42.304685 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b016028-48f2-487c-a6de-80415f49db35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:42.304966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b016028-48f2-487c-a6de-80415f49db35 admin admin] PATH_INFO: `/v3/projects/52060cecb49e4a8ba8028d171a5b57a7` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:42.306170 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b016028-48f2-487c-a6de-80415f49db35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52060cecb49e4a8ba8028d171a5b57a7)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:42.308120 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b016028-48f2-487c-a6de-80415f49db35 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:42.353040 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2b016028-48f2-487c-a6de-80415f49db35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52060cecb49e4a8ba8028d171a5b57a7', 'request_id': 'req-2b016028-48f2-487c-a6de-80415f49db35'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:42.359173 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2b016028-48f2-487c-a6de-80415f49db35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52060cecb49e4a8ba8028d171a5b57a7', 'request_id': 'req-2b016028-48f2-487c-a6de-80415f49db35'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:42.367258 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2b016028-48f2-487c-a6de-80415f49db35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52060cecb49e4a8ba8028d171a5b57a7', 'request_id': 'req-2b016028-48f2-487c-a6de-80415f49db35'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:42.377535 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2b016028-48f2-487c-a6de-80415f49db35 admin admin] The token cache is being invalidate because project 52060cecb49e4a8ba8028d171a5b57a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86001) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:12:42.377832 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2b016028-48f2-487c-a6de-80415f49db35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:42.378469 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-2b016028-48f2-487c-a6de-80415f49db35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:42.380037 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1396/2798] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:12:42 2021] DELETE /identity/v3/projects/52060cecb49e4a8ba8028d171a5b57a7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:42.385889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf7536-398e-42eb-b7e9-5cffd83e34b0 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:42.386184 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf7536-398e-42eb-b7e9-5cffd83e34b0 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:42.386470 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf7536-398e-42eb-b7e9-5cffd83e34b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:42.403698 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-a4bf7536-398e-42eb-b7e9-5cffd83e34b0 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:42.404887 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a4bf7536-398e-42eb-b7e9-5cffd83e34b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:42.462220 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1403/2799] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:42.471229 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9bae-ae8b-4348-b39e-e44fff30aa5d None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:42.471528 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9bae-ae8b-4348-b39e-e44fff30aa5d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:42.471814 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9bae-ae8b-4348-b39e-e44fff30aa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:42.490622 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-bcba9bae-ae8b-4348-b39e-e44fff30aa5d None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:42.492472 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-bcba9bae-ae8b-4348-b39e-e44fff30aa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:42.500425 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1397/2800] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:42.504574 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf7536-398e-42eb-b7e9-5cffd83e34b0 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:42.514248 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf7536-398e-42eb-b7e9-5cffd83e34b0 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:42.519018 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e48f8-e266-49d2-9dea-972cbcdeda1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:42.519673 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e48f8-e266-49d2-9dea-972cbcdeda1c admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:42.519964 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e48f8-e266-49d2-9dea-972cbcdeda1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:42.520248 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e48f8-e266-49d2-9dea-972cbcdeda1c admin admin] PATH_INFO: `/v3/domains` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:42.520971 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e48f8-e266-49d2-9dea-972cbcdeda1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86000) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 01:12:42.521285 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e48f8-e266-49d2-9dea-972cbcdeda1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:42.523060 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e48f8-e266-49d2-9dea-972cbcdeda1c admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:42.534253 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1404/2801] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 01:12:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 01:12:42.539014 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba9bae-ae8b-4348-b39e-e44fff30aa5d None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:42.549070 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba9bae-ae8b-4348-b39e-e44fff30aa5d None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:42.554331 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d0cd3-cec2-4a2b-b4d1-547ed517219c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:42.555011 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d0cd3-cec2-4a2b-b4d1-547ed517219c admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:42.555302 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d0cd3-cec2-4a2b-b4d1-547ed517219c admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:42.555585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d0cd3-cec2-4a2b-b4d1-547ed517219c admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:42.556286 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d0cd3-cec2-4a2b-b4d1-547ed517219c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:42.558183 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d0cd3-cec2-4a2b-b4d1-547ed517219c admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:42.582191 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1398/2802] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:12:42 2021] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 01:12:42.586267 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e48f8-e266-49d2-9dea-972cbcdeda1c admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:42.596004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e48f8-e266-49d2-9dea-972cbcdeda1c admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:42.650174 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133f833-df7d-42fc-bded-a6ab1c3f801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:42.650864 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133f833-df7d-42fc-bded-a6ab1c3f801d admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:42.651173 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133f833-df7d-42fc-bded-a6ab1c3f801d admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:42.651457 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133f833-df7d-42fc-bded-a6ab1c3f801d admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:42.652163 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133f833-df7d-42fc-bded-a6ab1c3f801d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:42.654087 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133f833-df7d-42fc-bded-a6ab1c3f801d admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:42.673599 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1405/2803] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:12:42 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 01:12:42.677613 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d0cd3-cec2-4a2b-b4d1-547ed517219c admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:42.688135 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d0cd3-cec2-4a2b-b4d1-547ed517219c admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:42.692730 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98c722-f7df-4c63-b728-2a79ab6e607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:42.693387 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c722-f7df-4c63-b728-2a79ab6e607d admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:42.693676 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c722-f7df-4c63-b728-2a79ab6e607d admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:42.693961 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98c722-f7df-4c63-b728-2a79ab6e607d admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:42.694758 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98c722-f7df-4c63-b728-2a79ab6e607d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:42.696545 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98c722-f7df-4c63-b728-2a79ab6e607d admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:42.706813 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1399/2804] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:12:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:12:42.711125 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133f833-df7d-42fc-bded-a6ab1c3f801d admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:42.720887 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133f833-df7d-42fc-bded-a6ab1c3f801d admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:42.726204 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7317fd-314c-4909-ba72-20d899dedd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:42.726894 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7317fd-314c-4909-ba72-20d899dedd60 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:42.727186 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7317fd-314c-4909-ba72-20d899dedd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:42.727472 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7317fd-314c-4909-ba72-20d899dedd60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:42.728222 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7317fd-314c-4909-ba72-20d899dedd60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:42.730073 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7317fd-314c-4909-ba72-20d899dedd60 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:42.739719 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1406/2805] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:12:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 01:12:42.743706 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98c722-f7df-4c63-b728-2a79ab6e607d admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:42.753513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98c722-f7df-4c63-b728-2a79ab6e607d admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:42.758162 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46572f-8808-4c9d-9e36-8ec03acd4133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:42.759065 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46572f-8808-4c9d-9e36-8ec03acd4133 admin admin] REQUEST_METHOD: `PUT` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:42.759361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46572f-8808-4c9d-9e36-8ec03acd4133 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:42.759645 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46572f-8808-4c9d-9e36-8ec03acd4133 admin admin] PATH_INFO: `/v3/projects/ce89dc3dd53943d1a8978b0166732bf9/users/57455deb30084aa6ab2392bec3cb4d1e/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:42.774188 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46572f-8808-4c9d-9e36-8ec03acd4133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce89dc3dd53943d1a8978b0166732bf9, user_id=57455deb30084aa6ab2392bec3cb4d1e, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:42.776875 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46572f-8808-4c9d-9e36-8ec03acd4133 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:42.790038 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1400/2806] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:12:42 2021] PUT /identity/v3/projects/ce89dc3dd53943d1a8978b0166732bf9/users/57455deb30084aa6ab2392bec3cb4d1e/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:42.800058 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8e94-2c88-4ce6-84dc-43ee87e47da2 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:42.800401 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8e94-2c88-4ce6-84dc-43ee87e47da2 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:42.800728 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8e94-2c88-4ce6-84dc-43ee87e47da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:42.826578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-a07b8e94-2c88-4ce6-84dc-43ee87e47da2 None None] MFA Rules not processed for user `57455deb30084aa6ab2392bec3cb4d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:42.827810 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-a07b8e94-2c88-4ce6-84dc-43ee87e47da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:42.890582 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1407/2807] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:42 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:42.894922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46572f-8808-4c9d-9e36-8ec03acd4133 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:42.956836 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46572f-8808-4c9d-9e36-8ec03acd4133 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:42.961636 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a95f3-5898-40ef-a6e6-502a3e266bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:42.962292 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a95f3-5898-40ef-a6e6-502a3e266bee admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:42.962584 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a95f3-5898-40ef-a6e6-502a3e266bee admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:42.962888 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a95f3-5898-40ef-a6e6-502a3e266bee admin admin] PATH_INFO: `/v3/projects` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:42.963593 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a95f3-5898-40ef-a6e6-502a3e266bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:42.965504 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a95f3-5898-40ef-a6e6-502a3e266bee admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:42.989540 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1401/2808] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:12:42 2021] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:12:42.994104 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b8e94-2c88-4ce6-84dc-43ee87e47da2 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:43.004576 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b8e94-2c88-4ce6-84dc-43ee87e47da2 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:43.058779 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca9085-89d0-4bf8-91af-b9ed2b5aab48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:43.059468 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca9085-89d0-4bf8-91af-b9ed2b5aab48 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:43.059750 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca9085-89d0-4bf8-91af-b9ed2b5aab48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:43.060026 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca9085-89d0-4bf8-91af-b9ed2b5aab48 admin admin] PATH_INFO: `/v3/users` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:43.060695 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca9085-89d0-4bf8-91af-b9ed2b5aab48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:43.062573 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca9085-89d0-4bf8-91af-b9ed2b5aab48 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:43.081905 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1408/2809] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:12:42 2021] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:12:43.086016 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a95f3-5898-40ef-a6e6-502a3e266bee admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:43.096166 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a95f3-5898-40ef-a6e6-502a3e266bee admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:43.101922 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81d437-2711-4eee-8d97-1de40dd54a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:43.102576 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81d437-2711-4eee-8d97-1de40dd54a72 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:43.102875 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81d437-2711-4eee-8d97-1de40dd54a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:43.103158 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81d437-2711-4eee-8d97-1de40dd54a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:43.104128 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81d437-2711-4eee-8d97-1de40dd54a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:43.105708 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81d437-2711-4eee-8d97-1de40dd54a72 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:43.115398 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1402/2810] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:12:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:12:43.120008 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca9085-89d0-4bf8-91af-b9ed2b5aab48 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:43.129671 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca9085-89d0-4bf8-91af-b9ed2b5aab48 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:43.134313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5df9ec-a4c2-4659-8e92-ecef4aaa505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:43.135221 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5df9ec-a4c2-4659-8e92-ecef4aaa505b admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:43.135503 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5df9ec-a4c2-4659-8e92-ecef4aaa505b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:43.135778 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5df9ec-a4c2-4659-8e92-ecef4aaa505b admin admin] PATH_INFO: `/v3/projects/3027dfdd48c548d9a6b0c42e2975da0f/users/b8a2556e9dc54c5d899c638ecc1f5e64/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:43.149647 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5df9ec-a4c2-4659-8e92-ecef4aaa505b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3027dfdd48c548d9a6b0c42e2975da0f, user_id=b8a2556e9dc54c5d899c638ecc1f5e64, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:43.152313 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5df9ec-a4c2-4659-8e92-ecef4aaa505b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:43.165227 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1409/2811] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:12:43 2021] PUT /identity/v3/projects/3027dfdd48c548d9a6b0c42e2975da0f/users/b8a2556e9dc54c5d899c638ecc1f5e64/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:43.168966 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81d437-2711-4eee-8d97-1de40dd54a72 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:43.179306 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81d437-2711-4eee-8d97-1de40dd54a72 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:43.235790 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c09b34-04c1-4508-9aee-6006a2d59987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:43.236464 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c09b34-04c1-4508-9aee-6006a2d59987 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:43.236752 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c09b34-04c1-4508-9aee-6006a2d59987 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:43.237032 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c09b34-04c1-4508-9aee-6006a2d59987 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:43.237781 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c09b34-04c1-4508-9aee-6006a2d59987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:43.239412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c09b34-04c1-4508-9aee-6006a2d59987 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:43.250141 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1403/2812] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:12:43 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:12:43.254111 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5df9ec-a4c2-4659-8e92-ecef4aaa505b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:43.264399 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5df9ec-a4c2-4659-8e92-ecef4aaa505b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:43.269061 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e3e2e-7a3b-486b-815c-5ce1c3b98cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:43.269931 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e3e2e-7a3b-486b-815c-5ce1c3b98cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:43.270215 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e3e2e-7a3b-486b-815c-5ce1c3b98cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:43.270491 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e3e2e-7a3b-486b-815c-5ce1c3b98cbf admin admin] PATH_INFO: `/v3/projects/3027dfdd48c548d9a6b0c42e2975da0f/users/b8a2556e9dc54c5d899c638ecc1f5e64/roles/2813231cc8954b998440e4bf5ede2945` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:43.272563 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e3e2e-7a3b-486b-815c-5ce1c3b98cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3027dfdd48c548d9a6b0c42e2975da0f, user_id=b8a2556e9dc54c5d899c638ecc1f5e64, role_id=2813231cc8954b998440e4bf5ede2945)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:43.275288 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e3e2e-7a3b-486b-815c-5ce1c3b98cbf admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:43.285205 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1410/2813] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:12:43 2021] PUT /identity/v3/projects/3027dfdd48c548d9a6b0c42e2975da0f/users/b8a2556e9dc54c5d899c638ecc1f5e64/roles/2813231cc8954b998440e4bf5ede2945 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 01:12:43.295631 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9993c45-e495-415c-b26e-95fd9595a384 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:43.295949 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9993c45-e495-415c-b26e-95fd9595a384 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:43.296235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9993c45-e495-415c-b26e-95fd9595a384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:43.322342 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-c9993c45-e495-415c-b26e-95fd9595a384 None None] MFA Rules not processed for user `b8a2556e9dc54c5d899c638ecc1f5e64`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:43.323585 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-c9993c45-e495-415c-b26e-95fd9595a384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:43.398900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1404/2814] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:43 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:43.409673 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e3e2e-7a3b-486b-815c-5ce1c3b98cbf admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:43.411429 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e62e3e2e-7a3b-486b-815c-5ce1c3b98cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:43.467055 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e3e2e-7a3b-486b-815c-5ce1c3b98cbf admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:43.470751 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce34054-20b2-42b7-8999-0bd0fcc2872f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:43.471424 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce34054-20b2-42b7-8999-0bd0fcc2872f service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:43.471706 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce34054-20b2-42b7-8999-0bd0fcc2872f service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:43.471978 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce34054-20b2-42b7-8999-0bd0fcc2872f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:43.482503 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce34054-20b2-42b7-8999-0bd0fcc2872f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:43.483979 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce34054-20b2-42b7-8999-0bd0fcc2872f service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:43.493339 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1411/2815] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:12:43 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:12:43.554769 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9993c45-e495-415c-b26e-95fd9595a384 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:43.614317 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9993c45-e495-415c-b26e-95fd9595a384 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:43.619136 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648df9d5-d42d-41ff-aaaf-cbb4b795a8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:43.620000 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648df9d5-d42d-41ff-aaaf-cbb4b795a8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:43.620287 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648df9d5-d42d-41ff-aaaf-cbb4b795a8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:43.620566 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648df9d5-d42d-41ff-aaaf-cbb4b795a8bf admin admin] PATH_INFO: `/v3/users/57455deb30084aa6ab2392bec3cb4d1e` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:43.621767 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648df9d5-d42d-41ff-aaaf-cbb4b795a8bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=57455deb30084aa6ab2392bec3cb4d1e)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:43.623724 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648df9d5-d42d-41ff-aaaf-cbb4b795a8bf admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:43.668504 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-648df9d5-d42d-41ff-aaaf-cbb4b795a8bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57455deb30084aa6ab2392bec3cb4d1e'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:43.675089 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-648df9d5-d42d-41ff-aaaf-cbb4b795a8bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57455deb30084aa6ab2392bec3cb4d1e'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:43.681947 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-648df9d5-d42d-41ff-aaaf-cbb4b795a8bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57455deb30084aa6ab2392bec3cb4d1e'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:43.693468 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-648df9d5-d42d-41ff-aaaf-cbb4b795a8bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57455deb30084aa6ab2392bec3cb4d1e'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:43.694104 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-648df9d5-d42d-41ff-aaaf-cbb4b795a8bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57455deb30084aa6ab2392bec3cb4d1e'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:43.699981 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1405/2816] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:12:43 2021] DELETE /identity/v3/users/57455deb30084aa6ab2392bec3cb4d1e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:43.704536 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ff041-e087-48f2-a147-aeae33ff44d5 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:43.704825 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ff041-e087-48f2-a147-aeae33ff44d5 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:43.705099 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ff041-e087-48f2-a147-aeae33ff44d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:43.722895 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-cc4ff041-e087-48f2-a147-aeae33ff44d5 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:43.724071 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-cc4ff041-e087-48f2-a147-aeae33ff44d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:43.779240 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1412/2817] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:43.790030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648df9d5-d42d-41ff-aaaf-cbb4b795a8bf admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:43.791544 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-648df9d5-d42d-41ff-aaaf-cbb4b795a8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:43.846191 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648df9d5-d42d-41ff-aaaf-cbb4b795a8bf admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:43.849832 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fd014-abae-4859-a63b-794a78a9f2b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:43.850545 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fd014-abae-4859-a63b-794a78a9f2b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:43.851007 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fd014-abae-4859-a63b-794a78a9f2b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:43.851293 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fd014-abae-4859-a63b-794a78a9f2b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:43.860372 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fd014-abae-4859-a63b-794a78a9f2b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:43.861822 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fd014-abae-4859-a63b-794a78a9f2b0 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:43.871200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1406/2818] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:12:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:12:44.122506 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ff041-e087-48f2-a147-aeae33ff44d5 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:44.123966 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-cc4ff041-e087-48f2-a147-aeae33ff44d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:44.137815 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ff041-e087-48f2-a147-aeae33ff44d5 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:44.142883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:44.143950 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:44.144241 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:44.144539 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] PATH_INFO: `/v3/projects/ce89dc3dd53943d1a8978b0166732bf9` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:44.145702 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce89dc3dd53943d1a8978b0166732bf9)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:44.148279 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:44.192214 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce89dc3dd53943d1a8978b0166732bf9', 'request_id': 'req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.198418 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce89dc3dd53943d1a8978b0166732bf9', 'request_id': 'req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.204415 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce89dc3dd53943d1a8978b0166732bf9', 'request_id': 'req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.216253 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] The token cache is being invalidate because project ce89dc3dd53943d1a8978b0166732bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:12:44.216539 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.217149 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.218674 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1413/2819] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:12:44 2021] DELETE /identity/v3/projects/ce89dc3dd53943d1a8978b0166732bf9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:44.222672 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fd014-abae-4859-a63b-794a78a9f2b0 service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:44.232397 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fd014-abae-4859-a63b-794a78a9f2b0 service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:44.295066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40857620-b4b7-48ca-acc6-a97d990a8292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:44.295933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40857620-b4b7-48ca-acc6-a97d990a8292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:44.296215 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40857620-b4b7-48ca-acc6-a97d990a8292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:44.296492 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40857620-b4b7-48ca-acc6-a97d990a8292 admin admin] PATH_INFO: `/v3/users/b8a2556e9dc54c5d899c638ecc1f5e64` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:44.297675 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40857620-b4b7-48ca-acc6-a97d990a8292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a2556e9dc54c5d899c638ecc1f5e64)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:44.299632 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40857620-b4b7-48ca-acc6-a97d990a8292 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:44.343495 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-40857620-b4b7-48ca-acc6-a97d990a8292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a2556e9dc54c5d899c638ecc1f5e64'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.349854 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-40857620-b4b7-48ca-acc6-a97d990a8292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a2556e9dc54c5d899c638ecc1f5e64'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.357043 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-40857620-b4b7-48ca-acc6-a97d990a8292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a2556e9dc54c5d899c638ecc1f5e64'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.368917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-40857620-b4b7-48ca-acc6-a97d990a8292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a2556e9dc54c5d899c638ecc1f5e64'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.369545 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-40857620-b4b7-48ca-acc6-a97d990a8292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a2556e9dc54c5d899c638ecc1f5e64'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.375319 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1407/2820] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:12:44 2021] DELETE /identity/v3/users/b8a2556e9dc54c5d899c638ecc1f5e64 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:12:44.638007 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:44.639615 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:44.653647 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935530f3-7dc5-48f2-a80d-18d16fdfb5b3 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:44.709509 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ce507-d345-4636-b35c-9e5af1305505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:44.710400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ce507-d345-4636-b35c-9e5af1305505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:44.710683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ce507-d345-4636-b35c-9e5af1305505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:44.710999 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ce507-d345-4636-b35c-9e5af1305505 admin admin] PATH_INFO: `/v3/projects/3027dfdd48c548d9a6b0c42e2975da0f` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:44.712181 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ce507-d345-4636-b35c-9e5af1305505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3027dfdd48c548d9a6b0c42e2975da0f)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:44.714094 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ce507-d345-4636-b35c-9e5af1305505 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:44.758781 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-084ce507-d345-4636-b35c-9e5af1305505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3027dfdd48c548d9a6b0c42e2975da0f', 'request_id': 'req-084ce507-d345-4636-b35c-9e5af1305505'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.763896 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-084ce507-d345-4636-b35c-9e5af1305505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3027dfdd48c548d9a6b0c42e2975da0f', 'request_id': 'req-084ce507-d345-4636-b35c-9e5af1305505'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.769736 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-084ce507-d345-4636-b35c-9e5af1305505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3027dfdd48c548d9a6b0c42e2975da0f', 'request_id': 'req-084ce507-d345-4636-b35c-9e5af1305505'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.781495 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-084ce507-d345-4636-b35c-9e5af1305505 admin admin] The token cache is being invalidate because project 3027dfdd48c548d9a6b0c42e2975da0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:12:44.781779 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-084ce507-d345-4636-b35c-9e5af1305505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.782406 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-084ce507-d345-4636-b35c-9e5af1305505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:12:44.783956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1414/2821] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:12:44 2021] DELETE /identity/v3/projects/3027dfdd48c548d9a6b0c42e2975da0f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 01:12:44.790094 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc65f4b-b99b-4690-835b-1a01dfe92423 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:44.790666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc65f4b-b99b-4690-835b-1a01dfe92423 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:44.790666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc65f4b-b99b-4690-835b-1a01dfe92423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:44.809034 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-8bc65f4b-b99b-4690-835b-1a01dfe92423 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:44.810239 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8bc65f4b-b99b-4690-835b-1a01dfe92423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:44.868085 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1408/2822] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 01:12:44.917685 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0271a-e576-4fa3-978a-a00ce4dbaf62 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:44.917915 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0271a-e576-4fa3-978a-a00ce4dbaf62 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:44.918153 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0271a-e576-4fa3-978a-a00ce4dbaf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:44.937327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-14e0271a-e576-4fa3-978a-a00ce4dbaf62 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:44.938536 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-14e0271a-e576-4fa3-978a-a00ce4dbaf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:44.946723 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1415/2823] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:44.950983 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc65f4b-b99b-4690-835b-1a01dfe92423 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:44.961384 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc65f4b-b99b-4690-835b-1a01dfe92423 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:44.966041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e34964-364e-4c41-84a8-2d9467de1d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:44.966701 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e34964-364e-4c41-84a8-2d9467de1d8f admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:44.967025 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e34964-364e-4c41-84a8-2d9467de1d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:44.967306 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e34964-364e-4c41-84a8-2d9467de1d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:44.968031 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e34964-364e-4c41-84a8-2d9467de1d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 01:12:44.968344 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e34964-364e-4c41-84a8-2d9467de1d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:44.969967 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e34964-364e-4c41-84a8-2d9467de1d8f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:44.982105 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1409/2824] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 01:12:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 01:12:44.986217 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0271a-e576-4fa3-978a-a00ce4dbaf62 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:44.995510 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0271a-e576-4fa3-978a-a00ce4dbaf62 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:45.000157 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577c726-bc1d-4d42-bb41-94cd2aab7c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:45.000804 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577c726-bc1d-4d42-bb41-94cd2aab7c43 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:45.001089 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577c726-bc1d-4d42-bb41-94cd2aab7c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:45.001367 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577c726-bc1d-4d42-bb41-94cd2aab7c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:45.002061 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577c726-bc1d-4d42-bb41-94cd2aab7c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:45.003996 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577c726-bc1d-4d42-bb41-94cd2aab7c43 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:45.028534 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1416/2825] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:12:44 2021] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:12:45.032577 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e34964-364e-4c41-84a8-2d9467de1d8f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:45.042945 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e34964-364e-4c41-84a8-2d9467de1d8f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:45.095578 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ce46d-055a-4897-bc42-af45f2685b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:45.096235 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ce46d-055a-4897-bc42-af45f2685b83 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:45.096527 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ce46d-055a-4897-bc42-af45f2685b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:45.096808 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ce46d-055a-4897-bc42-af45f2685b83 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:45.097497 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ce46d-055a-4897-bc42-af45f2685b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:45.099608 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ce46d-055a-4897-bc42-af45f2685b83 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:45.121941 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1410/2826] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:12:45 2021] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 01:12:45.123165 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577c726-bc1d-4d42-bb41-94cd2aab7c43 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:45.133364 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577c726-bc1d-4d42-bb41-94cd2aab7c43 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:45.138043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffe95f-0043-4f77-9f9b-4159193e070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:45.138699 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffe95f-0043-4f77-9f9b-4159193e070e admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:45.139033 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffe95f-0043-4f77-9f9b-4159193e070e admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:45.139317 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffe95f-0043-4f77-9f9b-4159193e070e admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:45.140072 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffe95f-0043-4f77-9f9b-4159193e070e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:45.141662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffe95f-0043-4f77-9f9b-4159193e070e admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:45.152491 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1417/2827] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:12:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:12:45.156160 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ce46d-055a-4897-bc42-af45f2685b83 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:45.166545 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ce46d-055a-4897-bc42-af45f2685b83 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:45.171562 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e345711-d4d7-4059-9252-78c4e2cfc883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:45.172160 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e345711-d4d7-4059-9252-78c4e2cfc883 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:45.172451 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e345711-d4d7-4059-9252-78c4e2cfc883 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:45.172731 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e345711-d4d7-4059-9252-78c4e2cfc883 admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:45.173458 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e345711-d4d7-4059-9252-78c4e2cfc883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:45.175102 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e345711-d4d7-4059-9252-78c4e2cfc883 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:45.185437 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1411/2828] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:12:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:12:45.189331 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffe95f-0043-4f77-9f9b-4159193e070e admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:45.200294 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffe95f-0043-4f77-9f9b-4159193e070e admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:45.204987 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f42497-6d75-48ee-91cf-378ce462405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:45.205958 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f42497-6d75-48ee-91cf-378ce462405f admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:45.206297 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f42497-6d75-48ee-91cf-378ce462405f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:45.206578 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f42497-6d75-48ee-91cf-378ce462405f admin admin] PATH_INFO: `/v3/projects/d3b2596f6cb642de8c6092a4edaa9de5/users/98e09550f2384025b32d2ba76afd46b2/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:45.220652 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f42497-6d75-48ee-91cf-378ce462405f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b2596f6cb642de8c6092a4edaa9de5, user_id=98e09550f2384025b32d2ba76afd46b2, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:45.223333 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f42497-6d75-48ee-91cf-378ce462405f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:45.235918 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1418/2829] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:12:45 2021] PUT /identity/v3/projects/d3b2596f6cb642de8c6092a4edaa9de5/users/98e09550f2384025b32d2ba76afd46b2/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 01:12:45.246182 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf639e8b-394d-4bb7-9d88-6f03b8594bfb None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:45.246502 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf639e8b-394d-4bb7-9d88-6f03b8594bfb None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:45.246793 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf639e8b-394d-4bb7-9d88-6f03b8594bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:45.274268 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-bf639e8b-394d-4bb7-9d88-6f03b8594bfb None None] MFA Rules not processed for user `98e09550f2384025b32d2ba76afd46b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:12:45.275519 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-bf639e8b-394d-4bb7-9d88-6f03b8594bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:45.336814 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1412/2830] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:12:45 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:12:45.346961 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f42497-6d75-48ee-91cf-378ce462405f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:12:45.348622 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-e1f42497-6d75-48ee-91cf-378ce462405f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:12:45.403988 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f42497-6d75-48ee-91cf-378ce462405f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:12:45.407613 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa82e8-7019-43fc-952e-63c2ebc2b5f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:12:45.408246 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa82e8-7019-43fc-952e-63c2ebc2b5f3 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:12:45.408529 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa82e8-7019-43fc-952e-63c2ebc2b5f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:12:45.408802 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa82e8-7019-43fc-952e-63c2ebc2b5f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:12:45.417868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa82e8-7019-43fc-952e-63c2ebc2b5f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:12:45.419391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa82e8-7019-43fc-952e-63c2ebc2b5f3 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:12:45.427927 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1419/2831] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:12:45 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:13:08.995629 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf639e8b-394d-4bb7-9d88-6f03b8594bfb None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:09.055307 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf639e8b-394d-4bb7-9d88-6f03b8594bfb None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:09.059779 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bbacd-aed9-492d-8e11-ed3906632f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:09.060665 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bbacd-aed9-492d-8e11-ed3906632f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:09.060949 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bbacd-aed9-492d-8e11-ed3906632f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:09.061227 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bbacd-aed9-492d-8e11-ed3906632f4f admin admin] PATH_INFO: `/v3/users/98e09550f2384025b32d2ba76afd46b2` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:09.062386 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bbacd-aed9-492d-8e11-ed3906632f4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e09550f2384025b32d2ba76afd46b2)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:09.064336 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bbacd-aed9-492d-8e11-ed3906632f4f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:09.109054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-807bbacd-aed9-492d-8e11-ed3906632f4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e09550f2384025b32d2ba76afd46b2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:09.115644 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-807bbacd-aed9-492d-8e11-ed3906632f4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e09550f2384025b32d2ba76afd46b2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:09.123437 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-807bbacd-aed9-492d-8e11-ed3906632f4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e09550f2384025b32d2ba76afd46b2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:09.135594 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-807bbacd-aed9-492d-8e11-ed3906632f4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e09550f2384025b32d2ba76afd46b2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:09.136225 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-807bbacd-aed9-492d-8e11-ed3906632f4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e09550f2384025b32d2ba76afd46b2'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:09.141959 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1413/2832] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:13:08 2021] DELETE /identity/v3/users/98e09550f2384025b32d2ba76afd46b2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:13:09.146373 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e5f8e-af8c-487b-8bb6-ca7bf1e0d5c9 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:09.146868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e5f8e-af8c-487b-8bb6-ca7bf1e0d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:09.146962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e5f8e-af8c-487b-8bb6-ca7bf1e0d5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:09.163262 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-083e5f8e-af8c-487b-8bb6-ca7bf1e0d5c9 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:13:09.164949 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-083e5f8e-af8c-487b-8bb6-ca7bf1e0d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:09.223663 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1420/2833] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:13:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:13:09.233788 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bbacd-aed9-492d-8e11-ed3906632f4f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:09.235234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-807bbacd-aed9-492d-8e11-ed3906632f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:09.291127 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bbacd-aed9-492d-8e11-ed3906632f4f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:09.294774 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52992a-f0d7-4451-9ee2-497e56ccc664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:09.295445 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52992a-f0d7-4451-9ee2-497e56ccc664 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:09.295732 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52992a-f0d7-4451-9ee2-497e56ccc664 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:09.296010 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52992a-f0d7-4451-9ee2-497e56ccc664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:09.305570 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52992a-f0d7-4451-9ee2-497e56ccc664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:09.307051 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52992a-f0d7-4451-9ee2-497e56ccc664 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:09.316425 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1414/2834] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:13:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:13:09.566387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e5f8e-af8c-487b-8bb6-ca7bf1e0d5c9 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:09.567879 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-083e5f8e-af8c-487b-8bb6-ca7bf1e0d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:09.581712 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e5f8e-af8c-487b-8bb6-ca7bf1e0d5c9 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:09.586516 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dff1c-4e88-4194-9525-9931dee59ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:09.587413 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dff1c-4e88-4194-9525-9931dee59ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:09.587729 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dff1c-4e88-4194-9525-9931dee59ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:09.587999 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dff1c-4e88-4194-9525-9931dee59ebe admin admin] PATH_INFO: `/v3/projects/d3b2596f6cb642de8c6092a4edaa9de5` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:09.589213 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dff1c-4e88-4194-9525-9931dee59ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b2596f6cb642de8c6092a4edaa9de5)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:09.591145 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dff1c-4e88-4194-9525-9931dee59ebe admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:09.636240 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-996dff1c-4e88-4194-9525-9931dee59ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b2596f6cb642de8c6092a4edaa9de5', 'request_id': 'req-996dff1c-4e88-4194-9525-9931dee59ebe'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:09.641306 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-996dff1c-4e88-4194-9525-9931dee59ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b2596f6cb642de8c6092a4edaa9de5', 'request_id': 'req-996dff1c-4e88-4194-9525-9931dee59ebe'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:09.647160 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-996dff1c-4e88-4194-9525-9931dee59ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b2596f6cb642de8c6092a4edaa9de5', 'request_id': 'req-996dff1c-4e88-4194-9525-9931dee59ebe'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:09.659692 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-996dff1c-4e88-4194-9525-9931dee59ebe admin admin] The token cache is being invalidate because project d3b2596f6cb642de8c6092a4edaa9de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:13:09.659921 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-996dff1c-4e88-4194-9525-9931dee59ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:09.660550 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-996dff1c-4e88-4194-9525-9931dee59ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:09.662070 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1421/2835] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:13:09 2021] DELETE /identity/v3/projects/d3b2596f6cb642de8c6092a4edaa9de5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:13:09.669750 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c6b7-9937-4bd7-905f-c6dde0b54580 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:09.670041 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c6b7-9937-4bd7-905f-c6dde0b54580 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:09.670350 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c6b7-9937-4bd7-905f-c6dde0b54580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:09.690125 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-9107c6b7-9937-4bd7-905f-c6dde0b54580 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:13:09.691377 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-9107c6b7-9937-4bd7-905f-c6dde0b54580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:09.748672 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1415/2836] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:13:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:13:09.757471 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7df495-e27d-4b27-9148-34aed66ad001 None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:09.757770 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7df495-e27d-4b27-9148-34aed66ad001 None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:09.758049 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7df495-e27d-4b27-9148-34aed66ad001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:09.776570 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-eb7df495-e27d-4b27-9148-34aed66ad001 None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:13:09.777774 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-eb7df495-e27d-4b27-9148-34aed66ad001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:09.785653 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1422/2837] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:13:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 01:13:09.790435 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107c6b7-9937-4bd7-905f-c6dde0b54580 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:09.800054 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107c6b7-9937-4bd7-905f-c6dde0b54580 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:09.805027 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece2846-72e9-4699-9a4f-bd0a2fa4248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:09.805676 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece2846-72e9-4699-9a4f-bd0a2fa4248a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:09.805953 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece2846-72e9-4699-9a4f-bd0a2fa4248a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:09.806228 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece2846-72e9-4699-9a4f-bd0a2fa4248a admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:09.807011 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece2846-72e9-4699-9a4f-bd0a2fa4248a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 01:13:09.807317 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece2846-72e9-4699-9a4f-bd0a2fa4248a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:09.808896 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece2846-72e9-4699-9a4f-bd0a2fa4248a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:09.820201 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1416/2838] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 01:13:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 01:13:09.824391 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7df495-e27d-4b27-9148-34aed66ad001 None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:09.833387 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7df495-e27d-4b27-9148-34aed66ad001 None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:09.839044 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995e74c-3681-4c98-81b9-2bb5d1fd1751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:09.839698 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995e74c-3681-4c98-81b9-2bb5d1fd1751 admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:09.839987 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995e74c-3681-4c98-81b9-2bb5d1fd1751 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:09.840272 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995e74c-3681-4c98-81b9-2bb5d1fd1751 admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:09.840962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995e74c-3681-4c98-81b9-2bb5d1fd1751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:09.842870 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995e74c-3681-4c98-81b9-2bb5d1fd1751 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:09.868868 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1423/2839] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:13:09 2021] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:13:09.872723 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece2846-72e9-4699-9a4f-bd0a2fa4248a admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:09.882438 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece2846-72e9-4699-9a4f-bd0a2fa4248a admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:09.936066 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82970e3c-7753-4a0a-8c5c-e5d8e988f926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:09.936738 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82970e3c-7753-4a0a-8c5c-e5d8e988f926 admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:09.937030 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82970e3c-7753-4a0a-8c5c-e5d8e988f926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:09.937309 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82970e3c-7753-4a0a-8c5c-e5d8e988f926 admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:09.938006 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82970e3c-7753-4a0a-8c5c-e5d8e988f926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:09.939962 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82970e3c-7753-4a0a-8c5c-e5d8e988f926 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:09.958412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1417/2840] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:13:09 2021] POST /identity/v3/users => generated 292 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:13:09.963382 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995e74c-3681-4c98-81b9-2bb5d1fd1751 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:09.973311 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995e74c-3681-4c98-81b9-2bb5d1fd1751 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:09.978662 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388992c-7854-4b87-bd29-fead0aab9ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:09.979609 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388992c-7854-4b87-bd29-fead0aab9ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:09.979895 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388992c-7854-4b87-bd29-fead0aab9ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:09.980172 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388992c-7854-4b87-bd29-fead0aab9ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:09.980893 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388992c-7854-4b87-bd29-fead0aab9ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:09.982490 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388992c-7854-4b87-bd29-fead0aab9ae3 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:09.992740 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1424/2841] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:13:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:13:09.996336 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82970e3c-7753-4a0a-8c5c-e5d8e988f926 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:10.006404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82970e3c-7753-4a0a-8c5c-e5d8e988f926 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:10.011718 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5d819-1a44-4b29-8c40-2aa0108cbd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:10.012369 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5d819-1a44-4b29-8c40-2aa0108cbd0a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:10.012654 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5d819-1a44-4b29-8c40-2aa0108cbd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:10.012933 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5d819-1a44-4b29-8c40-2aa0108cbd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:10.013650 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5d819-1a44-4b29-8c40-2aa0108cbd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:10.015281 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5d819-1a44-4b29-8c40-2aa0108cbd0a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:10.025697 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1418/2842] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:13:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:13:10.029571 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388992c-7854-4b87-bd29-fead0aab9ae3 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:10.039413 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388992c-7854-4b87-bd29-fead0aab9ae3 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:10.044021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2144e-614c-4f7d-8090-dbf1b49ab33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:10.044883 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2144e-614c-4f7d-8090-dbf1b49ab33b admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:10.045169 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2144e-614c-4f7d-8090-dbf1b49ab33b admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:10.045447 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2144e-614c-4f7d-8090-dbf1b49ab33b admin admin] PATH_INFO: `/v3/projects/572c81f2c2c6475791fbaed65513a74a/users/c460d6d5c4134355963eb5d4617d71e5/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:10.059556 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2144e-614c-4f7d-8090-dbf1b49ab33b admin admin] RBAC: Authorizing `identity:create_grant(project_id=572c81f2c2c6475791fbaed65513a74a, user_id=c460d6d5c4134355963eb5d4617d71e5, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:10.062187 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2144e-614c-4f7d-8090-dbf1b49ab33b admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:10.074913 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1425/2843] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:13:10 2021] PUT /identity/v3/projects/572c81f2c2c6475791fbaed65513a74a/users/c460d6d5c4134355963eb5d4617d71e5/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 01:13:10.084911 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9819546-54a5-48e7-b4dc-697d16ea7e7d None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:10.085211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9819546-54a5-48e7-b4dc-697d16ea7e7d None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:10.086234 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9819546-54a5-48e7-b4dc-697d16ea7e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:10.111919 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-f9819546-54a5-48e7-b4dc-697d16ea7e7d None None] MFA Rules not processed for user `c460d6d5c4134355963eb5d4617d71e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:13:10.113154 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-f9819546-54a5-48e7-b4dc-697d16ea7e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:10.174790 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1419/2844] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:13:10 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 01:13:10.185178 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2144e-614c-4f7d-8090-dbf1b49ab33b admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:10.186785 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-dbe2144e-614c-4f7d-8090-dbf1b49ab33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:10.241959 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2144e-614c-4f7d-8090-dbf1b49ab33b admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:10.245680 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea4149-cc25-4c32-8e80-5e94020e6797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:10.246327 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea4149-cc25-4c32-8e80-5e94020e6797 service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:10.246618 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea4149-cc25-4c32-8e80-5e94020e6797 service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:10.246935 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea4149-cc25-4c32-8e80-5e94020e6797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:10.255021 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea4149-cc25-4c32-8e80-5e94020e6797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:10.256494 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea4149-cc25-4c32-8e80-5e94020e6797 service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:10.265993 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1426/2845] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:13:10 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:13:12.781643 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9819546-54a5-48e7-b4dc-697d16ea7e7d None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:12.840900 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9819546-54a5-48e7-b4dc-697d16ea7e7d None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:12.845505 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ac7a5-05bd-42eb-a552-dce59f5eb900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:12.846364 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ac7a5-05bd-42eb-a552-dce59f5eb900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:12.846647 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ac7a5-05bd-42eb-a552-dce59f5eb900 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:12.846952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ac7a5-05bd-42eb-a552-dce59f5eb900 admin admin] PATH_INFO: `/v3/users/c460d6d5c4134355963eb5d4617d71e5` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:12.848131 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ac7a5-05bd-42eb-a552-dce59f5eb900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c460d6d5c4134355963eb5d4617d71e5)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:12.850043 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ac7a5-05bd-42eb-a552-dce59f5eb900 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:12.894209 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-cb5ac7a5-05bd-42eb-a552-dce59f5eb900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c460d6d5c4134355963eb5d4617d71e5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:12.901212 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-cb5ac7a5-05bd-42eb-a552-dce59f5eb900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c460d6d5c4134355963eb5d4617d71e5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:12.907701 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-cb5ac7a5-05bd-42eb-a552-dce59f5eb900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c460d6d5c4134355963eb5d4617d71e5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:12.919725 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-cb5ac7a5-05bd-42eb-a552-dce59f5eb900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c460d6d5c4134355963eb5d4617d71e5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:12.920361 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-cb5ac7a5-05bd-42eb-a552-dce59f5eb900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c460d6d5c4134355963eb5d4617d71e5'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:12.926461 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1420/2846] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:13:12 2021] DELETE /identity/v3/users/c460d6d5c4134355963eb5d4617d71e5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:13:12.931763 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245da590-9b7f-44a1-ae84-ce7b0946e47b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:12.932207 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245da590-9b7f-44a1-ae84-ce7b0946e47b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:12.932356 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245da590-9b7f-44a1-ae84-ce7b0946e47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:12.949290 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-245da590-9b7f-44a1-ae84-ce7b0946e47b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:13:12.950512 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-245da590-9b7f-44a1-ae84-ce7b0946e47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:13.008318 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1427/2847] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:13:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 01:13:13.018211 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ac7a5-05bd-42eb-a552-dce59f5eb900 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:13.019579 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-cb5ac7a5-05bd-42eb-a552-dce59f5eb900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:13.075241 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ac7a5-05bd-42eb-a552-dce59f5eb900 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:13.078917 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985fdab-b554-445a-905f-d566e80dfec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:13.079561 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985fdab-b554-445a-905f-d566e80dfec4 service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:13.079846 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985fdab-b554-445a-905f-d566e80dfec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:13.080125 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985fdab-b554-445a-905f-d566e80dfec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:13.089671 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985fdab-b554-445a-905f-d566e80dfec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:13.091161 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985fdab-b554-445a-905f-d566e80dfec4 service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:13.100316 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1421/2848] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:13:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:13:13.351777 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245da590-9b7f-44a1-ae84-ce7b0946e47b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:13.353254 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-245da590-9b7f-44a1-ae84-ce7b0946e47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:13.368157 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245da590-9b7f-44a1-ae84-ce7b0946e47b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:13.373817 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490e929-12d0-48f3-883c-bcf6ba985312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:13.374683 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e929-12d0-48f3-883c-bcf6ba985312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:13.375015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e929-12d0-48f3-883c-bcf6ba985312 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:13.375300 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e929-12d0-48f3-883c-bcf6ba985312 admin admin] PATH_INFO: `/v3/projects/572c81f2c2c6475791fbaed65513a74a` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:13.376582 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490e929-12d0-48f3-883c-bcf6ba985312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=572c81f2c2c6475791fbaed65513a74a)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:13.378423 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490e929-12d0-48f3-883c-bcf6ba985312 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:13.426352 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-e490e929-12d0-48f3-883c-bcf6ba985312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572c81f2c2c6475791fbaed65513a74a', 'request_id': 'req-e490e929-12d0-48f3-883c-bcf6ba985312'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:13.432660 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-e490e929-12d0-48f3-883c-bcf6ba985312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572c81f2c2c6475791fbaed65513a74a', 'request_id': 'req-e490e929-12d0-48f3-883c-bcf6ba985312'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:13.438749 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-e490e929-12d0-48f3-883c-bcf6ba985312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572c81f2c2c6475791fbaed65513a74a', 'request_id': 'req-e490e929-12d0-48f3-883c-bcf6ba985312'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:13.451506 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-e490e929-12d0-48f3-883c-bcf6ba985312 admin admin] The token cache is being invalidate because project 572c81f2c2c6475791fbaed65513a74a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:13:13.451796 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-e490e929-12d0-48f3-883c-bcf6ba985312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:13.452425 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-e490e929-12d0-48f3-883c-bcf6ba985312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:13.453998 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1428/2849] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:13:13 2021] DELETE /identity/v3/projects/572c81f2c2c6475791fbaed65513a74a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:13:13.459628 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119c69b-e668-4def-9cf5-23cd9b3d413a None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:13.460033 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119c69b-e668-4def-9cf5-23cd9b3d413a None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:13.460423 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119c69b-e668-4def-9cf5-23cd9b3d413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:13.478299 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-8119c69b-e668-4def-9cf5-23cd9b3d413a None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:13:13.479927 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8119c69b-e668-4def-9cf5-23cd9b3d413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:13.542616 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1422/2850] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:13:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:13:13.550985 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9af61-c2d9-4ffa-94de-ac29ffe3ef7b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:13.551281 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9af61-c2d9-4ffa-94de-ac29ffe3ef7b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:13.551564 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9af61-c2d9-4ffa-94de-ac29ffe3ef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:13.569873 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-70b9af61-c2d9-4ffa-94de-ac29ffe3ef7b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:13:13.571102 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-70b9af61-c2d9-4ffa-94de-ac29ffe3ef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:13.578956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1429/2851] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:13:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:13:13.582942 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119c69b-e668-4def-9cf5-23cd9b3d413a None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:13.592924 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119c69b-e668-4def-9cf5-23cd9b3d413a None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:13.597498 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52c2b2-6254-477b-95c1-94b26852d4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:13.598144 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52c2b2-6254-477b-95c1-94b26852d4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:13.598428 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52c2b2-6254-477b-95c1-94b26852d4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:13.598704 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52c2b2-6254-477b-95c1-94b26852d4d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:13.599453 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52c2b2-6254-477b-95c1-94b26852d4d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86001) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 01:13:13.599761 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52c2b2-6254-477b-95c1-94b26852d4d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:13.602055 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52c2b2-6254-477b-95c1-94b26852d4d1 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:13.613490 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1423/2852] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Nov 16 01:13:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 01:13:13.617548 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9af61-c2d9-4ffa-94de-ac29ffe3ef7b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:13.626380 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9af61-c2d9-4ffa-94de-ac29ffe3ef7b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:13.631034 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5eb2c-b39c-4624-b88b-50ab4c1e9edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:13.631698 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5eb2c-b39c-4624-b88b-50ab4c1e9edd admin admin] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:13.632013 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5eb2c-b39c-4624-b88b-50ab4c1e9edd admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:13.632624 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5eb2c-b39c-4624-b88b-50ab4c1e9edd admin admin] PATH_INFO: `/v3/projects` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:13.633096 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5eb2c-b39c-4624-b88b-50ab4c1e9edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:13.635004 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5eb2c-b39c-4624-b88b-50ab4c1e9edd admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:13.659284 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1430/2853] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Nov 16 01:13:13 2021] POST /identity/v3/projects => generated 391 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:13:13.663088 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52c2b2-6254-477b-95c1-94b26852d4d1 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:13.673748 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52c2b2-6254-477b-95c1-94b26852d4d1 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:13.727404 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af5ad7-6563-47a7-868b-587a96e1f40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:13.728063 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af5ad7-6563-47a7-868b-587a96e1f40f admin admin] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:13.728349 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af5ad7-6563-47a7-868b-587a96e1f40f admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:13.728625 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af5ad7-6563-47a7-868b-587a96e1f40f admin admin] PATH_INFO: `/v3/users` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:13.729666 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af5ad7-6563-47a7-868b-587a96e1f40f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:13.731719 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af5ad7-6563-47a7-868b-587a96e1f40f admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:13.751112 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1424/2854] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Nov 16 01:13:13 2021] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 01:13:13.754649 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5eb2c-b39c-4624-b88b-50ab4c1e9edd admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:13.765334 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5eb2c-b39c-4624-b88b-50ab4c1e9edd admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:13.769962 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8edff-3640-4e23-b3f7-e451c264072f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:13.770610 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8edff-3640-4e23-b3f7-e451c264072f admin admin] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:13.770920 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8edff-3640-4e23-b3f7-e451c264072f admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:13.771195 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8edff-3640-4e23-b3f7-e451c264072f admin admin] PATH_INFO: `/v3/roles` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:13.771914 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8edff-3640-4e23-b3f7-e451c264072f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:13.774275 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8edff-3640-4e23-b3f7-e451c264072f admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:13.784339 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1431/2855] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:13:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:13:13.788241 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af5ad7-6563-47a7-868b-587a96e1f40f admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:13.798113 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af5ad7-6563-47a7-868b-587a96e1f40f admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:13.802663 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551ea2b-5114-4cf8-9d00-58cc0d9e861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:13.803378 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551ea2b-5114-4cf8-9d00-58cc0d9e861a admin admin] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:13.803667 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551ea2b-5114-4cf8-9d00-58cc0d9e861a admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:13.804134 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551ea2b-5114-4cf8-9d00-58cc0d9e861a admin admin] PATH_INFO: `/v3/roles` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:13.804927 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551ea2b-5114-4cf8-9d00-58cc0d9e861a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:13.806530 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551ea2b-5114-4cf8-9d00-58cc0d9e861a admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:13.816287 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1425/2856] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Nov 16 01:13:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 01:13:13.820793 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8edff-3640-4e23-b3f7-e451c264072f admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:13.830454 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8edff-3640-4e23-b3f7-e451c264072f admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:13.835136 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3f576-8133-4d21-8e41-ae9e60392ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:13.836605 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3f576-8133-4d21-8e41-ae9e60392ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:13.836889 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3f576-8133-4d21-8e41-ae9e60392ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:13.837168 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3f576-8133-4d21-8e41-ae9e60392ba6 admin admin] PATH_INFO: `/v3/projects/6f6fac999c824af399ece13f3bd664af/users/51a4b29d701e43ad9227d4baeb892389/roles/e338c12e36c04cffba27cfe873d606aa` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:13.851693 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3f576-8133-4d21-8e41-ae9e60392ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6fac999c824af399ece13f3bd664af, user_id=51a4b29d701e43ad9227d4baeb892389, role_id=e338c12e36c04cffba27cfe873d606aa)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:13.854580 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3f576-8133-4d21-8e41-ae9e60392ba6 admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:13.867368 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1432/2857] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Nov 16 01:13:13 2021] PUT /identity/v3/projects/6f6fac999c824af399ece13f3bd664af/users/51a4b29d701e43ad9227d4baeb892389/roles/e338c12e36c04cffba27cfe873d606aa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:13:13.878142 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae30d05-d514-414d-a310-81ab197f0995 None None] REQUEST_METHOD: `POST` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:13.878460 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae30d05-d514-414d-a310-81ab197f0995 None None] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:13.878747 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae30d05-d514-414d-a310-81ab197f0995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:13.905412 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.auth.core [None req-7ae30d05-d514-414d-a310-81ab197f0995 None None] MFA Rules not processed for user `51a4b29d701e43ad9227d4baeb892389`. Rule list: `[]` (Enabled: `True`). {{(pid=86001) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:13:13.906603 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-7ae30d05-d514-414d-a310-81ab197f0995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:13.967417 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1426/2858] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:13:13 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:13:13.977865 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3f576-8133-4d21-8e41-ae9e60392ba6 admin admin] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:13.979890 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-80c3f576-8133-4d21-8e41-ae9e60392ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:14.034641 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3f576-8133-4d21-8e41-ae9e60392ba6 admin admin] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:14.038400 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56b000-3764-4175-ab26-8a792698a10e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292b73337e674cdfa9c05fe67040cf94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:14.039548 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56b000-3764-4175-ab26-8a792698a10e service cinder] REQUEST_METHOD: `GET` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:14.039834 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56b000-3764-4175-ab26-8a792698a10e service cinder] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:14.040129 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56b000-3764-4175-ab26-8a792698a10e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:14.048082 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56b000-3764-4175-ab26-8a792698a10e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:14.049548 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56b000-3764-4175-ab26-8a792698a10e service cinder] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:14.058526 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1433/2859] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:13:13 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:13:37.221449 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae30d05-d514-414d-a310-81ab197f0995 None None] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:37.281177 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae30d05-d514-414d-a310-81ab197f0995 None None] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:37.285656 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04b3a6-5956-45ae-8e54-f579c8078524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:37.286514 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04b3a6-5956-45ae-8e54-f579c8078524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:37.286800 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04b3a6-5956-45ae-8e54-f579c8078524 admin admin] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:37.287109 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04b3a6-5956-45ae-8e54-f579c8078524 admin admin] PATH_INFO: `/v3/users/51a4b29d701e43ad9227d4baeb892389` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:37.288288 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04b3a6-5956-45ae-8e54-f579c8078524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51a4b29d701e43ad9227d4baeb892389)` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:37.290200 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04b3a6-5956-45ae-8e54-f579c8078524 admin admin] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:37.333299 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8a04b3a6-5956-45ae-8e54-f579c8078524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51a4b29d701e43ad9227d4baeb892389'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:37.340303 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8a04b3a6-5956-45ae-8e54-f579c8078524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51a4b29d701e43ad9227d4baeb892389'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:37.347078 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8a04b3a6-5956-45ae-8e54-f579c8078524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51a4b29d701e43ad9227d4baeb892389'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:37.359837 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8a04b3a6-5956-45ae-8e54-f579c8078524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51a4b29d701e43ad9227d4baeb892389'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:37.360488 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.notifications [None req-8a04b3a6-5956-45ae-8e54-f579c8078524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51a4b29d701e43ad9227d4baeb892389'} {{(pid=86001) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:37.366186 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1427/2860] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Nov 16 01:13:37 2021] DELETE /identity/v3/users/51a4b29d701e43ad9227d4baeb892389 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:13:37.371376 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be4198-edeb-40ee-9067-73723e815b2b None None] REQUEST_METHOD: `POST` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:37.371866 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be4198-edeb-40ee-9067-73723e815b2b None None] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:37.371967 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be4198-edeb-40ee-9067-73723e815b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:37.388854 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.auth.core [None req-08be4198-edeb-40ee-9067-73723e815b2b None None] MFA Rules not processed for user `9ebf9643a2de4a8a9500c2ccce871c70`. Rule list: `[]` (Enabled: `True`). {{(pid=86000) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 01:13:37.390043 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-08be4198-edeb-40ee-9067-73723e815b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:37.445677 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1434/2861] 10.222.0.50 () {58 vars in 957 bytes} [Tue Nov 16 01:13:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 01:13:37.456171 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04b3a6-5956-45ae-8e54-f579c8078524 admin admin] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:37.457496 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-8a04b3a6-5956-45ae-8e54-f579c8078524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:37.513453 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04b3a6-5956-45ae-8e54-f579c8078524 admin admin] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:37.517202 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256f89-d1dc-4917-8d6d-d47bb102707d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7893cca0610b40abb9c45414f3690df0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:37.517848 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256f89-d1dc-4917-8d6d-d47bb102707d service neutron] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:37.518138 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256f89-d1dc-4917-8d6d-d47bb102707d service neutron] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:37.518419 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256f89-d1dc-4917-8d6d-d47bb102707d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:37.527340 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48256f89-d1dc-4917-8d6d-d47bb102707d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:37.528785 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48256f89-d1dc-4917-8d6d-d47bb102707d service neutron] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:37.538128 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1428/2862] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:13:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 01:13:37.794465 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be4198-edeb-40ee-9067-73723e815b2b None None] Authenticating user token {{(pid=86000) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:13:37.795966 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.fernet_utils [None req-08be4198-edeb-40ee-9067-73723e815b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86000) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:13:37.808447 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be4198-edeb-40ee-9067-73723e815b2b None None] Validating token access rules against request {{(pid=86000) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:13:37.813037 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b215c3-c25f-47bf-8eeb-c821156a4c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ebf9643a2de4a8a9500c2ccce871c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aec0bf3f5ba404495a1eab25f1fe71c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86000) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:13:37.813895 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b215c3-c25f-47bf-8eeb-c821156a4c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:13:37.814177 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b215c3-c25f-47bf-8eeb-c821156a4c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:13:37.814450 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b215c3-c25f-47bf-8eeb-c821156a4c3a admin admin] PATH_INFO: `/v3/projects/6f6fac999c824af399ece13f3bd664af` {{(pid=86000) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:13:37.815657 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b215c3-c25f-47bf-8eeb-c821156a4c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6fac999c824af399ece13f3bd664af)` {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:13:37.817543 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b215c3-c25f-47bf-8eeb-c821156a4c3a admin admin] RBAC: Authorization granted {{(pid=86000) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:13:37.866015 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-71b215c3-c25f-47bf-8eeb-c821156a4c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6fac999c824af399ece13f3bd664af', 'request_id': 'req-71b215c3-c25f-47bf-8eeb-c821156a4c3a'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:37.872712 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-71b215c3-c25f-47bf-8eeb-c821156a4c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6fac999c824af399ece13f3bd664af', 'request_id': 'req-71b215c3-c25f-47bf-8eeb-c821156a4c3a'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:37.878956 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-71b215c3-c25f-47bf-8eeb-c821156a4c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6fac999c824af399ece13f3bd664af', 'request_id': 'req-71b215c3-c25f-47bf-8eeb-c821156a4c3a'} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:37.891032 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-71b215c3-c25f-47bf-8eeb-c821156a4c3a admin admin] The token cache is being invalidate because project 6f6fac999c824af399ece13f3bd664af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86000) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 01:13:37.891322 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-71b215c3-c25f-47bf-8eeb-c821156a4c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:37.892153 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: DEBUG keystone.notifications [None req-71b215c3-c25f-47bf-8eeb-c821156a4c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86000) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 01:13:37.893813 dv-cinder-811155-2-iscsi devstack@keystone.service[86000]: [pid: 86000|app: 0|req: 1435/2863] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Nov 16 01:13:37 2021] DELETE /identity/v3/projects/6f6fac999c824af399ece13f3bd664af => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 01:16:31.129538 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256f89-d1dc-4917-8d6d-d47bb102707d service neutron] Authenticating user token {{(pid=86001) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 01:16:31.131484 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-48256f89-d1dc-4917-8d6d-d47bb102707d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:16:31.227313 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256f89-d1dc-4917-8d6d-d47bb102707d service neutron] Validating token access rules against request {{(pid=86001) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 01:16:31.283513 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17da66-d1d2-4873-b2c3-7a435d8ad08f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '678965f2159e4c33bf2465058f69ff02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cce43bc1cdb744a2b2c65dd4c50d6599', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86001) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 01:16:31.284159 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17da66-d1d2-4873-b2c3-7a435d8ad08f service placement] REQUEST_METHOD: `GET` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 01:16:31.284468 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17da66-d1d2-4873-b2c3-7a435d8ad08f service placement] SCRIPT_NAME: `/identity` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 01:16:31.284744 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17da66-d1d2-4873-b2c3-7a435d8ad08f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86001) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 01:16:31.286471 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.fernet_utils [None req-0a17da66-d1d2-4873-b2c3-7a435d8ad08f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86001) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 01:16:31.297353 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17da66-d1d2-4873-b2c3-7a435d8ad08f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 01:16:31.298952 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17da66-d1d2-4873-b2c3-7a435d8ad08f service placement] RBAC: Authorization granted {{(pid=86001) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 01:16:31.309128 dv-cinder-811155-2-iscsi devstack@keystone.service[86001]: [pid: 86001|app: 0|req: 1429/2864] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Nov 16 01:16:31 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)